128 bundles failed for Mouse Gastrulation Atlas

HumanCellAtlas / ingest-central

Ingest Central is the hub repository for the ingest service

Apache License 2.0

0 stars 1 forks source link

128 bundles failed for Mouse Gastrulation Atlas #499

Closed ESapenaVentura closed 4 years ago

ESapenaVentura commented 5 years ago

For Mouse gastrulation atlas, 128 bundles never got to see the sunlight:

Submission UUID: a32f53ce-d752-47a0-8372-d15d17e5f645
When: 08/08/2019
Ticket in Wrangling repo: Here

rdgoite commented 5 years ago

If I understand correctly, for this dataset, there are 63 donors, and some of the specimens in this dataset refer to multiple donors. Upon initial investigation, the 128 bundles seem to have gone missing due to a problem between Ingest and upload service during the upload of the metadata for one of the donors (346bf1a8-319c-4bc9-88d2-c27b6eaf8240). Here's a link to the logs I gathered through Kibana.

parthshahva commented 5 years ago

This is the known issue that occured for Tabula Muris. This is due to the simultaneous upload of the same metadata file that will be resolved in the exporter redesign.

fixed the files (['a32f53ce-d752-47a0-8372-d15d17e5f645/donor_organism_346bf1a8-319c-4bc9-88d2-c27b6eaf8240.json', 'a32f53ce-d752-47a0-8372-d15d17e5f645/process_483152cb-8df6-4636-b859-9be354182f34.json']) so that exporting can be finished

ESapenaVentura commented 5 years ago

I've looked at it in the tracker and it seems that it still isn't finished uploading :/ Any idea?

parthshahva commented 5 years ago

@ESapenaVentura I just fixed the files. An ingest developer still needs to kick the exporting

ESapenaVentura commented 5 years ago

Thanks @parthshahva ! I've talked with @rdgoite today and we will work on this next week. We are prioritising the other dataset as we need it uploaded ASAP

justincc commented 5 years ago

We will pause this at least until next ingest sprint (beginning 2019-08-20) in favor of addressing #482

justincc commented 5 years ago

Had a word with @ESapenaVentura and he says he is prioritizing Barcelona datasets first. He will come back to this when he is ready.

justincc commented 4 years ago

@ESapenaVentura this is no longer blocked now we have the exporter fixes. However, please could you ping us when you proceed.

ESapenaVentura commented 4 years ago

What would be the next step? Re-submit?

justincc commented 4 years ago

Good question. @rdgoite?

jlzamanian commented 4 years ago

@dataops

justincc commented 4 years ago

@ESapenaVentura please re-submit