ebi-ait / hca-ebi-wrangler-central

This repo is for tracking work related to wrangling datasets for the HCA, associated tasks and for maintaining related documentation.
https://ebi-ait.github.io/hca-ebi-wrangler-central/
Apache License 2.0
7 stars 2 forks source link

FoetalLungPeng #274

Closed Wkt8 closed 2 years ago

Wkt8 commented 3 years ago

Primary Wrangler: Wei Kheng Teh

Secondary Wrangler: Ida

Associated files: Link to paper: https://www.biorxiv.org/content/10.1101/2022.01.11.474933v1.full Google Drive: https://drive.google.com/drive/folders/19zWssnTCxFEIqj1AqZDRNWFrGrOlIz8m Link to Ingest: https://contribute.data.humancellatlas.org/submissions/detail?uuid=0b53d1ad-bc5f-4030-818b-b12c7ddf5b6c&project=2fe3c60b-ac1a-4c61-9b59-f6556c0fce63

Key Events

Please track the below as well as the key events:

  1. Track date first spreadsheet received and final spreadsheet sent by editing ticket to include date next to event.
  2. Track spreadsheet iterations by placing asterisks next to receive spreadsheet event.
  3. Track any metadata issues/tickets made for dataset with a bulleted list of links under received spreadsheet event. Links should be to the ticket in the metadata repo.
Wkt8 commented 3 years ago

Waiting to get additional metadata from HDBR.

Wkt8 commented 3 years ago

Peng has mentioned that there are additional donors that he would like to add to this project, and he expects it to be in the DCP around August. Am waiting on him to send us additional information on the new donors.

Wkt8 commented 2 years ago

Peng messaged me today saying the ATAC-seq, BCR and TCR data are ready to submit.

Wkt8 commented 2 years ago

Wrangled scRNA, scATAC-seq, VDJ, and organoid data.

Still waiting on some metadata from Peng on the VISIUM donor metadata. Need to email HDBR to get some metadata for scATAC-seq donors.

idazucchi commented 2 years ago

almost done with archiving Visium data almost done with ATAC-seq data the Visum data will not be in release 12 but the rest of the data will be

Wkt8 commented 2 years ago

We are now archiving this all in Annotare - and they have to be split up into different technologies, which has added a lot more work.

ofanobilbao commented 2 years ago

@Wkt8 to make 4 separate Array Express submissions, as technologies need to be separated.

ofanobilbao commented 2 years ago

It would be useful if he could move the files from HCA-util to annotare. @Wkt8 to create a ticket in operations

ami-day commented 2 years ago

There were some issues with the uploaded fastqs, Wei is looking into this

Wkt8 commented 2 years ago

I have had to split Peng's dataset into four different ArrayExpress submissions:

These have all been submitted to ArrayExpress and will have accessions to send to Peng.

The export to the DCP has not been done yet because Peng is still uncertain about the date for that to go public. The spreadsheet will be in the brokering drive. It probably will not have Visium data added to it yet due to the metadata schema change not being complete which allows imaging (probe and channel) to be optional.

Remaining actions:

Files are available in the hca-util upload area with uuid 4777804d-1b93-4bbf-955f-1c5083e2c504

Wkt8 commented 2 years ago

@idazucchi to sec review

idazucchi commented 2 years ago

Hello! I'm done with the secondary review. There is so much going on in this dataset! It's mostly good, but I have some comments Let me know if you have any question

Project

Donor

Collection protocol

Specimen from donor

Imaging preparation

Imaging protocol

Differentiation

Enrichment

Cell suspension

Library

Sequencing

Sequence file

Wkt8 commented 2 years ago

Have made updates from Ida's secondary review, and am waiting on Peng to give an updated h5ad analysis_files

Wkt8 commented 2 years ago

This is in graph-valid state. Can be exported.

Wkt8 commented 2 years ago

Exporting triggered. Once it has been confirmed that the project has exported, I will fill in the DCP Import Requests form.

ke4 commented 2 years ago

@ke4 and @jacobwindsor to investigate it

Wkt8 commented 2 years ago

Triggered exporting again.

amnonkhen commented 2 years ago

@ke4 and @amnonkhen monitored the exported and found that it finished

Wkt8 commented 2 years ago

Exported! Import Request for Production form submitted.