EBISPOT / goci

GWAS Catalog Ontology and Curation Infrastructure
Apache License 2.0
26 stars 19 forks source link

Move sumstats files and yamls to the public ftp #1304

Closed karatugo closed 4 months ago

karatugo commented 5 months ago

✅ One particular submission with more than 6,000 studies only has md5sums in GCST directories on staging and released to public. No sumstats files or yamls have been created. Submitted on 31.03.24. https://www.ebi.ac.uk/gwas/deposition/submission/6608c665db8d9f000198b901 -- ✅ Copy files to staging -- ✅ Check if the files moved to the staging ftp -- ✅ Check if the files moved to the public ftp -- ✅ Generate metadata yaml files

karatugo commented 5 months ago

Started copying files from the private ftp to staging.

ID:     3670454
Name:   copy_goci1304
karatugo commented 5 months ago

Copying files from the private ftp to staging complete.

karatugo commented 4 months ago

Study files are synced successfully to the public ftp.

karatugo commented 4 months ago

Generate metadata yaml files started here. https://github.com/EBISPOT/goci/issues/1292#issuecomment-2093095857

karatugo commented 4 months ago

Randomly checked a couple of them and the yaml files are in the public ftp.

sprintell commented 4 months ago

@eks-ebi pls help confirm ...

eks-ebi commented 4 months ago

I checked a few and the sumstats and yaml files are there in the public FTP. There is just one weird thing: the filetype field appears to be blank. See examples yaml file here: http://ftp.ebi.ac.uk/pub/databases/gwas/summary_statistics/GCST90384001-GCST90385000/GCST90384080/

karatugo commented 4 months ago

I think this is because they are validated manually. I need to update them in the database.

@eks-ebi Do you know what their correct file types are?

eks-ebi commented 4 months ago

@karatugo please ignore the last message, I was looking at the wrong submission

eks-ebi commented 4 months ago

file type for all should be GWAS-SSF v1.0

karatugo commented 4 months ago

Added the missing file type to https://app.zenhub.com/workspaces/gwas-59df823c4a6feb3786810391/issues/gh/ebispot/goci/1281 and will work on them soon

karatugo commented 4 months ago

If there's nothing else, is it okay close this ticket? @eks-ebi

eks-ebi commented 4 months ago

sorry @karatugo yes I think it's okay to close this ticket