EBISPOT / goci

GWAS Catalog Ontology and Curation Infrastructure
Apache License 2.0
26 stars 19 forks source link

Yamls not being generated #1401

Open earlEBI opened 1 month ago

earlEBI commented 1 month ago

I found many GCSTs across several different GCST parent brackets which do not have yamls, eg:

09/08/24 - http://ftp.ebi.ac.uk/pub/databases/gwas/summary_statistics/GCST90445001-GCST90446000/GCST90445932/ 18/07/24 - http://ftp.ebi.ac.uk/pub/databases/gwas/summary_statistics/GCST90435001-GCST90436000/GCST90435443/ 10/08/24 - http://ftp.ebi.ac.uk/pub/databases/gwas/summary_statistics/GCST90446001-GCST90447000/GCST90446130/ 12/06/24 - http://ftp.ebi.ac.uk/pub/databases/gwas/summary_statistics/GCST90432001-GCST90433000/GCST90432041/ 08/08/24 - http://ftp.ebi.ac.uk/pub/databases/gwas/summary_statistics/GCST90444001-GCST90445000/GCST90444337/ 07/08/24 - http://ftp.ebi.ac.uk/pub/databases/gwas/summary_statistics/GCST90443001-GCST90444000/GCST90443943/

This is not an exhaustive list. Please investigate, thank you.

karatugo commented 3 weeks ago

I tested body of work in sandbox, metadata yaml create successful.

karatugo commented 3 weeks ago

Also tested publishing GCST90446130 to RabbitMQ. Metadata yaml create successful.

karatugo commented 3 weeks ago

Also this yaml file was created during that period. http://ftp.ebi.ac.uk/pub/databases/gwas/summary_statistics/GCST90435001-GCST90436000/GCST90435387/

karatugo commented 3 weeks ago

@karatugo

Create a new meta table where we keep success/fail states of metadata yaml generation. Run a daily report.

karatugo commented 2 weeks ago

I'll prioritise this issue after my holidays.

karatugo commented 15 minutes ago

https://github.com/EBISPOT/gwas-sumstats-service/pull/358