search

EBISPOT / gwasdepo-deposition-service

0 stars 1 forks source link

When sumstats submissions have a value for "Analysis software", allow sumstats to validate true when p-values are zero #231

Open jdhayhurst opened 1 year ago

jdhayhurst commented 1 year ago

"Analysis software" is an optional field in the study template. If a value is given, when the POST request is made to the sumstats service to register (and validate) the sumstats files, add the analysis software field per study, analysisSoftware: <sw name>. By analysisSoftware field exists for the study, this tells the sumstats validator to allow p-values of 0, whereas by default these values are invalid.

Slides from discussion are here: https://docs.google.com/presentation/d/1ccWhl1GlU5hKi9yIXwLTdswJtOUsO2gI/edit?usp=sharing&ouid=115921420372247902258&rtpof=true&sd=true

jdhayhurst commented 11 months ago

this is an issue

ljwh2 commented 1 month ago

Discuss and plan in this sprint

karatugo commented 4 weeks ago

GWAS sumstats service changes tested and merged to sandbox.

sajo-ebi commented 3 weeks ago

@sajo-ebi to create a ticket for the deposition side

sajo-ebi commented 3 weeks ago

created ticket https://github.com/EBISPOT/gwasdepo-deposition-service/issues/247 for Deposition side

karatugo commented 2 weeks ago
karatugo commented 2 weeks ago

Test okay with the template v1.11

ljwh2 commented 1 week ago

curators to test

earlEBI commented 1 week ago

Tested with 2 sumstats-only submissions. Validation passes as long as something is entered in the analysis software column.

The error message for sumstats files with 0 p-values and nothing entered in the analysis software column is unhelpful: “Errors: test_izzy2.tsv: Summary statistics file validation failed, please run the validator on your file to see the errors (available here: https://pypi.org/project/gwas-sumstats-tools/)”

Would it be possible to give a more helpful error message for this particular scenario, eg. "Error: Analysis software must be provided in the metadata template for summary statistics containing 0 p-values."

karatugo commented 1 week ago

Sure, let me see what I can do.

karatugo commented 1 week ago

Tested here. https://wwwdev.ebi.ac.uk/gwas/deposition/submission/667e92c52b46030001615a5d

karatugo commented 1 week ago

Inserted new error messages for zero p-values to sumstats-error collections of respective Mongo DB instances.

earlEBI commented 3 days ago

Tested with a sumstats-only submission - looks good to me!

karatugo commented 3 days ago

Thanks, deployed to prod

ljwh2 commented 3 days ago

I think users might find the error message confusing:

Analysis software must be provided in the metadata template for summary statistics containing 0 p-values.

would be clearer as

Analysis software must be provided in the metadata template for summary statistics containing p-values equal to zero.

karatugo commented 2 days ago

@karatugo roll back changes until java side is deployed

karatugo commented 2 days ago

Re-deployed v1.4.16.