Review data downloads static file information before 21.09 release

opentargets / issues

Issue tracker for Open Targets Platform and Open Targets Genetics Portal

https://platform.opentargets.org https://genetics.opentargets.org

Apache License 2.0

12 stars 2 forks source link

Review data downloads static file information before 21.09 release #1760

Closed d0choa closed 3 years ago

d0choa commented 3 years ago

Several datasets will change in 21.09. We need to review the blacklisted datasets and probably add descriptions to some of the newly available datasets

andrewhercules commented 3 years ago

Once the ETL pipelines have been run, I will ask the back-end team to generate a JSON with the list of datasets and can update the descriptions and list of datasets to be shown and hidden.

21-04-release-datasets-mapping-file-downloads-page.zip

andrewhercules commented 3 years ago

Code to generate downloadData.json file with list of all datasets: gsutil cat 'gs://open-targets-pre-data-releases/21.09.2/output/etl/*/metadata/*/part-*.json' Note: replace 21.09.2 with the relevant pipeline release version
Dataset mapping files with names, descriptions, and show/hide status: https://docs.google.com/spreadsheets/d/1_266iRiVlCRii9cVLJ6__GCQVCw88QypEp6kXz8OcfQ

andrewhercules commented 3 years ago

Ticket closed as work completed, merged into main, and included in the 21.09.5 platform-app release bundle.