Currently the logic to re-fresh GWAS catalog data is in a shell script under utils/. This is because it was written before the airflow layer was developed. However at this point it isn't fit well with the overall design of the pipeline.
Expectations:
[] All the logic, which is currently in utils/update_GWAS_Catalog_data.sh should be moved to airflwo layer.
[] The logic should also harvest and store the GWAS related metadata and stored in the manifests.
Currently the logic to re-fresh GWAS catalog data is in a shell script under
utils/. This is because it was written before the airflow layer was developed. However at this point it isn't fit well with the overall design of the pipeline.Expectations:
utils/update_GWAS_Catalog_data.shshould be moved to airflwo layer.