monarch-initiative / monarch-ingest

Data ingest application for Monarch Initiative knowledge graph using Koza
https://monarchinitiative.org
14 stars 1 forks source link

Download jenkins job is writing too deep into the bucket #281

Closed kevinschaper closed 1 year ago

kevinschaper commented 2 years ago

We had an expectations misalignment between the producer and consumer of the data cache.

The ingest job expects gs://monarch-ingest/data-cache/alliance/BGI_ZFIN.json.gz, but the downloader is currently writing the file as gs://monarch-ingest/data-cache/data/alliance/BGI_ZFIN.json.gz

We likely need to just slightly tweak the gsutil cp command in Jenkinsfile-download

kevinschaper commented 1 year ago

This is a duplicate of an already fixed issue, closing