search

monarch-initiative / monarch-ingest

Data ingest application for Monarch Initiative knowledge graph using Koza
https://monarchinitiative.org
15 stars 2 forks source link

Add download support to Monarch Ingest #137

Closed kevinschaper closed 2 years ago

kevinschaper commented 2 years ago

This should download from the ingest cache (#138). At a minimum, if the ingest pipeline is running it should ensure that files exist.

Eventually, I assume that this will run on in some sort of fresh/serverless way, so it may not be necessary to check file dates - but we may do that anyway, once there is support in the downloader code.

kevinschaper commented 2 years ago

Closing this as an external downloader rather than depending on a cache. We will likely implement the cache (and maybe soon), but we likely can postpone that until a little later.