search

opentargets / issues

Issue tracker for Open Targets Platform and Open Targets Genetics Portal
https://platform.opentargets.org https://genetics.opentargets.org
Apache License 2.0
12 stars 2 forks source link

Move input data for ETL in Airflow #3238

Closed DSuveges closed 2 months ago

DSuveges commented 3 months ago

The current ETL DAG assumes input datasets already moved into the release bucket, however this is not automatically happening. The ETL DAG needs to contain steps to transfer data. This can be done via AirFlow's GCSToGCSOperator.

DSuveges commented 2 months ago

Done.