Prep pipelines-airflow to become a public repo

AtlasOfLivingAustralia / data-management

Data management issue tracking

7 stars 0 forks source link

Closed peggynewman closed 1 year ago

peggynewman commented 1 year ago

[ ] remove airflow-variables.json (Dave)
[ ] change pre_ingest_pd_dag.py / pre_ingest_drs_dag.py (can these use the other dp dag?)
[ ] take out json schedule for load jobs https://github.com/AtlasOfLivingAustralia/pipelines-airflow/blob/develop/dags/ala/job-schedule-config-prod.json

peggynewman commented 1 year ago

These are done, the preingestion DAG for OBIS is being rewritten.