As we will soon deploy an airflow instance to our server, we should start prototyping airflow versions of our data fetching scripts, and documenting the process.
This can be done on a local deploy of airflow, to iron out any bugs before we can deploy in production, replacing our current cron jobs
As we will soon deploy an airflow instance to our server, we should start prototyping airflow versions of our data fetching scripts, and documenting the process.
This can be done on a local deploy of airflow, to iron out any bugs before we can deploy in production, replacing our current cron jobs