Implementation of Airflow running in dev environment.
Airflow Container is able to run shell Owid Fetch script from the DAG with BashOperator.
How to test it:
make docker-build ENV=devmake docker-start ENV=dev
access http://127.0.0.1:8099/
login with admin, password admin
trigger manually the execute_owid DAG (right upper corner)
Notes:
The runtime of the owid task takes around 5 minutes.
IMPORTANT in .env, set the right dags path,
e.g. AIRFLOW_FILES_PATH_DIR_HOST={your_home_path}/EpiGraphHub/docker/airflow
Description:
Implementation of Airflow running in dev environment. Airflow Container is able to run shell Owid Fetch script from the DAG with BashOperator.
How to test it:
make docker-build ENV=devmake docker-start ENV=devaccesshttp://127.0.0.1:8099/login withadmin, passwordadmintrigger manually theexecute_owidDAG (right upper corner)Notes:
The runtime of the owid task takes around 5 minutes. IMPORTANT in
.env, set the right dags path, e.g.AIRFLOW_FILES_PATH_DIR_HOST={your_home_path}/EpiGraphHub/docker/airflow