feat(airflow DAG): SINAN aggravates

thegraphnetwork / EpiGraphHub

Software platform to Gather, transmform, harmonize and store epidemiological data for analytical purposes.

https://epigraphhub.org

GNU General Public License v3.0

8 stars 10 forks source link

feat(airflow DAG): SINAN aggravates #163

Closed luabida closed 1 year ago

luabida commented 1 year ago

This DAG has a weird trigger that automatically marks the tasks to up_for_retry, but it passes in the second try. I've set the max concurrency to 2 in order to prevent scheduler grasps.

luabida commented 1 year ago

@xmnlab to emailing work, it needs some extra information on the .env or .cfg:

AIRFLOW__SMTP__SMTP_HOST=smtp.sendgrid.net
AIRFLOW__SMTP__SMTP_STARTTLS=False
AIRFLOW__SMTP__SMTP_SSL=False
AIRFLOW__SMTP__SMTP_USER=apikey
AIRFLOW__SMTP__SMTP_PASSWORD=<generated-api-key>
AIRFLOW__SMTP__SMTP_PORT=587
AIRFLOW__SMTP__SMTP_MAIL_FROM=<your-from-email>

https://airflow.apache.org/docs/apache-airflow/stable/howto/email-config.html

xmnlab commented 1 year ago

We are using gmail for that. Please add the env variable to the tpl file and I will add it manually in the server side