astronomer / dag-factory

Dynamically generate Apache Airflow DAGs from YAML configuration files
Apache License 2.0
1.2k stars 180 forks source link

[Docs] Represent the Airflow Python vs YML DAG feature better way #200

Open pankajastro opened 3 months ago

pankajastro commented 3 months ago

Maybe some script or pre-commit to check if the Python DAG feature vs YML DAG feature are in sync

pankajastro commented 3 months ago

Feedback from @matveykortsev to support notifications as callbacks.

Guys add please support for on_failure_callback in this way:

from airflow.providers.slack.notifications.slack import send_slack_notification 'on_failure_callback': [ send_slack_notification( slack_conn_id='slack', text=""" :red_circle: Task Failed. Task: {{ ti.task_id }}
Dag: {{ ti.dag_id }} Execution Time: {{ ti.execution_date }}
Log Url: {{ ti.log_url }} """, channel="analytics-alerts", username="Airflow", ) ], Now its only possible without params and only through absolute path for .py file

https://github.com/astronomer/dag-factory/issues/206#issuecomment-2248320589