search

apache / airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
https://airflow.apache.org/
Apache License 2.0
36.95k stars 14.26k forks source link

Data-aware scheduling SLA support #38099

Open michael-robbins-seek opened 7 months ago

michael-robbins-seek commented 7 months ago

Description

Ability to define an SLA for a data aware scheduled DAG. This could take the form of a timedelta since 'the last successful run' or some other more complex expression.

Use case/motivation

Currently any dag that's data-aware scheduled has little to none direct monitoring/observability capabilities. It would be great to at least have SLA support for this.

Related issues

N/A

Are you willing to submit a PR?

Code of Conduct

boring-cyborg[bot] commented 7 months ago

Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval.

RNHTTR commented 7 months ago

This ought to be fixed by the DAG SLA component of AIP-57