search

getsentry / airflow-metrics

Metrics for airflow
Apache License 2.0
14 stars 6 forks source link

feat: Report the state of all tasks #4

Closed Zylphrex closed 5 years ago

Zylphrex commented 5 years ago

To indiciate the number of tasks in each state. For example, a high number of tasks being stuck in the queued/scheduled state can indicate that the system is behaving abnormally

Zylphrex commented 5 years ago

There is no issue with over-reporting here as each metric is the current state, not aggregated over time. Also it is not necessary to run the scheduler to run airflow, but the webserver seems likely to be running for every installation of airflow.

This is also very straightforward to change if needed.