airflow-helm / charts

The User-Community Airflow Helm Chart is the standard way to deploy Apache Airflow on Kubernetes with Helm. Originally created in 2017, it has since helped thousands of companies create production-ready deployments of Airflow on Kubernetes.
https://github.com/airflow-helm/charts/tree/main/charts/airflow
Apache License 2.0
630 stars 474 forks source link

Add http based readiness and liveness probes to Scheduler #742

Closed chattarajoy closed 1 year ago

chattarajoy commented 1 year ago

Fixes

https://github.com/airflow-helm/charts/issues/737

What does your PR do?

The current scheduler health check includes python code that changes with Airflow version and with the recent 2.6.0 release there are more changes needed to the health check code.

Instead scheduler exposes a webserver that runs the exact same health check code and is maintained along with Airflow code. This change leverages the same webserver to perform readiness and liveness probes.

Checklist

For all Pull Requests

For releasing ONLY

thesuperzapper commented 1 year ago

Closing in preference of https://github.com/airflow-helm/charts/pull/743