Improve development experience for `breeze k8s` suite of commands

[potiuk]

Body

We have the breeze k8s suite of commands that allows to create cluster and run Airflow in k8s cluster easily (for Local/Celery/K8s executor). It nicely works and we use it for CI/k8s tests, but iteration speed with it is slow. It's fast to iterate on tests (they are run from a local virtualenv) but when you need to change airflow code, it is very slow. You need to:

a) make changes to Airflow code b) build "k8s" image (it's fast but you need to build it) c) re-deploy the image to the kind cluster

It takes minutes to update the code in a running cluster.

We should find a way to incorporate tools like Telepresence https://www.getambassador.io/docs/telepresence/latest/quick-start for example to improve the iteration speed.

Committer

• [X] I acknowledge that I am a maintainer/committer of the Apache Airflow project.

[shahar1]

Assigning myself, it seems like an area that I'd like to experience :)

[potiuk]

Cool :)