KubernetesPodOperator in deferrable mode does not delete pod when task is marked externally - Githubissues

apache / airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

https://airflow.apache.org/

Apache License 2.0

37.12k stars 14.31k forks source link

KubernetesPodOperator in deferrable mode does not delete pod when task is marked externally #44014

Open kien-truong opened 2 days ago

kien-truong commented 2 days ago

Apache Airflow version

2.10.3

If "Other Airflow 2 version" selected, which one?

No response

What happened?

KubernetesPodOperator in deferrable mode does not delete pod when task is marked fail/success manually in the UI.

What you think should happen instead?

KubernetesPodOperator in deferrable mode should delete pod when the task is marked fail/success

How to reproduce

KubernetesPodOperator in deferrable mode does not delete pod when task is marked fail

Operating System

Linux

Versions of Apache Airflow Providers

apache-airflow-providers-cncf-kubernetes==9.0.0

Deployment

Google Cloud Composer

Deployment details

Composer 2.9.9 Airflow 2.9.3

Anything else?

No response

Are you willing to submit PR?

[ ] Yes I am willing to submit a PR!

Code of Conduct

[X] I agree to follow this project's Code of Conduct

kien-truong commented 2 days ago

Related issue:

Deferrable operator tasks do not call on_kill method when fail or restarted