search

astronomer / astro-provider-ray

This provider contains operators, decorators and triggers to send a ray job from an airflow task
https://astronomer.github.io/astro-provider-ray/
Apache License 2.0
12 stars 2 forks source link

Add on_failure_callback to the SubmitRayJob operator #64

Closed venkatajagannath closed 1 month ago

venkatajagannath commented 2 months ago

The job is not killed and the cluster is not deleted when the user marks a job as failed through the UI.

This is not expected behavior. Per some research, this can be solved by providing a callback to execute when a task fails.