astronomer / astro-provider-ray

This provider contains operators, decorators and triggers to send a ray job from an airflow task
https://astronomer.github.io/astro-provider-ray/
Apache License 2.0
12 stars 2 forks source link

Requesting allowing infinite timeouts #69

Closed dukarc closed 1 month ago

dukarc commented 1 month ago

I.e. could we allow job_timeout_seconds the ability to accept -1 as infinity timeframe. We would prefer to manage timeouts on the airflow side.

RAY_TASK_CONFIG = {
    "conn_id": CONN_ID,
    "runtime_env": {"working_dir": str(FOLDER_PATH)},
    "poll_interval": 5,
    "job_timeout_seconds": -1, 
    "ray_cluster_yaml": str(RAY_SPEC),
    "xcom_task_key": "dashboard",
}