search

astronomer / astro-provider-ray

This provider contains operators, decorators and triggers to send a ray job from an airflow task
https://astronomer.github.io/astro-provider-ray/
Apache License 2.0
12 stars 2 forks source link

Add support for Apache YuniKorn #42

Open venkatajagannath opened 3 months ago

venkatajagannath commented 3 months ago

Scheduling jobs on Ray clusters should be efficient. Apache YuniKorn is a scheduling that can be integrated with a Ray cluster for more optimal use of our resources