astronomer / astro-provider-ray

This provider contains operators, decorators and triggers to send a ray job from an airflow task
https://astronomer.github.io/astro-provider-ray/
Apache License 2.0
12 stars 2 forks source link

Replace DeamonSet approach for NVIDIA drivers with NVIDIA K8 operator #70

Open venkatajagannath opened 1 month ago

venkatajagannath commented 1 month ago

NVIDIA provides a k8 operator that can be used to add GPU drivers to the cluster.

It can be installed through a helm chart.

Its a cleaner approach (compared to current) and will allow us to delete all the deamon set logic in the RayHook.

See link for more details -- https://docs.nvidia.com/datacenter/cloud-native/gpu-operator/latest/getting-started.html