Open chappidim opened 1 year ago
CC: @krfricke , @matthewdeng , look like a decision for the ml team to make?
@matthewdeng can you please set priority and advise on timeline?
This is a P2 on our side, but @chappidim if you are able to work on this we are happy to help.
Description
Currently, ray-ml has
gpu
label which installs NVIDIA and other crucial GPU drivers. Now that we support NeuronCore and other accelerators, it would benefits users to use a ray-ml image with neuron-core/EFA drivers installed. This would cut-down the autoscaler or node-provision time from minutes to seconds.