search

erikerlandson / ray-ubi

A minimalist Ray distributed computing container image, based on Red Hat UBI
Apache License 2.0
2 stars 1 forks source link

GPU support #5

Open yanivg10 opened 3 years ago

yanivg10 commented 3 years ago

Does this image support ray on GPUs?

erikerlandson commented 3 years ago

Hi @yanivg10, these images weren't designed or tested with gpus, but gpu support is definitely on my roadmap.

yanivg10 commented 3 years ago

Thanks. What about Kubernetes? Can I use this image to run ray on k8s?

erikerlandson commented 3 years ago

@yanivg10 yes, these images should run on k8s. I would expect the operator deployment here to work on k8s: https://github.com/erikerlandson/ray-odh-demo/tree/main/deploy/operator

(note, the corresponding open data hub deployment would not, as ODH is designed to run on openshift)

yanivg10 commented 3 years ago

Thanks. Do I need the ray-operator-ubi image for k8s deployment?

erikerlandson commented 3 years ago

I don't think it is strictly necessary, but highly recommend using the ray operator for creating and managing ray clusters. Run the ray operator pod, and then to create clusters you just create RayCluster CRD object, and the operator will use that to generate your cluster. Ray is designed so that it expects cluster creation, scaling and tear-down to be managed by its operator.