search

opensearch-project / opensearch-build

🧰 OpenSearch / OpenSearch-Dashboards Build Systems
Apache License 2.0
132 stars 260 forks source link

[Feature Request] Prebuilt Docker images with CUDA runtime #4743

Open stevapple opened 1 month ago

stevapple commented 1 month ago

Is your feature request related to a problem? Please describe

OpenSearch provides built-in ML support through ml-commons plugin. While the plugin provides CUDA integration out of the box, the official Docker images doesn’t have CUDA built-in, so one need to build their own Docker image if they want to use GPU acceleration for machine learning.

Describe the solution you'd like

Add a -cuda variant for OpenSearch’s Docker distribution with CUDA built-in (optionally a -neuron one), and serve it via DockerHub.

Related component

Other

Describe alternatives you've considered

No response

Additional context

No response

prudhvigodithi commented 1 month ago

[Triage] Thanks @stevapple can you please add more details on this and some helpful links. Thank you

rishabh6788 commented 1 month ago

In case you are building your own image using OS image as base image, can you please add the instructions on how you are building cuda enabled image?

rishabh6788 commented 1 week ago

@stevapple any update on this?