search

opensearch-project / helm-charts

:wheel_of_dharma: A community repository for Helm Charts of OpenSearch Project.
https://opensearch.org/docs/latest/opensearch/install/helm/
Apache License 2.0
170 stars 228 forks source link

How to define a ML node? #489

Closed andreasMore closed 11 months ago

andreasMore commented 11 months ago

Hi Team,

In version 2.4 of OpenSearch, machine learning nodes have been added. I am using OpenSearch version 2.11.0. How can I define a deployment that consists of 3 nodes that do everything except ML and one node that should be used only for ML (maybe also with GPU)? For the deplyoment I want to use helm. Unfortunately I could not find a tutorial for this.

Thanks a lot Andreas

peterzhuamazon commented 11 months ago

Hi @andreasMore could you try passing the node role here? https://github.com/opensearch-project/helm-charts/blob/main/charts/opensearch/values.yaml#L16-L20

@prudhvigodithi

Thanks.

andreasMore commented 11 months ago

Hi @peterzhuamazon , thank you for your answer. Unfortunately it’s not what I was looking for, because then all nodes would also have the ml role, which is not recommended.

prudhvigodithi commented 11 months ago

Hey @andreasMore you need to maintain a seperate values,yaml file with just ML node role, install the chart, it should connect to the existing cluster which is already deployed with different values.yaml file.

prudhvigodithi commented 11 months ago

Here is an example https://opensearch.org/blog/setup-multinode-cluster-kubernetes/. Adding @TheAlgo

andreasMore commented 11 months ago

Thank you for the information. Now it works as intended.

prudhvigodithi commented 11 months ago

Thanks for the update @andreasMore