Open noCharger opened 6 months ago
A clear and concise description of what the problem is, e.g. I'm always frustrated when [...].
As a developer, I want to have a large ML model (even LLMs) supported for remote inference purpose.
A clear and concise description of what you want to happen.
One direction is to integrate with the ml-common plugin, which already have such capability.
A clear and concise description of any alternative solutions or features you've considered.
Add any other context or screenshots about the feature request here.
Ref https://github.com/opensearch-project/opensearch-learning-to-rank-base/issues/26 Public doc https://opensearch.org/docs/latest/ml-commons-plugin/remote-models/index/
Trade-off understanding:
Is your feature request related to a problem?
A clear and concise description of what the problem is, e.g. I'm always frustrated when [...].
As a developer, I want to have a large ML model (even LLMs) supported for remote inference purpose.
What solution would you like?
A clear and concise description of what you want to happen.
One direction is to integrate with the ml-common plugin, which already have such capability.
What alternatives have you considered?
A clear and concise description of any alternative solutions or features you've considered.
Do you have any additional context?
Add any other context or screenshots about the feature request here.
Ref https://github.com/opensearch-project/opensearch-learning-to-rank-base/issues/26 Public doc https://opensearch.org/docs/latest/ml-commons-plugin/remote-models/index/
Trade-off understanding: