opensearch-project / ml-commons

ml-commons provides a set of common machine learning algorithms, e.g. k-means, or linear regression, to help developers build ML related features within OpenSearch.
Apache License 2.0
96 stars 135 forks source link

[FEATURE] Add image embedding model type #2621

Open IanMenendez opened 4 months ago

IanMenendez commented 4 months ago

Is your feature request related to a problem? Right now it is not possible to register image embedding ML models in an OS cluster

What solution would you like? Users should be able to register image embedding ML models. We can achieve this by adding an ImageEmbedding function name with it respective DJL translator and model

We will also need to add an image embedding ingest processor so that it feeds the docs to the model when doc ingest happens

What alternatives have you considered? It is possible to register image embedding models through remote models but it would be great to have models working inside the OS cluster

dblock commented 3 months ago

[Catch All Triage - 1, 2, 3, 4]