search

spring-projects / spring-ai

An Application Framework for AI Engineering
https://docs.spring.io/spring-ai/reference/1.0-SNAPSHOT/index.html
Apache License 2.0
2.89k stars 721 forks source link

Add support for multimodal embedding model #1009

Open thingersoft opened 2 months ago

thingersoft commented 2 months ago

Any plans on extending the embeddings model API to support multimodal embedding models such as the one from Vertex AI? https://cloud.google.com/vertex-ai/generative-ai/docs/embeddings/get-multimodal-embeddings

tzolov commented 2 months ago

Related to https://github.com/spring-projects/spring-ai/issues/1009

thingersoft commented 2 months ago

@tzolov Thank you, I'll give it a try as soon as the PR will be merged.

Related to #1009

There's a typo in issue reference...

csterwa commented 1 week ago

@thingersoft does the VertexAI embedding enhancement provide the multimodal capability you were looking for?