search

wyona / katie-backend

Katie Backend
https://katie.qa
Apache License 2.0
27 stars 2 forks source link

Feature Request: Support OpenAI / Mistral compatible embedding REST interface #32

Closed michaelwechner closed 4 months ago

michaelwechner commented 4 months ago

There are various services, which provide OpenAI / Mistral compatible REST interfaces, like for example

https://github.com/Repositorium-ch/embedding-service

Katie should allow the configuration of such an endpoint

michaelwechner commented 4 months ago

https://github.com/Repositorium-ch/embedding-service/issues/6

colin-r-carter commented 4 months ago

@michaelwechner https://github.com/Repositorium-ch/embedding-service/issues/6 should be fixed, so this implementation should now hopefully work

michaelwechner commented 4 months ago

Great, thank you very much! Works now very fine :-) we will have to slightly enhance Katie, such that one can add the alternative endpoint, e.g. http://localhost:3000/v1/embeddings

michaelwechner commented 4 months ago

Let us try to re-use src/main/java/com/wyona/katie/handlers/OpenAIEmbeddings.java and also do this for MistralAIEmbed

michaelwechner commented 4 months ago

Implemented :-)