✨ Support Embedding API

EinStack / glide

🐦 A open blazing-fast simple model gateway for rapid development of production GenAI apps

https://docs.einstack.ai/glide/

Apache License 2.0

113 stars 18 forks source link

✨ Support Embedding API #67

Open roma-glushko opened 5 months ago

roma-glushko commented 5 months ago

Add a new set of API to support embeddings:

come up with the unified embedding request/response schemas
add a new model type to the routers config
define at least one provider with embedding capabilities

avinashkurup commented 2 weeks ago

Hello @roma-glushko,

Following up on our recent Discord thread, we are currently evaluating your project for a use case that involves Retrieval-Augmented Generation (RAG) and embedding as key components.

We are very excited about the LLMOps features in this project and would love to leverage them for our needs. Could you please let us know if the embedding API is planned for introduction in the near future?

Thank you for your assistance!

avinashkurup commented 2 days ago

Thank you so much, @roma-glushko, I will test this branch.

roma-glushko commented 1 day ago

Hey @avinashkurup I have not yet gotten the end to end flow, it's just an early draft with WIP right now. Just to be clear here.