search

qdrant / fastembed

Fast, Accurate, Lightweight Python library to make State of the Art Embedding
https://qdrant.github.io/fastembed/
Apache License 2.0
1.53k stars 110 forks source link

[Feature]: How can we deploy FastEmbed externally as an Inference service? #395

Open S1LV3RJ1NX opened 1 week ago

S1LV3RJ1NX commented 1 week ago

What feature would you like to request?

I would like to deploy fastembed as an external service, similar to infinity. Can we do that?

Is there any additional information you would like to provide?

No response

joein commented 6 days ago

Hey @S1LV3RJ1NX Fastembed is a library, not an inference server, in order to do that you'd need to write some code, e.g. fastapi backend