michaelfeil / infinity

Infinity is a high-throughput, low-latency REST API for serving vector embeddings, supporting a wide range of text-embedding models and frameworks.
https://michaelfeil.eu/infinity/
MIT License
975 stars 72 forks source link

Support for nomic-ai/nomic-embed-text-v1.5 #123

Closed SupreethRao99 closed 4 months ago

SupreethRao99 commented 4 months ago

Nomic AI latest model nomic-ai/nomic-embed-text-v1.5 requires einops as a dependency as well as requiring sentence transformers >2.4.0. It would be great if Infinity supported the model

michaelfeil commented 4 months ago

I'll likely not add einops to the docker image, but you are welcome to build you own docker image. Release should be up within 24h .