How can I use Multi-vector retrieval embedding throught xinference client?

xorbitsai / inference

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.

https://inference.readthedocs.io

Apache License 2.0

5.4k stars 438 forks source link

How can I use Multi-vector retrieval embedding throught xinference client? #2371

Closed HuuHuy227 closed 1 month ago

HuuHuy227 commented 1 month ago

Feature request / 功能建议

I saw BAAI/bge-m3 has 3 retrieval methods:

Dense retrieval
Sparse retrieval
Multi-vector retrieval I want use Multi-vector retrieval. So how could i use it through xinference?

Motivation / 动机

Your contribution / 您的贡献

qinxuye commented 1 month ago

Thanks, we need to do some investigation to see how to support.

github-actions[bot] commented 1 month ago

This issue is stale because it has been open for 7 days with no activity.

github-actions[bot] commented 1 month ago

This issue was closed because it has been inactive for 5 days since being marked as stale.