Feature Request for Text Embeddings Inference

continuedev / continue

⏩ Continue is the leading open-source AI code assistant. You can connect any models and any context to build custom autocomplete and chat experiences inside VS Code and JetBrains

https://docs.continue.dev/

Apache License 2.0

15.89k stars 1.21k forks source link

Feature Request for Text Embeddings Inference #1519

Closed jvhgit closed 2 months ago

jvhgit commented 2 months ago

Validations

[ ] I believe this is a way to improve. I'll try to join the Continue Discord for questions
[X] I'm not able to find an open issue that requests the same enhancement

Problem

Hi,

Thank you for your work. I was wondering if you could add support for https://github.com/huggingface/text-embeddings-inference as an embeddingsProvider (like you did with the TGI). Would be great.

Kind regards,

Solution

No response

LLukas22 commented 2 months ago

Just adding that TEI also provides an /rerank endpoint, which could also be implemented as one of the rerankers e.g. when used with models such as jinaai/jina-reranker-v2-base-multilingual.

I would also be willing to add this feature if it is wanted 🤔

jvhgit commented 2 months ago

That would be real nice! I am working on a pilot within my company to see if this could increase development speed and documentation, this would be a real nice feature I can use for the setup.

jvhgit commented 2 months ago

I am closing this issue since it is already implemented! See: https://docs.continue.dev/walkthroughs/codebase-embeddings, the reranking part is not implemented, I suggest that you make a seperate issue.

Kind regards

Patrick-Erichsen commented 2 months ago

@LLukas22 - currently we do not have support for TEI as a reranker (see the available options here).

We'd we welcome a PR to implement it though! Check out https://github.com/continuedev/continue/blob/main/CONTRIBUTING.md to get started and feel free to reach out with any questions in Discord.