Text Embeddings Interface (TEI) as a Reranker

continuedev / continue

⏩ Continue is the leading open-source AI code assistant. You can connect any models and any context to build custom autocomplete and chat experiences inside VS Code and JetBrains

https://docs.continue.dev/

Apache License 2.0

19.7k stars 1.73k forks source link

Text Embeddings Interface (TEI) as a Reranker #1701

Open LLukas22 opened 4 months ago

LLukas22 commented 4 months ago

Validations

[X] I believe this is a way to improve. I'll try to join the Continue Discord for questions
[X] I'm not able to find an open issue that requests the same enhancement

Problem

TEI provides a /rerank endpoint which could be implemented as one of the rerankers, since there are currently a lot of available open source models that perform quite well such as e.g. jinaai/jina-reranker-v2-base-multilingual.

Solution

Add a simple wrapper around the defined /rerank endpoint.

sestinj commented 4 months ago

Definitely a good idea, thanks for pointing this out!