:mag: AI orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.
Is your feature request related to a problem? Please describe.
The current implementation of TransformerSimilarityRanker only supports cross-encoder models, which limits the use of bi-encoder models like ColBERT v2.0.
peteriz
commented
3 weeks ago
Is your feature request related to a problem? Please describe. The current implementation of
TransformerSimilarityRankeronly supports cross-encoder models, which limits the use of bi-encoder models like ColBERT v2.0.Related discussion: Colbert as reranker
Describe the solution you'd like Update the
TransformerSimilarityRankeror creating a new component to support bi-encoder models like ColBERT.Describe alternatives you've considered Leave the current implementation as is.
Additional context Similar implementation: Llama ColbertRerank