test re-ranking

[almutareb]

Is your feature request related to a problem? Please describe. Improve relevance of retrieved documents by re-ranking them using a cross-encoder

Describe the solution you'd like remove distracting documents before presenting them to the LLM to improve it's generation

Describe alternatives you've considered A clear and concise description of any alternative solutions or features you've considered.

Additional context Context: https://medium.com/@rossashman/the-art-of-rag-part-3-reranking-with-cross-encoders-688a16b64669 candidates: sentence-transformers/all-mpnet-base-v2

29

[almutareb]

Should be used with query re-writing/query expansion