This pull request adds reranking functionality to the retrieval process in order to improve the relevance of the retrieved documents. It includes the following commits:
add reranking to inference
make reranking optional
The changes in the code include modifications to the process_input_with_retrieval function, which now includes a rerank_documents function to rerank the retrieved documents based on the input query. The reranked documents are then used in the completion process.
This pull request adds reranking functionality to the retrieval process in order to improve the relevance of the retrieved documents. It includes the following commits:
add reranking to inference
make reranking optional
The changes in the code include modifications to the
process_input_with_retrieval
function, which now includes arerank_documents
function to rerank the retrieved documents based on the input query. The reranked documents are then used in the completion process.