search

Marker-Inc-Korea / RAGchain

Extension of Langchain for RAG. Easy benchmarking, multiple retrievals, reranker, time-aware RAG, and so on...
Apache License 2.0
274 stars 28 forks source link

Add relevance score for reranker #331

Closed vkehfdl1 closed 8 months ago

vkehfdl1 commented 9 months ago

From now, relevance score does not support at reranker. So, using reranker in custom pipeline's rank-aware metric is not accurate at all.

vkehfdl1 commented 9 months ago

We can use this as 'Search new passages or not?' module. Because it can measure relevancy between new query and existed (already retrieved) passages.

But what if you ask about previous chat and the question itself is not relevant? Umm...