Create a `Rerank` module in Pyserini

castorini / pyserini

Pyserini is a Python toolkit for reproducible information retrieval research with sparse and dense representations.

http://pyserini.io/

Apache License 2.0

1.57k stars 349 forks source link

Create a `Rerank` module in Pyserini #1926

Open ToluClassics opened 1 month ago

ToluClassics commented 1 month ago

Currently we are able to do pyserini.search.faiss.FaissSearcher for dense retrieval and pyserini.search.lucene.LuceneSearcher for sparse retrieval.

I think it would be nice to have a module like pyserini.rerank....... that takes in a query and a set of documents and maybe uses rankllm and whatever reranker is implemented to return a reranked set.