Redirect Anserini BM25 baselines in BEIR to Pyserini

beir-cellar / beir

A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.

http://beir.ai

Apache License 2.0

1.49k stars 177 forks source link

Open thakur-nandan opened 1 year ago

thakur-nandan commented 1 year ago

The current Anserini-based BM25 implementation in BEIR uses an old docker image.

Redirect authors to the Pyserini repository where they can evaluate the latest BM25 baselines and regressions.

[ ] Add Anserini BM25 regressions in README.
[ ] Update the evaluation_anserini_bm25.py with a note saying to check Pyserini.
[ ] Update BEIR Wiki docs to add information about Pyserini Regressions.
[ ] Link latest BEIR resources Paper.