beir-cellar / beir

A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
http://beir.ai
Apache License 2.0
1.57k stars 191 forks source link

Don't rebuild bm25 pyserini index every time when running the script #145

Closed zhiyuanpeng closed 1 year ago

zhiyuanpeng commented 1 year ago

Hi there,

In the file eval_bm25.py, there is a parameter initialize to control whether or not to rebuild the index. However, I didn't find such a parameter in the file evaluate_anserini_bm25.py. There is no need to rebuild the index for the same dataset each time I run the script. How can I skip the index building in file evaluate_anserini_bm25.py if I don't want to rebuild it. Thanks.

Best Regards, Zhiyuan.