beir-cellar / beir

A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
http://beir.ai
Apache License 2.0
1.49k stars 177 forks source link

recommended pytrec-eval-terrier rather than pytrec-eval #174

Open liyongkang123 opened 1 month ago

liyongkang123 commented 1 month ago

It is recommended to use pytrec-eval-terrier instead of pytrec-eval.

During the installation of beir, pytrec-eval is required, but this library has not been maintained for 4 years, and installation failures often occur, which in turn causes beir failure. https://pypi.org/project/pytrec-eval-terrier/#files It is a substitute for pytrec-eval. I recommend that beir replace the dependency in setup.py