search

beir-cellar / beir

A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
http://beir.ai
Apache License 2.0
1.57k stars 191 forks source link

replacing `pytrec_eval` with `pytrec-eval-terrier` #175

Open archersama opened 3 months ago

archersama commented 3 months ago

When replacing pytrec_eval with pytrec-eval-terrier, several installation issues of pytrec_eval can be effectively addressed. These issues include, but are not limited to:

  1. Compilation Failure: The need for compilation during installation often leads to failures, as discussed in this Stack Overflow post: https://stackoverflow.com/questions/74444484/pytrec-library-not-able-to-install-on-my-system-raising-error.
  2. Path Issues on Windows: Installation failures on Windows due to path-related problems, as documented in this GitHub issue: https://github.com/cvangysel/pytrec_eval/issues/32.

By using pytrec-eval-terrier, these installation problems can be effectively mitigated, as demonstrated by the solution provided in this comment: https://github.com/cvangysel/pytrec_eval/issues/32#issuecomment-2085306474.