capreolus-ir / capreolus

A toolkit for end-to-end neural ad hoc retrieval
https://capreolus.ai
Apache License 2.0
95 stars 32 forks source link

cache converted msmarco train file into a tmp file #186

Closed crystina-z closed 2 years ago

crystina-z commented 2 years ago

as slack discussion - original code would produce an incomplete file if the process is stopped before the loop completes, which is handled by using cached_file now.

tested with

python -m capreolus.run rank.searcheval with benchmark.name=msmarcopsg searcher.name=msmarcopsgbm25

got

RR@10   0.1840