castorini / dhr

Dense hybrid representations for text retrieval
60 stars 5 forks source link

What is QRELS_PATH in the https://github.com/castorini/dhr/blob/main/docs/dhr/msmarco-passage-train-eval.md? #2

Closed shizhl closed 1 year ago

jacklin64 commented 1 year ago

Hi @shizhl, thanks for the question. You can go to the official website (https://microsoft.github.io/msmarco/Datasets) to download the qrel file for passage ranking. And in the readme, we evaluate in the dev set and the corresponding eval file is here https://msmarco.blob.core.windows.net/msmarcoranking/qrels.dev.tsv.