microsoft / TREC-2019-Deep-Learning

Website for the TREC Deep Learning Track 2019
https://microsoft.github.io/TREC-2019-Deep-Learning/
Creative Commons Attribution 4.0 International
87 stars 29 forks source link

questions about the test set of 43 queries #20

Open 33hzs opened 1 month ago

33hzs commented 1 month ago

I want to find the test set file of 43 queries, but I can't find it. For example, for paragraph retrieval, the document mentions that there is a reusable test set containing 43 queries. Which of the following compressed packages should I find it in? collection.tar.gz queries.tar.gz qrels.dev.tsv grels.train.tsv collectionandqueries.tar.gz triples.train.small.tar.gz triples.train.full.tsv.gz qidpidtriples.train.full.2.tsv.gz top1000.train.tar.gz top 1000.dev.tar.gz msmarco-test2019-queries.tsv msmarco-passagetest2019- top 1000.tsv 2019grels-pass.txt

bmitra-msft commented 1 month ago

2019qrels-pass and 2019qrels-docs are the correct files to look at the for the two tasks in the 2019 TREC DL track, respectively.