search

beir-cellar / beir

A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
http://beir.ai
Apache License 2.0
1.55k stars 186 forks source link

250 queries for Robust04? #55

Closed Muennighoff closed 2 years ago

Muennighoff commented 2 years ago

The below gives me 250 queries for robust04, however you report having only 249 in the paper. How come?

import ir_datasets
dataset = ir_datasets.load("trec-robust04")
x=list(dataset.queries_iter())
len(x)