beir-cellar / beir

A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
http://beir.ai
Apache License 2.0
1.49k stars 177 forks source link

Missing document from corpus ArguAna #172

Open NourOM02 opened 2 months ago

NourOM02 commented 2 months ago

Dataset

ArguAna

Problem

In the qrels, there is one instance where for the given query test-free-speech-debate-yfsdfkhbwu-con03a the relevant document had the following id test-free-speech-debate-yfsdfkhbwu-con03b. However, if you check the corpus and look up for this id, there is no such a document.