It is interesting to study the effect of ReQue query refinement methods on a new dataset with a totally different nature. Therefore, we decided to add an ANTIQUE dataset, to the previously used TREC corpora (Robust04, Gov2, Clueweb09 and clueWeb12). Considering the widespread use of mobile and voice search, answer passage retrieval for non-factoid questions plays a critical role in modern information retrieval systems. ANTIQUE is a large-scale non-factoid question answering collections with 2,626 real questions from a diverse set of categories and 34,011 manual comprehensive relevance judgments.
It is interesting to study the effect of ReQue query refinement methods on a new dataset with a totally different nature. Therefore, we decided to add an ANTIQUE dataset, to the previously used TREC corpora (Robust04, Gov2, Clueweb09 and clueWeb12). Considering the widespread use of mobile and voice search, answer passage retrieval for non-factoid questions plays a critical role in modern information retrieval systems. ANTIQUE is a large-scale non-factoid question answering collections with 2,626 real questions from a diverse set of categories and 34,011 manual comprehensive relevance judgments.
The paper for this dataset can be found here: https://arxiv.org/abs/1905.08957