search

luyug / Dense

A toolkit for building dense retrievers with deep language models.
Apache License 2.0
52 stars 4 forks source link

Why not saving the doc indices that contain the answer for a question in NQ or TriviaQA? #9

Open GeneZC opened 1 year ago

GeneZC commented 1 year ago

Using pyserini to evaluate on NQ or TriviaQA requires an additional index of Wikipedia which seems to be redundant to me.

It seems to be easier to save the doc indices that contain the answer for a question in NQ or TriviaQA so that we could compute the retrieval accuracy.