This change adds an operation called knn-recall that computes the following metrics:
Recall
NDCG
Avg number of nodes visited during search
The new queries-recall.json file contains all the queries (76 in total) from the testing set along with their embeddings and the top 1000 ids computed with brute force over the entire corpus.
For the relevance metrics, the qrels.tsv file contains annotations for all the queries listed in queries-recall.json. This file is generated from the original training data available at ir_datasets/msmarco_passage_v2.
This change adds an operation called knn-recall that computes the following metrics:
The new
queries-recall.jsonfile contains all the queries (76 in total) from the testing set along with their embeddings and the top 1000 ids computed with brute force over the entire corpus. For the relevance metrics, theqrels.tsvfile contains annotations for all the queries listed inqueries-recall.json. This file is generated from the original training data available at ir_datasets/msmarco_passage_v2.