I have a question that if I use a custom dataset with the same format in MS MARCO, how to choose the negative sample on dev/test set?
For example, if I want to find if BM25 negative sample is better than random sample in my filed. I use BM25 negative samples in the training stage, negative samples the dev/test set should be made by BM25 or random?
So thanks for the novel work.
I have a question that if I use a custom dataset with the same format in MS MARCO, how to choose the negative sample on dev/test set?
For example, if I want to find if BM25 negative sample is better than random sample in my filed. I use BM25 negative samples in the training stage, negative samples the dev/test set should be made by BM25 or random?