Closed jpainam closed 6 years ago
sorry to reply late, you may understand wrong, its true that the multi query evaluation result is mostly better than the single query evaluation, while in my experiment, the single means that we trained the model by single GPU, not the single query evaluation, and so is for the multi. Hope it helps you!
I got your point. Thank you.
Hi! Most paper report multi query evaluation greater than single query evaluation. Your evaluation results show the contrary. Didn't reverse the order of the results? And please confirm if the evaluation code you provided is for single query evaluation or muti query
Thanks and great code.