can use the samples that their different score is 1?

AdeDZY / K-NRM

K-NRM: End-to-End Neural Ad-hoc Ranking with Kernel Pooling

BSD 3-Clause "New" or "Revised" License

202 stars 43 forks source link

can use the samples that their different score is 1? #6

Closed bayou3 closed 6 years ago

bayou3 commented 6 years ago

Hello, I use Letor4 dataset, which owns three levels of judgement for query-docs, 2, 1, 0. Then the difference of scores between two samples are always 1, because I generate training or testing sample by considering "level-2 doc and level-1 doc" , "level-1 and level-0 doc", is it OK?

AdeDZY commented 6 years ago

It is okay that diff_score is always 1. Diff_score could be 2 if you also consider pairs of level-2 doc and level 0 doc.

bayou3 commented 6 years ago

Thank you so much for your reply!