GanjinZero / RRHF

[NIPS2023] RRHF & Wombat
792 stars 49 forks source link

Why use HingeLoss instead of BPRLoss ? #15

Open KID-22 opened 1 year ago

KID-22 commented 1 year ago

This is good job. However, we always use BPRLoss rather than HingeLoss in pairwise learning to rank since the margin of HingeLoss is hard to tune. So I wonder whther you have tried the BPRLoss?

GanjinZero commented 1 year ago

No, I haven't tried it. I found set margin=0 in margin loss run very well. I think other losses can achieve similar results (but you should try it).