How is a MRR score of 0.20 possible?

JinheonBaek / RGCN

Pytorch implementation of a RGCN Link Prediction Model

229 stars 41 forks source link

How is a MRR score of 0.20 possible? #4

Closed moritzblum closed 3 years ago

moritzblum commented 3 years ago

I trained with your code and got an MRR of 0.2. In the original paper they only reach an MRR score of 0.156. How is my score with a model with fewer parameters than the original approach possible?

moritzblum commented 3 years ago

Oh sorry, I messed up with "raw" and "filtered". You actually compute the filtered score which is 0.249 in the original paper.