malllabiisc / CompGCN

ICLR 2020: Composition-Based Multi-Relational Graph Convolutional Networks
Apache License 2.0
597 stars 107 forks source link

How do you calculate mrr by relation category #33

Open jwzhi opened 2 years ago

jwzhi commented 2 years ago

Hi,

In appendix A, I saw that you calculated the mrr by each relation category. However, when I am trying to reproduce the number, it's weird that I get the number for 1-n and n-1 swapped. For example, for compgcn + conve, for the mrr of 1-N relations, I got number 0.25, but in your paper you reported (0.112+0.779)/2 = 0.4455.

I wonder if (1) if I calculated it in a wrong way (2) you can provide the script of how you calculated these numbers