malllabiisc / CompGCN

ICLR 2020: Composition-Based Multi-Relational Graph Convolutional Networks
Apache License 2.0
597 stars 107 forks source link

Which evaluation protocol do you use #34

Open jwzhi opened 2 years ago

jwzhi commented 2 years ago

Hi,

just stated in your more recent work: https://arxiv.org/pdf/1911.03903.pdf, how you break ties when doing evaluation is important. And I wonder what tie handling method do you use in this work. It seems like TOP for me because of this line ranks = 1 + torch.argsort(torch.argsort(pred, dim=1, descending=True), dim=1, descending=False)[b_range, obj] But I am not 100% sure. Please correct me if I misunderstood your code!