search

shehzaadzd / MINERVA

Meandering In Networks of Entities to Reach Verisimilar Answers
Apache License 2.0
310 stars 87 forks source link

Reproduce Kinship, FB15k-237 results #13

Open posenhuang opened 6 years ago

posenhuang commented 6 years ago

Hi @rajarshd, @shehzaadzd,

Using the config for kinship and fb15k-237, we only get the following results, which are quite different from the ones in the paper. 

FB15k-237
[ Hits@1:  0.1511 ]
[ Hits@3:  0.2183 ]
[ Hits@5:  0.2620 ]
[ Hits@10:  0.3275 ]
[ Hits@20:  0.3898 ]
[ auc:  0.2048 ] 
Kinship
[ Hits@1:  0.2607 ]
[ Hits@3:  0.4981 ]
[ Hits@5:  0.5819 ]
[ Hits@10:  0.6853 ]
[ Hits@20:  0.7551 ]
[ auc:  0.4048 ]

Related to https://github.com/shehzaadzd/MINERVA/issues/10, is there any fixes to reproduce the results?

rajarshd commented 6 years ago

Hi @posenhuang, thanks for using our code. Little occupied with the upcoming deadlines. We will try to get back to you by tonight!

posenhuang commented 6 years ago

@rajarshd Appreciate your help!

David-Lee-1990 commented 5 years ago

Is this problem solved?

shivam1702 commented 4 years ago

Kindly provide the configurations!!

renhuali commented 3 years ago

Is this problem solved? I have the same problem，using the config for kinship and fb15k-237, I only get the following results, FB15k-237: Score for iteration 100 Hits@1: 0.0358 Hits@3: 0.0794 Hits@5: 0.1077 Hits@10: 0.1526 Hits@20: 0.1980 auc: 0.0710

Kinship: Score for iteration 1900 Hits@1: 0.4888 Hits@3: 0.7753 Hits@5: 0.8586 Hits@10: 0.9120 Hits@20: 0.9419 auc: 0.6453 Why is the result different from that in the paper?