Hey if I just change the line 194 (d = Data(data_dir=data_dir, reverse=True) in main.py file, and use reverse=False, and run the code for FB15k-237 with recommended settings, the MRR shoots up to 0.4067. Is it expected behaviour?
Log for iteration 145:
145
21.162700176239014
0.001321860825107114
Test:
Number of data points: 20466
Hits @10: 0.6135053259063813
Hits @3: 0.4763998827323366
Hits @1: 0.3409557314570507
Mean rank: 147.47825662073683
Mean reciprocal rank: 0.4335430118109515
Hey if I just change the line 194 (d = Data(data_dir=data_dir, reverse=True) in main.py file, and use reverse=False, and run the code for FB15k-237 with recommended settings, the MRR shoots up to 0.4067. Is it expected behaviour?
To replicate:
MRR keeps increasing.
Log for iteration 145: 145 21.162700176239014 0.001321860825107114 Test: Number of data points: 20466 Hits @10: 0.6135053259063813 Hits @3: 0.4763998827323366 Hits @1: 0.3409557314570507 Mean rank: 147.47825662073683 Mean reciprocal rank: 0.4335430118109515