ibalazevic / TuckER

TuckER: Tensor Factorization for Knowledge Graph Completion
MIT License
350 stars 60 forks source link

Could the one-way evaluation be a problem? #19

Closed Xiaobeing closed 3 years ago

Xiaobeing commented 4 years ago

Hi,

I have a question on the evaluation in the code.

when the test rank is evaluated, the scores seem only be calculated for each head toward all tails. I didn't see the scores are calculated for each tail toward all heads in the code. Don't people usually calculate them both and average them as the final scores? Would this one-way evaluation be a problem, such as having some bias?

Thank you!

YancaoZhang commented 3 years ago

When loading data, reverse=True.

ibalazevic commented 3 years ago

Please see this issue for the answer to your question.