Closed xixi019 closed 1 year ago
The paper doesn't introduce any new dataset.
But it has new numbers for existing datasets.
Shall I merge the pull request https://github.com/KGQA/leaderboard/pull/108 ?
No, a new pull request per issue is recommended
relevant pull request: https://github.com/KGQA/leaderboard/pull/167
@DavidBlavid Are these numbers correct? I cannot find them in this pull request.
Because we do not differentiate between before/after, first/last and time join in cron_questions.md, i calculated the averages for the numbers. So for AE-TQ (0.542 + 0.762 + 0.737)/3 = 0.680 for Hits@1 and (0.701 + 0.793 + 0.767)/3 = 0.754 for Hits@3.
Please let me know if this is correct or if i should change it
Should we add a footnote for it? @xixi019
Because we do not differentiate between before/after, first/last and time join in cron_questions.md, i calculated the averages for the numbers. So for AE-TQ (0.542 + 0.762 + 0.737)/3 = 0.680 for Hits@1 and (0.701 + 0.793 + 0.767)/3 = 0.754 for Hits@3.
Please let me know if this is correct or if i should change it
I replied in this comment: https://github.com/KGQA/leaderboard/pull/167#discussion_r1228373058
I have created a new pull request based on the reviews: https://github.com/KGQA/leaderboard/pull/174
Complex Question Answering Over Temporal Knowledge Graphs