Does it make sense to add https://arxiv.org/pdf/2206.01818.pdf ?

KGQA / leaderboard

You can find the most recent KGQA benchmark numbers from publications here.

https://kgqa.github.io/leaderboard/

MIT License

108 stars 16 forks source link

Does it make sense to add https://arxiv.org/pdf/2206.01818.pdf ? #41

Closed RicardoUsbeck closed 2 years ago

xixi019 commented 2 years ago

I do not think so, since they only give evaluation on subsets (1-hop, 2-hop, 3-hop) of kgqa datasets. And we do not want that, right?

LongquanJiang commented 2 years ago

In some ways, it is meaningful as we have already tracked the evaluation results of MetaQA and PathQuestions datasets in the leaderboard, both of which are used in this paper.

The evaluation results of these two datasets have already been updated.

close this issue if merged

RicardoUsbeck commented 2 years ago

Closed by https://github.com/KGQA/leaderboard/pull/42