Add results from SKILL - Githubissues

KGQA / leaderboard

You can find the most recent KGQA benchmark numbers from publications here.

https://kgqa.github.io/leaderboard/

MIT License

108 stars 16 forks source link

Closed RicardoUsbeck closed 2 years ago

RicardoUsbeck commented 2 years ago

xixi019 commented 2 years ago

I am not sure whether the datasets evaluated in the article are KGQA datasets:

FreebaseQA: A QA dataset dependent on freebase, only offers entity, predicate and path, no SPARQL. See this link.
WikiHop: A reading comprehension dataset based on document, distant supervised by wikidata.
TriviaQA: A reading comprehension dataset based on document.
NaturalQuestion: A reading comprehension dataset based on document.

RicardoUsbeck commented 2 years ago

Yes, freebaseQA is still a valid dataset although there is no SPARQL provided. The others are not, you are right!

xixi019 commented 2 years ago

Thanks for reply, I will add freebaseQA and eval result from this paper soon!