search

GasolSun36 / ToG

[ICLR 2024] Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge Graph
141 stars 11 forks source link

CWQ Ground Truth #21

Open amayuelas opened 1 month ago

amayuelas commented 1 month ago

Where did you obtain the ground truth answers for the CWQ dataset? I just reran the provided SPARQL queries on my installation of Freebase and I am getting 81.11% answers correct. Shouldn't I be getting 100%?

GasolSun36 commented 1 month ago

Where did you obtain the ground truth answers for the CWQ dataset? I just reran the provided SPARQL queries on my installation of Freebase and I am getting 81.11% answers correct. Shouldn't I be getting 100%?

You can get ground truth answers of CWQ dataset on the official website. Moreover, I think it's definitely need 100% correct, maybe you can talk to @Tanglumy for more information.