search

malllabiisc / EmbedKGQA

ACL 2020: Improving Multi-hop Question Answering over Knowledge Graphs using Knowledge Base Embeddings
Apache License 2.0
415 stars 95 forks source link

webqsp half #68

Open yaowang1112 opened 3 years ago

yaowang1112 commented 3 years ago

Do we need relation matching for webqsp half ?

apoorvumang commented 3 years ago

No, it is not needed. Please refer Table 5 in the paper for the ablation study that shows that performance decreases when doing relation matching for half KG.

lihuiliullh commented 2 years ago

The accuracy I got on webqsp half was 0.478. May I know how you got 53.2% accuracy? @apoorvumang

Validation accuracy decreases to 0.468394 from 0.478508, 0 more epoch to check

apoorvumang commented 2 years ago

@lihuiliullh did you re-train the KG embeddings or use the pretrained checkpoint?

lihuiliullh commented 2 years ago

I just downloaded the code and ran it following the instruction. @apoorvumang

image