BrambleXu / knowledge-graph-learning

A curated list of awesome knowledge graph tutorials, projects and communities.
MIT License
738 stars 120 forks source link

ACL-2022-Does BERT Know that the IS-A Relation Is Transitive? #340

Open BrambleXu opened 1 year ago

BrambleXu commented 1 year ago

Summary:

黑箱的DL模型无法理解任务的复杂度,比如这个提问:can a black-box model make logically consistent predictions for transitive relations? 最近的研究显示预训练后的BERT能捕捉lexicosemantic clues,但是为什么能捕捉确依旧无法证明。为了能检测这一点,设计了一个实验,用BERT对IS-A关系进行预测。结果显示BERT的预测并不能完全遵守IS-A关系的传递性能。

Resource:

Paper information:

Notes:

Model Graph:

Result:

Thoughts:

Next Reading: