arXiv-2019/11-Do Attention Heads in BERT Track Syntactic Dependencies?

BrambleXu / knowledge-graph-learning

A curated list of awesome knowledge graph tutorials, projects and communities.

MIT License

735 stars 120 forks source link

Open BrambleXu opened 4 years ago

BrambleXu commented 4 years ago

Summary:

探索BERT里的head对于Syntactic Dependencies信息的学习情况。

Resource:

Paper information:

Notes:

Model Graph:

Result:：

Thoughts:

Next Reading: