Review papers about attention model with knowledge graph

[xinyuwang1209]

ERNIE: Enhanced Language Representation with Informative Entities https://arxiv.org/abs/1905.07129

K-BERT: Enabling Language Representation with Knowledge Graph https://arxiv.org/pdf/1909.07606.pdf

KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representation https://arxiv.org/abs/1911.06136

CoLAKE: Contextualized Language and Knowledge Embedding https://arxiv.org/abs/2010.00309

Exploiting Structured Knowledge in Text via Graph-Guided Representation Learning https://arxiv.org/abs/2004.14224

K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapters https://arxiv.org/abs/2002.01808

[xinyuwang1209]

Chinese Blog:

https://mp.weixin.qq.com/s/3hAm2_Lxgf0o7BjRd7UxIA