BrambleXu / knowledge-graph-learning

A curated list of awesome knowledge graph tutorials, projects and communities.
MIT License
735 stars 120 forks source link

EMNLP-2020-Cold-start Active Learning through Self-supervised Language Modeling #321

Open BrambleXu opened 3 years ago

BrambleXu commented 3 years ago

Summary:

对于active learning的cold start问题,效果不好的原因在于模型的不稳定和数据的稀缺。但是现在的预训练语言模型可能带来不同。基于BERT的masked language modeling loss来代表分类的不确定性。

Resource:

Paper information:

Notes:

Model Graph:

Result:

Thoughts:

Next Reading: