search

ymcui / Chinese-BERT-wwm

Pre-Training with Whole Word Masking for Chinese BERT（中文BERT-wwm系列模型）
https://ieeexplore.ieee.org/document/9599397
Apache License 2.0
9.66k stars 1.39k forks source link

“注意：开源版本不包含MLM任务的权重；如需做MLM任务，请进行二次预训练。” #216

Closed lxxXuan closed 2 years ago

lxxXuan commented 2 years ago

请问这句话展开来说是什么意思呢？没太懂

ymcui commented 2 years ago

如果你不是直接拿来（不经过任何训练）做MLM预测任务就没有影响。

stale[bot] commented 2 years ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

stale[bot] commented 2 years ago

Closing the issue, since no updates observed. Feel free to re-open if you need any further assistance.