ZhuiyiTechnology / WoBERT

以词为基本单位的中文BERT
Apache License 2.0
455 stars 69 forks source link

有关预训练 #14

Open ZhangHaojie077 opened 2 years ago

ZhangHaojie077 commented 2 years ago

您好,看您用了30G的语料来训练wobert,原生bert不是只用了wiki吗?感觉同语料下对比才更有说服力