search

mawentao277 / CharBERT

CharBERT: Character-aware Pre-trained Language Model (COLING2020)
Apache License 2.0
117 stars 28 forks source link

How to pretrain CharBERT #12

Open Believer215 opened 3 years ago

Believer215 commented 3 years ago

For example, if I want to pretrain the CharBERT using biomedical articles, how do I pretrain it? Is it the same way as BERT? Thanks in advance!