Is the TinyBERT_General_4L_312D published on huggingface pure English LM or En-CN-Mixed LM?

huawei-noah / Pretrained-Language-Model

Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.

3.03k stars 627 forks source link

Is the TinyBERT_General_4L_312D published on huggingface pure English LM or En-CN-Mixed LM? #246

Open JohnHerry opened 10 months ago

JohnHerry commented 10 months ago

Thanks for the job. We find there is pretrained TinyBert published on huggingface, Is this one trained on English-Mandarin-Mixture? or pure English? thanks.