huawei-noah / Pretrained-Language-Model

Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.
3.03k stars 627 forks source link

CeMAT预训练模型下载? #221

Open Vincent131499 opened 2 years ago

Vincent131499 commented 2 years ago

work很棒!但readme里面提到的预训练模型并没有放出来,想问下模型什么时候开放下载呢

jingmu123 commented 1 year ago

您好,谢谢您的关注,预训练模型已经更新。您可以从这里下载:https://drive.google.com/drive/folders/1mZDCt8oH4v-jgXf8J291oTLr_7-Be_Gj

Vincent131499 commented 1 year ago

hello,我这边今天验证了下直接加载预训练模型在en2zh数据上的效果,但是输出有点异常,是数据处理的原因吗? image

jingmu123 commented 1 year ago

您好,CeMAT是一个预训练模型,需要在特定的训练集上微调后才能用于翻译任务的推理;