PaddlePaddle / ERNIE

Official implementations for various pre-training models of ERNIE-family, covering topics of Language Understanding & Generation, Multimodal Understanding & Generation, and beyond.
6.29k stars 1.28k forks source link

想从头训练,不知还是否有教程啥的 #624

Closed FightingFighting closed 3 years ago

FightingFighting commented 3 years ago

我指的是ERNIE-VIL

TangDonnie commented 3 years ago

可以具体说明一下什么是从头开始训练

FightingFighting commented 3 years ago

@TangDonnie 就是我指的不是将预训练模型用于下游任务,我是想重新训练一次预训练模型

TangDonnie commented 3 years ago

可以参考论文和已有开源模型进行一下基础代码开发

FightingFighting commented 3 years ago

@TangDonnie 笑哭

stale[bot] commented 3 years ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Feel free to reopen it. Thank you for your contributions.