search

microsoft / ProphetNet

A research project for natural language generation, containing the official implementations by MSRA NLC team.
MIT License
692 stars 110 forks source link

Train new model #46

Closed ghost closed 2 years ago

ghost commented 3 years ago

Hi, Thanks for your awesome model Could I ask how to train a whole new model for a specific task for a language like summarizing Vietnamese articles.

Would you mind provide some instructions on that?

Edited: I have successfully finetune from pretrained model ProphetNet X to create Vietnamese model. However, I also want to create new model as well.

@qiweizhen @yuyan2do @dayihengliu

thomas-li-sjtu commented 2 years ago

Anything new about how to pretrain the ProphetNet from scratch? Pleas let me know.