How to pretrain the ProphetNet?

microsoft / ProphetNet

A research project for natural language generation, containing the official implementations by MSRA NLC team.

MIT License

651 stars 104 forks source link

Open thomas-li-sjtu opened 2 years ago

thomas-li-sjtu commented 2 years ago

Thanks for your wonderful work!

I wonder how to pretrain a ProphetNet from scratch. Would you mind provide some instructions?