google-research / pegasus

Apache License 2.0
1.59k stars 315 forks source link

How to pre-train the pegasus language model? #236

Open CountingMstar opened 1 year ago

CountingMstar commented 1 year ago

Hello every one. I am a master course student in AI. As a researcher, I want to make better language model in the text summarization field. To do this, I want to know how pre-train the pegasus model. In this repo is very good but I don't know about this. If you know about that how to pre-train the model for the text summraization(pegasus, bart ect) please let me know. Thanks.