The pre-trained model - Githubissues

google-research / pegasus

Apache License 2.0

1.61k stars 316 forks source link

The pre-trained model #68

Open matt9704 opened 4 years ago

matt9704 commented 4 years ago

In the pegasus paper, there are two types of pre-trained models, PEGASUS_BASE and PEGASUS_LARGE. And there are different choices of training corpus, c4, HugeNews, and Mixed & Stochastic. I'm wondering which type of the model is provided in Google Cloud (https://console.cloud.google.com/storage/browser/pegasus_ckpt)? Are the checkpoints for a PEGASUS_BASE model traind on C4?

JingqingZ commented 4 years ago

The checkpoints are LARGE and mixed+stochastic.