jbrry / Irish-BERT

Repository to store helper scripts for creating an Irish BERT model.
Other
9 stars 0 forks source link

Need to edit existing BERT code to save more than n checkpoints #61

Open jbrry opened 3 years ago

jbrry commented 3 years ago

We recently had trouble keeping older checkpoints when training BERT.

It turns out if you want to keep more checkpoints than the default, you can manually add a parameter or add a parameter to tf.estimator.RunConfig, see here for reference: https://github.com/dbmdz/berts/issues/32