search

gmihaila / ml_things

This is where I put things I find useful that speed up my work with Machine Learning. Ever looked in your old projects to reuse those cool functions you created before? Well, this repo is designed to be a Python Library of functions I created in my previous project that can be reused. I also share some Notebooks Tutorials and Python Code Snippets.
https://gmihaila.github.io
Apache License 2.0
254 stars 61 forks source link

pretrain_transformer - checkpoints save #1

Closed gmihaila closed 3 years ago

gmihaila commented 4 years ago

machine_learning_things/tutorial_notebooks/pretrain_transformer.ipynb

Is saving too many checkpoints on large data. Use a larger save_steps or set save_steps=-1 to avoid saving any checkpoints.

# process training arguments
training_args = TrainingArguments(output_dir='bert_podcast', do_train=True, 
                                  do_eval=True,
                                  save_steps=-1)
gmihaila commented 3 years ago

Use save_steps=-1 to avoid saving too many checkpoints.