Closed parambharat closed 1 year ago
Check out this pull request on
See visual diffs & provide feedback on Jupyter Notebooks.
Powered by ReviewNB
Aside from the comment above, LGTM! Reads very easily
Do I merge this?
@ash0ts , @parambharat also added more granular checkpointing ability to the Trainer, it should be out in the next transformer
release
@tcapelle lets wait to remove the mention of WATCH first
Do we remove watch or no?
The wandb huggingface integration was recently updated to store checkpoints. This PR includes a colab example to demonstrate how the integration can be used to train and checkpoint models as well as resume training using artifacts.