allenai / OLMo

Modeling, training, eval, and inference code for OLMo
https://allenai.org/olmo
Apache License 2.0
4.37k stars 431 forks source link

Fix restarts in later epochs #670

Closed epwalsh closed 1 month ago

epwalsh commented 1 month ago

This PR fixes restarting a training run in later epochs so that we no longer need to set the flag --epoch=INT.