search

facebookresearch / schedule_free

Schedule-Free Optimization in PyTorch
Apache License 2.0
1.91k stars 65 forks source link

Warmup when restarting #39

Closed Fr0do closed 4 months ago

Fr0do commented 4 months ago

Should I warmup when I continue a run that crashed in the middle assuming I am loading saved optimizer states?

adefazio commented 4 months ago

Warmup shouldn't be necessary. Please let me know how it goes.