search

axolotl-ai-cloud / axolotl

Go ahead and axolotl questions
https://axolotl-ai-cloud.github.io/axolotl/
Apache License 2.0
7.85k stars 864 forks source link

One cycle lr #1803

Closed winglian closed 2 months ago

winglian commented 3 months ago

Refactors the one cycle LR so it's usable across multiple trainers.