search

konstmish / prodigy

The Prodigy optimizer and its variants for training neural networks.
MIT License
296 stars 17 forks source link

Can we combine this profitably with Schedule-Free? #17

Open JDvorak opened 5 months ago

JDvorak commented 5 months ago

https://github.com/facebookresearch/schedule_free

This looks compatible with the prodigy approach, but not entirely sure.

konstmish commented 5 months ago

Working on that!