search

mgrankin / over9000

Over9000 optimizer
Apache License 2.0
425 stars 57 forks source link

Applying fix for different param_groups for RAdam #10

Closed redknightlois closed 5 years ago

redknightlois commented 5 years ago

https://github.com/LiyuanLucasLiu/RAdam/issues/24

mgrankin commented 5 years ago

That's valuable fix, thank you, but @sholderbach already did that. https://github.com/mgrankin/over9000/pull/9

redknightlois commented 5 years ago

LOL... Didn't saw the Ralamb change so I applied it too.