fix sgdw weight decay bug

jettify / pytorch-optimizer

torch-optimizer -- collection of optimizers for Pytorch

Apache License 2.0

3.04k stars 300 forks source link

Open Leiay opened 2 years ago

Leiay commented 2 years ago

Hi,

I open this pull request for the issue I submitted regarding SGDW: https://github.com/jettify/pytorch-optimizer/issues/454#issue-1332395921 Hope this change makes sense. Thanks!

Best Regards, Liu