Small bug fix: change default eps in DAdaptAdaGrad to avoid value error

facebookresearch / dadaptation

D-Adaptation for SGD, Adam and AdaGrad

MIT License

501 stars 19 forks source link

Small bug fix: change default eps in DAdaptAdaGrad to avoid value error #39

Closed brunzema closed 12 months ago

brunzema commented 12 months ago

The default value of eps=0.0 in DAdaptAdaGrad directly raises a value error. I changed it to eps=1e-6 as specified in the doc string. Thank you for the nice optimizers!

adefazio commented 12 months ago

Thanks for the fix!