ShigekiKarita / grain

autograd mir and CUDA library for dynamic neural networks in D.
https://shigekikarita.github.io/grain
Boost Software License 1.0
66 stars 7 forks source link

grain.optim: Fix bug in Adam optimizer #15

Closed CyberShadow closed 3 years ago

CyberShadow commented 3 years ago

I did not test this or get this to work, but the previous code did not seem correct.

Perhaps there is an opportunity to improve the unit test to cover the previous bug.

ShigekiKarita commented 3 years ago

Many thanks!