search

sail-sg / Adan

Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models
Apache License 2.0
756 stars 64 forks source link

Typo in the paper #15

Closed Tomarchelone closed 2 years ago

Tomarchelone commented 2 years ago

Looking at arxiv version. In Appendix C in the last two lines of the Eq. 10 and the first line of the following update rule: \theta in the last term should have index k-1 instead of k.

(Not sure if this is the appropriate place to report paper typos, please tell me if there is a more sutable one).

XingyuXie commented 2 years ago

@Tomarchelone you are right. Thanks for pointing out this. We will refine it in our next update.

It's ok to report paper typos here. Other problems are also welcome to inform us in any way. Thanks again.

Best