Nicolaus93 / coin_betting

Parameter-free optimization algorithms written for Pytorch.
MIT License
2 stars 0 forks source link

Implement momentum #4

Open Nicolaus93 opened 3 years ago

Nicolaus93 commented 3 years ago

Algorithms should have the option to use momentum as explained in section 6 of https://arxiv.org/pdf/1802.06293.pdf and section 3 in https://cs.stanford.edu/~ashokc/papers/onlinealigned.pdf