search

pmelchior / proxmin

Proximal optimization in pure python
MIT License
113 stars 24 forks source link

Implement RAdam #18

Closed pmelchior closed 5 years ago

pmelchior commented 5 years ago

see https://arxiv.org/abs/1908.03265v1 and https://medium.com/@lessw/new-state-of-the-art-ai-optimizer-rectified-adam-radam-5d854730807b for details

pmelchior commented 5 years ago

closed with ad0508b3316b94c1cb04df2a2bbf7ddf3cd4d2e8