search

google-deepmind / optax

Optax is a gradient processing and optimization library for JAX.
https://optax.readthedocs.io
Apache License 2.0
1.69k stars 190 forks source link

Implement support for Yogi optimiser #9

Closed mtthss closed 3 years ago

mtthss commented 4 years ago

See paper:

https://papers.nips.cc/paper/8186-adaptive-methods-for-nonconvex-optimization.pdf

8bitmp3 commented 3 years ago

Doc string also added, awesome work everyone https://github.com/deepmind/optax/pull/90