Added mathematical description to Noisy SGD

google-deepmind / optax

Optax is a gradient processing and optimization library for JAX.

https://optax.readthedocs.io

Apache License 2.0

1.57k stars 169 forks source link

Added mathematical description to Noisy SGD #857

Closed hmludwig closed 4 months ago

hmludwig commented 4 months ago

I added mathematical description to noisy SGD to improve clarity (see #757)

The results look like this:

fabianp commented 4 months ago

thanks @hmludwig ! Having accurate, reliable and helpful documentation is the most important part of a scientific project like this one. Your contribution makes a big difference 🙌🏼