search

google-deepmind / optax

Optax is a gradient processing and optimization library for JAX.
https://optax.readthedocs.io
Apache License 2.0
1.59k stars 170 forks source link

Statistical Adaptive Stochastic Gradient Methods #703

Open fabianp opened 6 months ago

fabianp commented 6 months ago

Implement the SALSA method from

Zhang, Pengchuan, et al. "Statistical adaptive stochastic gradient methods." arXiv preprint arXiv:2002.10597 (2020).

alirezadamash commented 6 months ago

I am studying the paper, it seems I can connect my brain to the lines of the paper:) let me work on this issue.

fabianp commented 6 months ago

All yours @alirezadamash !