Implement SPS+ variant of Polyak step-size

google / jaxopt

Hardware accelerated, batchable and differentiable optimizers in JAX.

https://jaxopt.github.io

Apache License 2.0

903 stars 62 forks source link

Closed copybara-service[bot] closed 8 months ago

copybara-service[bot] commented 8 months ago

Implement SPS+ variant of Polyak step-size

Also tests of PolyakSGD were tightened using a relative measure of gradient suboptimality instead of just the gradient suboptimality.