search

google-deepmind / optax

Optax is a gradient processing and optimization library for JAX.
https://optax.readthedocs.io
Apache License 2.0
1.63k stars 174 forks source link

Clarify formula for cosine learning rate. #823

Closed copybara-service[bot] closed 6 months ago

copybara-service[bot] commented 6 months ago

Clarify formula for cosine learning rate.

I think it's useful to have the precise formula of the learning in the docstring. Otherwise I find myself often going to the source code to understand the learning rate.