Create learning rate schedulers

google / objax

Apache License 2.0

769 stars 77 forks source link

Create learning rate schedulers #187

Open david-berthelot opened 3 years ago

david-berthelot commented 3 years ago

It would need a dedicated namespace, like objax.schedule for example (or a better name possibly). We could have linear learning rate decay, cosine, multistep, etc...

Need feedback on what to offer.

AlexeyKurakin commented 3 years ago

Pull request with work in progress: https://github.com/google/objax/pull/202