Open DimitriTimoz opened 2 weeks ago
Implement the LRSchedulers inspired by how PyTorch handles them. Include some basic schedulers.
The learning rate is updated as follows:
opt.set_learning_rate(scheduler.step(step)?);
Implement the LRSchedulers inspired by how PyTorch handles them. Include some basic schedulers.
The learning rate is updated as follows: