Add BaseOptimizer, RMSProp, Adagrad, Adamax, Adadelta - Githubissues

OptimalFoundation / nadir

Nadir: Cutting-edge PyTorch optimizers for simplicity & composability! 🔥🚀💻

https://nadir.rtfd.io

Apache License 2.0

13 stars 3 forks source link

Add BaseOptimizer, RMSProp, Adagrad, Adamax, Adadelta #23

Closed bhavnicksm closed 1 year ago

bhavnicksm commented 1 year ago

This pull request does the following:

[x] Adds BaseOptimizer class
[x] Adds SGD and Adam based on the Base Optimizer class
[x] Adds Adagrad
[x] Adds RMSProp
[x] Adds Adadelta
[x] Adds Adamax
[x] Adds Momentum