Is your feature request related to a problem? Please describe.
In addition to Gradient Descent Variants from Research Papers, other more advanced optimizers are present as well.
Describe alternatives you've considered
Decide accordingly, whether to add classes in Optimizer.py or work on Optim Folder for this as well.
Explore accordingly, and simultaneously add resources here.
Is your feature request related to a problem? Please describe. In addition to Gradient Descent Variants from Research Papers, other more advanced optimizers are present as well.
Describe the solution you'd like https://ruder.io/optimizing-gradient-descent/ <----------(See this till more references will be uploaded) https://www.kdnuggets.com/2019/06/gradient-descent-algorithms-cheat-sheet.html
Describe alternatives you've considered Decide accordingly, whether to add classes in Optimizer.py or work on Optim Folder for this as well. Explore accordingly, and simultaneously add resources here.