[Project] More Sophisticated Gradient Descent - Githubissues

SingleZombie / DL-Demos

Demos for deep learning

357 stars 88 forks source link

[Project] More Sophisticated Gradient Descent #8

Closed SingleZombie closed 2 years ago

SingleZombie commented 2 years ago

Implement following algorithms:

Mini-batch gradient descent
Gradient descent with momentum
RMSProp
Adam
Learning rate decay