Open nicholas-leonard opened 9 years ago
http://www.erogol.com/comparison-sgd-vs-momentum-vs-rmsprop-vs-momentumrmsprop/
[1] https://github.com/w-cheng/optimx/blob/master/rmsprop.lua [2] https://github.com/y0ast/VariationalDeconvnet/blob/master/rmsprop.lua [3] https://github.com/kaishengtai/torch-ntm/blob/master/rmsprop.lua
http://www.erogol.com/comparison-sgd-vs-momentum-vs-rmsprop-vs-momentumrmsprop/