nicholas-leonard / dp

A deep learning library for streamlining research and development using the Torch7 distribution.
Other
343 stars 140 forks source link

RMSProp and AdaGrad Visitors #117

Open nicholas-leonard opened 9 years ago

nicholas-leonard commented 9 years ago

http://www.erogol.com/comparison-sgd-vs-momentum-vs-rmsprop-vs-momentumrmsprop/

nicholas-leonard commented 9 years ago

[1] https://github.com/w-cheng/optimx/blob/master/rmsprop.lua [2] https://github.com/y0ast/VariationalDeconvnet/blob/master/rmsprop.lua [3] https://github.com/kaishengtai/torch-ntm/blob/master/rmsprop.lua