search

alanyuchenhou / elephant

MIT License
4 stars 5 forks source link

optimizer #23

Closed alanyuchenhou closed 8 years ago

alanyuchenhou commented 8 years ago

SGD(stochastic gradient decent) is the optimizer in action now. There are variants with enhanced learning rate control #22 I can try like AdaGrad.

alanyuchenhou commented 8 years ago

AdaGrad didn't provide any substantial benefit.