search

alanyuchenhou / elephant

MIT License
3 stars 5 forks source link

learning rate #22

Closed alanyuchenhou closed 8 years ago

alanyuchenhou commented 8 years ago

Regarding learning rate mentioned in #21, I haven't exploited any tricks with learning rate yet - it has been constant 0.1. I can try something fancier like exponential decay function for learning rate.

alanyuchenhou commented 8 years ago

Exponential decay contribute to higher accuracy, but it is not useful for online learning so I think I guess maybe we don't try it now.