ShifuML / shifu

An end-to-end machine learning and data mining framework on Hadoop
https://github.com/ShifuML/shifu/wiki
Apache License 2.0
249 stars 109 forks source link

Adaptive Learning Rate Support #46

Open zhangpengshan opened 9 years ago

zhangpengshan commented 9 years ago

So far, our learning rate is a fixed value, some paper and mllib are starting to use adaptive learning rate according to current iteration.

This is useful to decrease total iteration number.

zhangpengshan commented 9 years ago

Need read paper on ADADELTA, still not clear about the learning rate computation.

zhangpengshan commented 9 years ago

Postpone this issue to 0.2.6.

zhangpengshan commented 8 years ago

Postpone this issue to 0.2.8. Should learn from stanfordnlp

zhangpengshan commented 8 years ago

Check StanfordNLP project in Github.