search

Luolc / AdaBound

An optimizer that trains as fast as Adam and as good as SGD.
https://www.luolc.com/publications/adabound/
Apache License 2.0
2.9k stars 330 forks source link

LSTM hyparameters for language modeling #21

Open hoangcuong2011 opened 4 years ago

hoangcuong2011 commented 4 years ago

Greetings,

Thanks for your great paper. I am wondering about the hyperparameters you used for language modeling experiments. Could you provide information about that?

Thank you!