LSTM hyparameters for language modeling

Luolc / AdaBound

An optimizer that trains as fast as Adam and as good as SGD.

https://www.luolc.com/publications/adabound/

Apache License 2.0

2.91k stars 331 forks source link

LSTM hyparameters for language modeling #21

Open hoangcuong2011 opened 5 years ago

hoangcuong2011 commented 5 years ago

Greetings,

Thanks for your great paper. I am wondering about the hyperparameters you used for language modeling experiments. Could you provide information about that?

Thank you!