search

IndicoDataSolutions / Passage

A little library for text analysis with RNNs.
MIT License
530 stars 134 forks source link

Initialize LSTM forget gate with one #30

Open ma2rten opened 9 years ago

ma2rten commented 9 years ago

This paper found they got significantly better results on a range of tasks if the forget gate for LSTM is initialized with one.

http://www.jmlr.org/proceedings/papers/v37/jozefowicz15.pdf

eoninfinity commented 6 years ago

How to initialze the forget gate with1