search

Element-Research / rnn

Recurrent Neural Network library for Torch7's nn
BSD 3-Clause "New" or "Revised" License
938 stars 314 forks source link

Weight Normalization #414

Open richardassar opened 7 years ago

richardassar commented 7 years ago

Added weight-normalized versions of SeqGRU, SeqLSTM and SeqLSTMP.

These modules provide stability and better generalisation, vanilla GRU/LSTM blow up close to convergence for tasks such as SampleRNN.

BinaryBlue commented 7 years ago

On Fri, May 12, 2017 at 6:04 AM, The_Fly notifications@github.com wrote:

rmalized versions of SeqGRU, SeqLSTM and SeqLSTMP.

These modules provide stability and better generalisation, vanilla GRU/LSTM blow up close to convergence for tasks such as SampleR

ok