search

Element-Research / rnn

Recurrent Neural Network library for Torch7's nn
BSD 3-Clause "New" or "Revised" License
941 stars 313 forks source link

Weight normalization #410

Open richardassar opened 7 years ago

richardassar commented 7 years ago

I've implemented Weight Normalization inside a variant of SeqGRU I wrote for a project.

https://github.com/richardassar/SampleRNN_torch/blob/master/SeqGRU_WN.lua

If there's interest I can submit a PR with a SeqLSTM implementation also.