Element-Research / rnn

Recurrent Neural Network library for Torch7's nn
BSD 3-Clause "New" or "Revised" License
938 stars 314 forks source link

Sequence to Sequence Attention model #403

Open abskjha opened 7 years ago

abskjha commented 7 years ago

First of all thanks for this wonderful library. How can we make a simple sequence to sequence Attention model (Bahdanau et al: https://arxiv.org/abs/1409.0473) using LSTM? As there are some open source libraries for NMT (like OpenNMT) where you can use it as a black box for training your model but nowhere I could find its simple implementation.

tastyminerals commented 7 years ago

You can check some code examples here. If you don't find anything of use, go to tensorflow, they have an example of seq2seq model.