Add support to AWD-LSTM-LM for QRNN architecture

salesforce / awd-lstm-lm

LSTM and QRNN Language Model Toolkit for PyTorch

BSD 3-Clause "New" or "Revised" License

1.96k stars 488 forks source link

Add support to AWD-LSTM-LM for QRNN architecture #10

Closed Smerity closed 7 years ago

Smerity commented 7 years ago

The QRNN is two or more times faster than the cuDNN LSTM. The below code adds support for the QRNN architecture and also provides hyper parameters to start experimentation.