This repository contains the code that was used for the Sequential MNIST, Penn Treebank and text8 experiments in the paper Recurrent Batch Normalization (http://arxiv.org/abs/1603.09025). For the Attentive Reader, see https://github.com/cooijmanstim/Attentive_reader/tree/bn.

The experiments directory contains shell scripts that demonstrate how to launch the experiments with the hyperparameters from the paper.

Depends on Theano, Blocks and Fuel.

Other implementations:

• https://github.com/fchollet/keras/pull/2183
• https://github.com/iassael/torch-bnlstm
• https://github.com/OlavHN/bnlstm
• https://gist.github.com/spitis/27ab7d2a30bbaf5ef431b4a02194ac60