Did you update the moving averages when taking the batch norm ?

[shamanez]

In this line . It even says ,

updates_collections=None

What is actually meant by this ?

[shamanez]

The documentation in tensorflow say like this ,

Note: when training, the moving_mean and moving_variance need to be updated. By default the update ops are placed in tf.GraphKeys.UPDATE_OPS, so they need to be added as a dependency to the train_op. For example:

[yscacaca]

updates_collections=None is to force the updates in place. You can also tf.GraphKeys.UPDATE_OPS by referring the TensorFlow documents.