Not running in evaluation mode during testing/generation intentional?

DmitryUlyanov / texture_nets

Code for "Texture Networks: Feed-forward Synthesis of Textures and Stylized Images" paper.

Apache License 2.0

1.22k stars 217 forks source link

Not running in evaluation mode during testing/generation intentional? #35

Closed tonypeng closed 8 years ago

tonypeng commented 8 years ago

It seems to me that the network is not being run in evaluation mode (and therefore use the population mean/variance for the batch/instance normalization layers) when running feed forward/generating styled images. Is this intentional? I read your paper and wasn't sure if

Differently from batch normalization, furthermore, the instance normalization layer is applied at test time as well

meant to calculate the means/variances during test time as well/not use population statistics.

DmitryUlyanov commented 8 years ago

Yes, batch norm in training mode and batch_size = 1 is instance norm.