DmitryUlyanov / texture_nets

Code for "Texture Networks: Feed-forward Synthesis of Textures and Stylized Images" paper.
Apache License 2.0
1.22k stars 217 forks source link

Does BN function equivalently to InstanceNorm when batchsize equals 1? #77

Closed Naruto-Sasuke closed 7 years ago

DmitryUlyanov commented 7 years ago

Yes, if you will not set eval mode while testing.

Naruto-Sasuke commented 7 years ago

Thank you. I am wondering that whether using BN with batchSize 1 has the same effect with using InstanceNorm with batchSize 1. Or which is better for most normal cases.

DmitryUlyanov commented 7 years ago

Hi, BN with batch size 1 is exactly the same as Instance norm with batch size = 1.

On Tue, Aug 8, 2017 at 6:12 PM Hungryof notifications@github.com wrote:

Thank you. I am wondering that whether using BN with batchSize 1 has the same effect with using InstanceNorm with batchSize 1. Or which is better for most normal cases.

— You are receiving this because you commented.

Reply to this email directly, view it on GitHub https://github.com/DmitryUlyanov/texture_nets/issues/77#issuecomment-320986977, or mute the thread https://github.com/notifications/unsubscribe-auth/AGanZMnwP5zr3fhV3aAGdXwOAzGafV7aks5sWHrVgaJpZM4OVEbR .

-- Best, Dmitry

Naruto-Sasuke commented 7 years ago

Aha, I got it and thank you Dimitry!