search

karandwivedi42 / imagenet-multiGPU.torchnet

An imagenet example in torchnet
4 stars 1 forks source link

What si opt.fixBN? #2

Open Supersak80 opened 7 years ago

Supersak80 commented 7 years ago

What exactly is the purpose of opt.fixBN?

karandwivedi42 commented 7 years ago

While tuning it is recommended to sometimes fix batch normalisation layers. Setting fixBN to true converted BN layers to affine layers so that the running mean and std computation inside BN layers is not changed during fine tuning