JiahuiYu / slimmable_networks

Slimmable Networks, AutoSlim, and Beyond, ICLR 2019, and ICCV 2019
Other
914 stars 131 forks source link

BN initialization for tracking performance during training #50

Closed MingxiLi closed 3 years ago

MingxiLi commented 3 years ago

Thanks for your great work!

I have a question about the initialization of BNs which are used for tracking performance during training. It seems that the weight and bias of BNs are not learnable. Why not set 'affine=True'? https://github.com/JiahuiYu/slimmable_networks/blob/3a4c4fd64428d47bb520af2ecb1d8e772afd9f66/models/slimmable_ops.py#L163