Is weight norm better than no batch norm, no batch norm better than batch norm?

xinntao / EDVR

Winning Solution in NTIRE19 Challenges on Video Restoration and Enhancement (CVPR19 Workshops) - Video Restoration with Enhanced Deformable Convolutional Networks. EDVR has been merged into BasicSR and this repo is a mirror of BasicSR.

https://github.com/xinntao/BasicSR

1.49k stars 318 forks source link

Is weight norm better than no batch norm, no batch norm better than batch norm? #65

Closed robotzheng closed 5 years ago

robotzheng commented 5 years ago

I try weight_norm, but can not avoid the "more than 100" error.

xinntao commented 5 years ago

I have not tried weight norm. No batch norm is better than batch norm.

If you train EDVR-M, it is not very likely to encounter this warning. Did you always meet this warning?

robotzheng commented 5 years ago

yes, I want to train a big model with options: RB40 frames23.