JiahuiYu / wdsr_ntire2018

Code of our winning entry to NTIRE super-resolution challenge, CVPR 2018
http://www.vision.ee.ethz.ch/ntire18/
598 stars 123 forks source link

Wide-activation #11

Closed DanChen001 closed 5 years ago

DanChen001 commented 5 years ago

Hi,

Thank you for providing the code.

The wide-activated network is very effective. Do you have idea why it works? Thanks.

JiahuiYu commented 5 years ago

@DanChen001 The wide activation rule is mainly based on several motivations. One motivation is that non-linear ReLUs impede information flow from shallow layers to deeper ones, as mentioned in our report.

DanChen001 commented 5 years ago

@JiahuiYu Thanks.