Closed DanChen001 closed 5 years ago
@DanChen001 The wide activation rule is mainly based on several motivations. One motivation is that non-linear ReLUs impede information flow from shallow layers to deeper ones, as mentioned in our report.
@JiahuiYu Thanks.
Hi,
Thank you for providing the code.
The wide-activated network is very effective. Do you have idea why it works? Thanks.