side output before relu activation function

nnizhang / S2MA

source code of "Learning Selective Self-Mutual Attention for RGB-D Saliency Detection" (CVPR2020)

62 stars 8 forks source link

side output before relu activation function #6

Open clelouch opened 3 years ago

clelouch commented 3 years ago

Hi, thanks for your great work. I've noticed that in the VGGNet, you generate the side output before relu activation. However, in almost all previous methods, they generate side output after applying the relu function. Can you tell me why you use this configuration and how much improvement it brings?