search

DingXiaoH / ACNet

ACNet: Strengthening the Kernel Skeletons for Powerful CNN via Asymmetric Convolution Blocks
MIT License
831 stars 133 forks source link

About BN layer #35

Closed HCookY95 closed 3 years ago

HCookY95 commented 4 years ago

@ShawnDing1994 @DingXiaoH Hi friend,

That's a pretty impressive work.

I wanna put the AC block into my own network, it's a ResNet-like architecture. I have noticed there is BN layer after each kernel (square, horizontal and vertical), and then add those three together to get the result of AC block.

So I have questions, do I still need add one more BN layer after the result? eg. When define ResNet, does it still need to add a BN layer in bottleneck?

DingXiaoH commented 3 years ago

There is no need to put a BN after an ACB. E.g., the bottleneck of ResNet-50 should be like 1x1conv - BN - ReLU - ACB - ReLU - 1x1conv - BN