how to understand the meaning of variable 'hs' in RepViTBlock

THU-MIG / RepViT

RepViT: Revisiting Mobile CNN From ViT Perspective [CVPR 2024] and RepViT-SAM: Towards Real-Time Segmenting Anything

https://arxiv.org/abs/2307.09283

Apache License 2.0

730 stars 55 forks source link

Closed qishuaihui closed 1 year ago

qishuaihui commented 1 year ago

how to understand the meaning of variable 'hs' in RepViTBlock? I find it can not control the activation function.

we can find it from the repvit.py and it is defined as follows: nn.GELU() if use_hs else nn.GELU(),

jameslahm commented 1 year ago

Hi, 'hs' is indeed an unused variable. It can be removed in RepViTBlock.