What is the difference between GN with group= 1 and LN?

sail-sg / poolformer

PoolFormer: MetaFormer Is Actually What You Need for Vision (CVPR 2022 Oral)

https://arxiv.org/abs/2111.11418

Apache License 2.0

1.3k stars 116 forks source link

Closed ShihuaHuang95 closed 2 years ago

ShihuaHuang95 commented 2 years ago

Hi, could you please identify the difference between GN with group=1 and LN? The accuracy gap is large.

yuweihao commented 2 years ago

Hi @ShihuaHuang95 , please the issue #9 .

yuweihao commented 2 years ago

Duplicate of #9 .