sail-sg / poolformer

PoolFormer: MetaFormer Is Actually What You Need for Vision (CVPR 2022 Oral)
https://arxiv.org/abs/2111.11418
Apache License 2.0
1.3k stars 117 forks source link

Pretrained weights for other versions #46

Closed JRestom closed 1 year ago

JRestom commented 1 year ago

Are there any available weights for the PoolFormer version with BN and LN instead of the Modified Layer Norm? (Table 5 in https://arxiv.org/abs/2111.11418)

yuweihao commented 1 year ago

Hi @JRestom ,

Thanks for your attention. For BN checkpoint, I have posted it in this issue #5 . For LN checkpoint, sorry that it is deleted. I will retrain it in a week and share it with you. Thanks.

JRestom commented 1 year ago

Thank you! It would be of great help.

yuweihao commented 1 year ago

Hi @JRestom ,

poolformer_ln_s12.pth.tar (let norm_layer=LayerNormChannel) is released.

Thanks!

JRestom commented 1 year ago

Hello @yuweihao, I highly appreciate the weights. One issue, when opening the link it directs me to a file called poolformer_bn_s12 (BatchNorm I assume). Could you double check the link?

yuweihao commented 1 year ago

Hi @JRestom , yes, poolformer_bn_s12.pth.tar and let norm_layer=torch.nn.BatchNorm2d.

JRestom commented 1 year ago

I meant, the link of poolformer_ln_s12.pth.tar is directing me to the same folder as poolformer_bn_s12.pth.tar. Shouldn't they be different? (one for LayerNom and one for BatchNorm).

yuweihao commented 1 year ago

Oh, my fault, the right link is poolformer_ln_s12.pth.tar.

JRestom commented 1 year ago

Thank you so much!!