search

sail-sg / poolformer

PoolFormer: MetaFormer Is Actually What You Need for Vision (CVPR 2022 Oral)
https://arxiv.org/abs/2111.11418
Apache License 2.0
1.3k stars 117 forks source link

PoolFormer pretrained using MAE #53

Open Summer723 opened 1 year ago

Summer723 commented 1 year ago

Hi,

I really enjoy reading and doing one 2d pose estimation project using PoolFormer as backbone, also love the idea of metaformer. Have you thought about pretraining the model using MAE? Would you expect to have a performance boost as ViT does? Thanks in advance

yuweihao commented 1 year ago

Hi @Summer723 ,

Thank you for your attention. I am so sorry for the late response. In the past several months, I didn't have large computation resources for this project to conduct the experiments.