search

microsoft / SimMIM

This is an official implementation for "SimMIM: A Simple Framework for Masked Image Modeling".
https://arxiv.org/abs/2111.09886
MIT License
917 stars 86 forks source link

Inconsistency of ViT-base config as described in the paper #16

Open Jiahao000 opened 2 years ago

Jiahao000 commented 2 years ago

Thanks for sharing your excellent work!

I notice that there are some differences in ViT-base pre-training config provided here and described in the paper, e.g., base_lr, warmup_epochs, lr_scheduler. May I know why these settings are different?

Thank you!