search

microsoft / SimMIM

This is an official implementation for "SimMIM: A Simple Framework for Masked Image Modeling".
https://arxiv.org/abs/2111.09886
MIT License
917 stars 86 forks source link

SimMIM with Absolute Position Embedding #21

Open hemangchawla opened 2 years ago

hemangchawla commented 2 years ago

Hello,

I would like to use SimMIM model pre-trained with Absolute position embedding = True, and RPE ( incl. shared) = False.

However, I do not have the resources to train with an effective batch size of 2048.

Would it please be possible to provide appropriate pre-trained models on the repo?

Thanks and regards