search

facebookresearch / mae

PyTorch implementation of MAE https//arxiv.org/abs/2111.06377
Other
6.93k stars 1.17k forks source link

The reconstruction of mae_pretrain_vit_base.pth is awful, is it right? #156

Closed zheng547 closed 1 year ago

zheng547 commented 1 year ago

I use the pre-trained model from https://dl.fbaipublicfiles.com/mae/pretrain/mae_pretrain_vit_base.pth. image

babar414 commented 1 year ago

Hi, this could be due to your pretrained model does not contained the weights of the decoder part as you may be using the pretrained model which is supposed to be used for finetuning/probing but not visualizing. You may try the model that is mentioned in the demo notebook provided by the authors at below link:

https://github.com/facebookresearch/mae/blob/main/demo/mae_visualize.ipynb