Does the MAE pre-trained model transfer well to CIFAR？

facebookresearch / mae

PyTorch implementation of MAE https//arxiv.org/abs/2111.06377

Other

6.93k stars 1.17k forks source link

Does the MAE pre-trained model transfer well to CIFAR？ #154

Open ZK-Zhou opened 1 year ago

ZK-Zhou commented 1 year ago

Hello, I am doing the task of mae transfering to cifar, and I find that MAE is no better than supervised pre-trained vit on small data sets. Could you give me some advice？

alexlioralexli commented 6 months ago

I found that MAE pretraining helps with CIFAR-100. Maybe you could try that?