TonyLianLong / CrossMAE

Official Implementation of the CrossMAE paper: Rethinking Patch Dependence for Masked Autoencoders
https://crossmae.github.io/
Other
77 stars 5 forks source link

Thw linear probing #4

Open CASlzwde opened 3 months ago

CASlzwde commented 3 months ago

Hi, this is an interesting work. I want to know the linear probing results.

Max-Fu commented 2 months ago

The linear probe results for ViT-S and ViT-B are provided below. All models are pretrained for 800 epochs.

For ViT-S: MAE CrossMAE
49.7 51.5
For ViT-B: MAE CrossMAE
65.1 65.4