search

facebookresearch / mae

PyTorch implementation of MAE https//arxiv.org/abs/2111.06377
Other
6.93k stars 1.17k forks source link

Is the visualization result normal? #174

Open WangYZ1608 opened 11 months ago

WangYZ1608 commented 11 months ago

Hello,

thank you for the great work and the great repo.

I reproduced the pre-training of MAE-ViT-Large, performed 800 epochs, and set norm_pix_loss=True. Below is the visualization result and tensorboard curve, is this normal?

the result similar to #156

result Snipaste_2023-07-31_16-48-29

jfcarre commented 10 months ago

I am having similar results, any update?

xywen97 commented 9 months ago

Almost the same promblem. When I try to finetune the MAE model with MSE loss on a new small dataset, I found the loss was decreasing but the visualization results were quite strange (be like what you show above). So weired.