facebookresearch / mae

PyTorch implementation of MAE https//arxiv.org/abs/2111.06377
Other
6.93k stars 1.17k forks source link

Training time #164

Open penguin1109 opened 1 year ago

penguin1109 commented 1 year ago

How many epochs do we need to train in order to make the model generate reasonable ouputs? I am currently training the MAE model from scratch, with 4000 images (the dataset is very small though). But the model keeps on generating images like the image uploaded.

What is the possible problem here??

Thanks. 0 (1)

johnWang2022 commented 1 year ago

I do not know you set the norm pix loss is true or false , when you make pretraining. If you want to generate the image like original image , you should set norm pix loss to false ( remove the --norm_pix_loss) when you make pretraining or fine-tuning. it will close the norm for patch of target tensor. 1684404187983