pretrain fails when image categories are similar

SwinTransformer / Transformer-SSL

This is an official implementation for "Self-Supervised Learning with Swin Transformers".

https://arxiv.org/abs/2105.04553

MIT License

624 stars 67 forks source link

pretrain fails when image categories are similar #18

Open 894665169 opened 1 year ago

894665169 commented 1 year ago

i want to use your work to perform few epochs pretrain on my dataset,which contains sevceral similar vehicle categories. So i load the imagenet-pretrained checkpoint and run another pretrain on my dataset,and it fails cause the loss not falling。 What's the reason?