dinohead weight normalized

facebookresearch / dino

PyTorch code for Vision Transformers training with the Self-Supervised learning method DINO

Apache License 2.0

6.06k stars 885 forks source link

dinohead weight normalized #248

Open kffeng opened 12 months ago

kffeng commented 12 months ago

Hi, thank you for your work. I would like to ask, what kind of impact will it have on the model if the weight normalized trick is not used in dinohead? Will it reduce the final accuracy?