facebookresearch / dino

PyTorch code for Vision Transformers training with the Self-Supervised learning method DINO
Apache License 2.0
6.25k stars 905 forks source link

Loss Nan Error #263

Open Elijah-Yi opened 10 months ago

Elijah-Yi commented 10 months ago

change out_dim= 65536 to 1024, training in 15 epoch, loss is Nan