Closed Artificial-Inability closed 1 year ago
I found that in projects/dino/configs/models/dino_r50.py, the temperature setting in position_embedding is 10000, which is inconsistent with the setting in dino paper(T=20). However, when I used the default temperature setting in this repo to reproduce COCO 1x experiment, I got the same result as the dino paper(49.0). Could you double check the temperature setting when you did the experiments in dino paper? Did you do experiments about what is the best temperature for dino?
setting temperature to 20
and 10000
get almost the same results in DINO~ @Artificial-Inability
I found that in projects/dino/configs/models/dino_r50.py, the temperature setting in position_embedding is 10000, which is inconsistent with the setting in dino paper(T=20). However, when I used the default temperature setting in this repo to reproduce COCO 1x experiment, I got the same result as the dino paper(49.0). Could you double check the temperature setting when you did the experiments in dino paper? Did you do experiments about what is the best temperature for dino?