search

IDEA-Research / detrex

detrex is a research platform for DETR-based object detection, segmentation, pose estimation and other visual recognition tasks.
https://detrex.readthedocs.io/en/latest/
Apache License 2.0
2.01k stars 209 forks source link

Inconsisitent temperature setting in dino config and paper #188

Closed Artificial-Inability closed 1 year ago

Artificial-Inability commented 1 year ago

I found that in projects/dino/configs/models/dino_r50.py, the temperature setting in position_embedding is 10000, which is inconsistent with the setting in dino paper(T=20). However, when I used the default temperature setting in this repo to reproduce COCO 1x experiment, I got the same result as the dino paper(49.0). Could you double check the temperature setting when you did the experiments in dino paper? Did you do experiments about what is the best temperature for dino?

rentainhe commented 1 year ago

I found that in projects/dino/configs/models/dino_r50.py, the temperature setting in position_embedding is 10000, which is inconsistent with the setting in dino paper(T=20). However, when I used the default temperature setting in this repo to reproduce COCO 1x experiment, I got the same result as the dino paper(49.0). Could you double check the temperature setting when you did the experiments in dino paper? Did you do experiments about what is the best temperature for dino?

setting temperature to 20 and 10000 get almost the same results in DINO~ @Artificial-Inability