Question in equation (1) and (2)

WXinlong / DenseCL

Dense Contrastive Learning (DenseCL) for self-supervised representation learning, CVPR 2021 Oral.

GNU General Public License v3.0

544 stars 70 forks source link

Closed tghong closed 3 years ago

tghong commented 3 years ago

Thanks for the great work!

I have a question in equation (1) and (2) in the paper. In the denominators of these equations, why the temperature hyper-parameter \tau is not used in the "exp(q·k+)" and "exp(r^s·t^s+)"? In https://github.com/WXinlong/DenseCL/blob/main/openselfsup/models/heads/contrastive_head.py#L34, it seems that \tau is applied to all key features.

WXinlong commented 3 years ago

Hi, thanks for pointing it out! It's a typo and we will correct it in our next version.

tghong commented 3 years ago

OK. Thank you!