Closed tghong closed 3 years ago
Thanks for the great work!
I have a question in equation (1) and (2) in the paper. In the denominators of these equations, why the temperature hyper-parameter \tau is not used in the "exp(q·k+)" and "exp(r^s·t^s+)"? In https://github.com/WXinlong/DenseCL/blob/main/openselfsup/models/heads/contrastive_head.py#L34, it seems that \tau is applied to all key features.
Hi, thanks for pointing it out! It's a typo and we will correct it in our next version.
OK. Thank you!
Thanks for the great work!
I have a question in equation (1) and (2) in the paper. In the denominators of these equations, why the temperature hyper-parameter \tau is not used in the "exp(q·k+)" and "exp(r^s·t^s+)"? In https://github.com/WXinlong/DenseCL/blob/main/openselfsup/models/heads/contrastive_head.py#L34, it seems that \tau is applied to all key features.