dvlab-research / Parametric-Contrastive-Learning

Parametric Contrastive Learning (ICCV2021) & GPaCo (TPAMI 2023)
https://arxiv.org/abs/2107.12028
MIT License
241 stars 32 forks source link

bias/normalisation #22

Open audibert-alexandre-fra opened 1 year ago

audibert-alexandre-fra commented 1 year ago

Hello. I have one remark

If my previous comment is correct, can you explain this choice. Thanks in advance

jiequancui commented 1 year ago

Hi,

Thanks for your question.

There are no special reasons. We observed that after the training with dot products between centers and representations, the output has already been almost normalized.

Best,