Question on SimCLR loss

wvangansbeke / Unsupervised-Classification

SCAN: Learning to Classify Images without Labels, incl. SimCLR. [ECCV 2020]

https://arxiv.org/abs/2005.12320

Other

1.37k stars 267 forks source link

Question on SimCLR loss #59

Closed rajat-tech-002 closed 3 years ago

rajat-tech-002 commented 3 years ago

Hy @wvangansbeke , can you please tell whether the loss value returned by SimCLR function is averaged over the batch or not? This Instance-CL loss is SimCLR loss only.

wvangansbeke commented 3 years ago

Hi @rajat-tech-002,

Yes, we take the mean over the batch. Check the last line of the SimCRL-loss (here).