Closed cGy147 closed 3 years ago
Hi @cGy147,
Thanks for your interest. Recalling the GraphCL loss is defined as: - log( sim(positive pair) / sum of sim(negative pairs) )
, where negative pairs excluding the positive ones (diagonal values of sim_matrix). Thus subtraction is performed here.
But in your paper:
I think your implemention of your code is different from the equation 3, which consists of 1 positive pair and N-1 negative pairs. Am I misunderstanding?
Hi @cGy147,
Yeah thanks a lot for pointing this out. The formulation should be corrected. The denominator should be sum^N_{k=1, k \neq i} exp(sim(kth neg pair)/t)
. I will submit a corrected version arXiv today.
Hi: In GraphCL/unsupervised_TU/gsimclr:
Why the denominator of loss need subtract the pos_sim?