Why is the consistency cost taken between cons_logits of student and class_logits of teacher?

CuriousAI / mean-teacher

A state-of-the-art semi-supervised method for image recognition

https://arxiv.org/abs/1703.01780

Other

1.56k stars 331 forks source link

Why is the consistency cost taken between cons_logits of student and class_logits of teacher? #31

Open Nitinsiwach opened 5 years ago

Nitinsiwach commented 5 years ago

I am talking about self.mean_cons_cost_mt, self.cons_costs_mt = consistency_costs( self.cons_logits_1, self.class_logits_ema, self.cons_coefficient, consistency_mask, self.hyper['consistency_trust']) What is the difference between using 'self.class_logits_ema' and using 'self.cons_logits_ema' as consistency targets?