Closed Fulin-Gao closed 8 months ago
Hi @Fulin-Gao, $\boldsymbol{p}$ stands for predictions of the student model, and $\boldsymbol{q}$ means those from the teacher model. The one without prime symbol $\prime$ means output from the 1st augmented view, and the one with prime means output from another view. This set of symbols follows self-distillation and self-supervised learning literature.
For soft pseudo-label $\pmb p$, $\pmb p^{\prime}$, $\pmb q^{\prime}$, we are a little confused, what is the difference between them?