search

yyliu01 / PS-MT

[CVPR'22] Perturbed and Strict Mean Teachers for Semi-supervised Semantic Segmentation
https://arxiv.org/pdf/2111.12903.pdf
MIT License
186 stars 17 forks source link

three teachers #38

Closed wangmingaaaaa closed 9 months ago

wangmingaaaaa commented 9 months ago

Would it be better to integrate three teachers?

yyliu01 commented 9 months ago

Hi @wangmingaaaaa

Unfortunately, no. I have tried it, but the performance did not show significant improvement with more than two teachers. The potential reason might be that they eventually converge to the same local minimum in the late stages of training, and more teachers speed up such process.

While a potential solution is a different optimisation way of the third teacher, and this paper might be relevant.

Cheers, Yuyuan

wangmingaaaaa commented 9 months ago

Thank you very much for your reply