Which model should I use after training, the teacher or the student?

amazon-science / omni-detr

PyTorch implementation of Omni-DETR for omni-supervised object detection: https://arxiv.org/abs/2203.16089

Other

64 stars 6 forks source link

Which model should I use after training, the teacher or the student? #5

Closed 1224wxwx closed 2 years ago

1224wxwx commented 2 years ago

Thanks for the amazing work. After training for several epochs in SSOD mode，I found that the performance of teacher model was much better than student. I wonder whether this phenomena is normal or not? If it is normal, which model should I use，the teacher or the sutdent？ Thanks.

zhaoweicai commented 2 years ago

Yes, the gap between student and teacher is normal, and we used the results of the teacher in the papers.

1224wxwx commented 2 years ago

thank you