lightweight network for self-teaching

[lnSong]

When I use monodepth2 and implement self-teaching, uncertainty does improve the results. But why I use a lightweight network and implement self-teaching, the result is not better but worse?

[mattpoggi]

Can you give more details about the lightweight model and the training protocol (epochs, etc.)?

[lnSong]

I use mobilenet as the backbone, the epoch is 100, and the learning rate is 0.0001. I first train the teacher network, then fix the teacher network, and then use mobilenet with uncertainty prediction branch as the student network. The teacher network is the same as the student network.Thank you!