xy-guo / LIGA-Stereo

Code for LIGA-Stereo Detector, ICCV'21
Apache License 2.0
91 stars 18 forks source link

The implementation process and experimental results of using "soft targets". #11

Closed zjwzcx closed 2 years ago

zjwzcx commented 2 years ago

Hi Xiaoyang! Thanks for your great work. In the Introduction of LIGA-Stereo, you mentioned

'Comparing with traditional knowledge distillation for recognition tasks, we did not take the final erroneous classification and regression predictions from the LiDAR model as “soft” targets, which we found benefits little for training stereo detection networks.'

Could you please elaborate on your implementation process and experimental results?

xy-guo commented 2 years ago

Instead of imitating features, the network takes the soft probability distribution predicted by LiDAR-network as targets for the classification branch. For the regression, we directly use L1-loss to fit the regression offsets predicted from the LiDAR networks.