tanluren / yolov3-channel-and-layer-pruning

yolov3 yolov4 channel and layer pruning, Knowledge Distillation 层剪枝,通道剪枝,知识蒸馏
Apache License 2.0
1.5k stars 446 forks source link

关于蒸馏时计算lcls 的问题 #132

Open zhangyilalala opened 3 years ago

zhangyilalala commented 3 years ago

你好! 请问一下,以下代码为什么把objness也计算进softmax里面? output_s_i = ps[..., 4:].view(-1, model.nc + 1) output_t_i = pt[..., 4:].view(-1, model.nc + 1) lcls += criterion_st(nn.functional.log_softmax(output_s_i/T, dim=1), nn.functional.softmax(output_t_i/T,dim=1)) (TT) / ps.size(0) 为什么不是下面这样从类别置信度开始呢? output_s_i = ps[..., 5:].view(-1, model.nc) output_t_i = pt[..., 5:].view(-1, model.nc)