tianzhi0549 / FCOS

FCOS: Fully Convolutional One-Stage Object Detection (ICCV'19)
https://arxiv.org/abs/1904.01355
Other
3.27k stars 630 forks source link

Is the centerness branch able to replace as a centerness loss in target function and only be used in inference process? #270

Open foreverYoungGitHub opened 4 years ago

foreverYoungGitHub commented 4 years ago

Hi, @tianzhi0549,

Thank you for your great work!

I'm really curious about the centerness branch in the FCOS. It has been proved by FCOS and ATSS paper that it can improve the percision of model significantly, espectially in the reg branch.

However, based on eq. 3) in the paper. The centerness target is directly calculated by the regression target. Is that possible we could replace the centerness branch as a penalty in the regression loss in the training process?

Also since it is directly calculated by the reg target, in the inference process, the centerness actually can be directly calculated by the reg prediction and applied it to the score value to filter the low quality box as well.

I'm wondering what is the advantage to adopt centerness branch in FCOS and why does it have this effect?

Thanks!

Best,

chengsonghust commented 4 years ago

Centerness branch is introduced to align the cls_score and bbox_pred. In the training step, the target centerness can be used to down-weight IoU loss of predicted boxes near the edge. In the inference step, the predicted centerness is used to down-weight the cls-scores of predicted boxes near the edge.

Cying212Jack commented 3 years ago

I guess centerness branch can explicitly adds boundness as a penalty in the training.