CalayZhou / MBNet

Improving Multispectral Pedestrian Detection by Addressing Modality Imbalance Problems (ECCV 2020)
100 stars 30 forks source link

`w_d_weight' and `w_n_weight' #21

Open nihaoxiaoli opened 3 years ago

nihaoxiaoli commented 3 years ago

你好,我有一个问题是:

#illumination Gate
def Illumination_Gate(stage_rgb,stage_lwir,channel_num ,bn_axis,w_d_weight,w_n_weight,stage_name = 'stage3',trainable=True):
    stage_rgb = multiply([stage_rgb,w_d_weight])
    stage_lwir = multiply([stage_lwir,w_n_weight])
    stage_concat=Concatenate()([stage_rgb,stage_lwir])
    stage_concat = L2Normalization(gamma_init=10, name=stage_name+'_cat_bn_pre')(stage_concat)

这里面为什么乘的是w_d_weightw_n_weight?我感觉从论文或者直觉来说应该乘w_rgbw_lwir吧。感觉比较疑惑。 感谢您的回复

CalayZhou commented 3 years ago

您好,我觉得您的想法挺合理的,你可以试一试乘w_rgb和w_lwir,当初在光照感知这块设计得比较粗糙,如何自适应融合RGB与红外特征这一块可以进一步研究