Isn't that the spatial attention of SWRCAB should be a mask instead of tensor?

FadeoN / Distilling-Image-Dehazing-With-Heterogeneous-Task-Imitation

51 stars 8 forks source link

Isn't that the spatial attention of SWRCAB should be a mask instead of tensor? #8

Open aricsong1995 opened 3 years ago

aricsong1995 commented 3 years ago

Thank for your excellent work? I have a question regarding the spatial attenion at SWRCAB forward function. i notice that after the first sigmoid and multiplication, the shape of the weight is tensor instead of 2d mask. Is there any reason for that? i thought that is the spatial attention.