Question about use bias on linear layer

zyh-uaiaaaa / Erasing-Attention-Consistency

Official implementation of the ECCV2022 paper: Learn From All: Erasing Attention Consistency for Noisy Label Facial Expression Recognition

77 stars 15 forks source link

Question about use bias on linear layer #4

Open BossunWang opened 1 year ago

BossunWang commented 1 year ago

Hi, expert The proposed attention mechanism using the weights of fc layer to generate an attention map. I would like to know setting bias is true whether to affect the attention mechanism. Do you have any experiment about flag of bias?

https://github.com/zyh-uaiaaaa/Erasing-Attention-Consistency/blob/6dbc12cc6ab1efe85542afbbe99287bb3853aa4f/src/model.py#L19