Closed zhanghengdev closed 2 years ago
Hello, I noticed that in https://github.com/IDEA-opensource/DAB-DETR/blob/94f20eda2be7cf38ddf94102db92e949b6846a65/models/DAB_DETR/transformer.py#L333 , there is a parameter rm_self_attn_decoder that is set to False by default. Have you ever set it to True? What's the performance?
rm_self_attn_decoder
False
We found the performance droped a lot without self-attntention in decoder layers.
Hello, I noticed that in https://github.com/IDEA-opensource/DAB-DETR/blob/94f20eda2be7cf38ddf94102db92e949b6846a65/models/DAB_DETR/transformer.py#L333 , there is a parameter
rm_self_attn_decoder
that is set toFalse
by default. Have you ever set it to True? What's the performance?