What's the performance when `rm_self_attn_decoder` set to `True`?

IDEA-Research / DAB-DETR

[ICLR 2022] Official implementation of the paper "DAB-DETR: Dynamic Anchor Boxes are Better Queries for DETR"

Apache License 2.0

501 stars 86 forks source link

Closed zhanghengdev closed 2 years ago

zhanghengdev commented 2 years ago

Hello, I noticed that in https://github.com/IDEA-opensource/DAB-DETR/blob/94f20eda2be7cf38ddf94102db92e949b6846a65/models/DAB_DETR/transformer.py#L333 , there is a parameter rm_self_attn_decoder that is set to False by default. Have you ever set it to True? What's the performance?

SlongLiu commented 2 years ago

We found the performance droped a lot without self-attntention in decoder layers.