How to introduce DN-DETR denoising method into SAM-DETR?

ZhangGongjie / SAM-DETR

[CVPR'2022] SAM-DETR & SAM-DETR++: Official PyTorch Implementation

MIT License

292 stars 50 forks source link

How to introduce DN-DETR denoising method into SAM-DETR? #16

Open jiaozhiqiang opened 1 year ago

jiaozhiqiang commented 1 year ago

Thanks for the wonderful work. I have seen that DN is introduced into SAM-Deter ++, but there is no corresponding disclosure code. Could you briefly describe the method if it is convenient? Can I just replace the input from the Decoder with something like a DN? thank you

jiaozhiqiang commented 10 months ago

I also have a problem. After using DN to add SAM-Detr-+ +, the DN group object queries are spliced together with the original object queries and input into Transformer. Then, this will cause the object queries of DN group in Decoder to be resampled by SAM module. Won't this destroy the meaning of DN group? So is it unreasonable to splice DN groups directly with original object queries? Looking forward to your answer. Thank you!