Sense-X / Co-DETR

[ICCV 2023] DETRs with Collaborative Hybrid Assignments Training
MIT License
939 stars 100 forks source link

[Help requested] Clarification on Generating Customized Positive Queries. #147

Open gracikk-ds opened 1 month ago

gracikk-ds commented 1 month ago

Hi, guys! Great work!

@TempleX98, I have been studying your paper on "DETRs with Collaborative Hybrid Assignments Training" and I am particularly interested in the Customized Positive Queries Generation process.
In DAB-DETR, there are two types of queries used by the decoder: content queries and positional queries. Please confirm if my understanding is correct on how to generate these queries when integrating your method into DAB-DETR. And even more, do I need to use DAB DETR with content and positional queries?

Here is my understanding:

I would appreciate your confirmation or any additional insights on this process. Thank you for your assistance.

Best regards, Aleksandr Gordeev

TempleX98 commented 1 month ago

Similar to Co-Deformable-DETR, the content queries are obtained via an MLP layer.