lyuwenyu / RT-DETR

[CVPR 2024] Official RT-DETR (RTDETR paddle pytorch), Real-Time DEtection TRansformer, DETRs Beat YOLOs on Real-time Object Detection. 🔥 🔥 🔥
Apache License 2.0
2.54k stars 294 forks source link

where is Uncertainty minimal query selection? #331

Open zhangchbin opened 5 months ago

zhangchbin commented 5 months ago

Thanks to the authors' work. I can not find the uncertainty minimal query selection module in the pytorch code. It uses a classification score to select tokens, as shown in https://github.com/lyuwenyu/RT-DETR/blob/main/rtdetr_pytorch/src/zoo/rtdetr/rtdetr_decoder.py#L488C1-L489C1

GluttonK commented 5 months ago

I have the same confusion. In this code, the selection criteria for the first (num_queries=300) objects seem to be just classification scores, rather than combining classification and localization as the author said.

1999zsh commented 2 months ago

hello, do you find the related code?

SebastianJanampa commented 1 month ago

Hi, I think it is this part https://github.com/lyuwenyu/RT-DETR/blob/14971513a5ef805edaf434af1a11403d2f1a9036/rtdetr_pytorch/src/zoo/rtdetr/rtdetr_criterion.py#L111. The authors mentioned they used it for the classification loss