open-mmlab / mmdetection

OpenMMLab Detection Toolbox and Benchmark
https://mmdetection.readthedocs.io
Apache License 2.0
28.52k stars 9.29k forks source link

Cannot reproduce rtmdet FPS #11682

Open mmeendez8 opened 2 months ago

mmeendez8 commented 2 months ago

Describe the bug I am not able to reproduce the inference speed of rtmdet network.

Reproduction

I have created a simple colab that can help to reproduce my findings. It is a very simple way of running the benchmarking script with different mmdet configs.

I have collected all code in this repo and this is the Colab notebook.

image

As you can see above rtmdet fps results show that is slower than DETR, Retinanet or FasterRCNN.