TensorRT does not show any speed improvement ???

open-mmlab / mmdetection

OpenMMLab Detection Toolbox and Benchmark

https://mmdetection.readthedocs.io

Apache License 2.0

29.31k stars 9.42k forks source link

TensorRT does not show any speed improvement ??? #5658

Open chuong98 opened 3 years ago

chuong98 commented 3 years ago

Hello, I try to convert cascade_rcnn_r50 to tensorRT, and comparing the speed. However, I don;t see any improvement at all in term of speed, while the accuracy slightly drops ?

I use the deployment/test.py for TensorRT, and tools/test.py for Pytorch model, evaluated on COCO Val2017.

Pytorch: 5000/5000, 15.6 task/s, elapsed: 320s. mAP 40.3
TensorRT : 5000/5000, 15.8 task/s, elapsed: 316s. mAP: 40.1

RunningLeon commented 3 years ago

@chuong98 Hi, this feature is experimental and would be improved in the future.