search

CaoWGG / TensorRT-CenterNet

tensorrt5 , centernet , centerface, deform conv, int8
767 stars 159 forks source link

infer time seems not as good as expected #59

Closed vesor closed 4 years ago

vesor commented 4 years ago

Hi, I am testing on Jetson Xavier with Jetpack 4.2 (TensorRT 5.1, cuda 10.0) pytorch version 1.4, torchvision 0.5

The infer time seems not as good as expected.

****CenterNet ctdet_coco_dla_1x pytorch : 125ms tensorrt : ~103ms tensorrt fp16: ~80ms

Any idea whats wrong?

Thanks

vesor commented 4 years ago

According to author, ctdet_coco_dla_1x is "dla34", not "dla34v0".

Here is the updated test results: (All tests include a 10 times run as warm up, then run 100 times to get average total time. (not net time))

****CenterNet ctdet_coco_dla_1x pytorch : Jetson Xavier: 193ms Gtx1070 notebook: 44ms tensorrt : Jetson Xavier: 103ms Gtx1070 notebook: 28ms tensorrt fp16: Jetson Xavier: 80ms

****CenterNet ctdet_coco_dlav0_1x pytorch : Jetson Xavier: 139ms Gtx1070 notebook: 31ms tensorrt : Jetson Xavier: 61ms Gtx1070 notebook: 18ms tensorrt fp16: Jetson Xavier: 32ms