inference time - Githubissues

enazoe / yolo-tensorrt

TensorRT8.Support Yolov5n,s,m,l,x .darknet -> tensorrt. Yolov4 Yolov3 use raw darknet *.weights and *.cfg fils. If the wrapper is useful to you,please Star it.

MIT License

1.19k stars 315 forks source link

inference time #93

Open alicera opened 3 years ago

alicera commented 3 years ago

The speed of FP16 is close to the speed of INT8.

FP16 pre elasped time:5.43204ms inference elasped time:352.434ms post elasped time:0.118294ms detect elasped time:358.042ms

INT8 pre elasped time:18.3601ms inference elasped time:355.024ms post elasped time:0.117736ms detect elasped time:373.58ms