TensorRT-YOLOv4
demo
Performance
| model | input_size | GPU | mode | inference Time |
|---|---|---|---|---|
| yolov4 | 608x608 | gtx 1080Ti | float32 | 23.3 ms |
| yolov4 | 416x416 | gtx 1080Ti | float32 | 13.0 ms |
| yolov3 | 608x608 | gtx 1080Ti | float32 | 18.2 ms |
| yolov3 | 416x416 | gtx 1080Ti | float32 | 10.0 ms |
| yolov3-tiny | 608x608 | gtx 1080Ti | float32 | 3.31 ms |
| yolov3-tiny | 416x416 | gtx 1080Ti | float32 | 2.01 ms |
| yolov3-tiny-prn | 608x608 | gtx 1080Ti | float32 | 3.05 ms |
| yolov3-tiny-prn | 416x416 | gtx 1080Ti | float32 | 2.01 ms |
- Including pre-processing and post-processing time.
Enviroments
- gtx 1080Ti
ubuntu 1604 TensorRT 5.0 cuda 9.0 python3 onnx=1.4.1
Models
- Add (infer_thresh) and (down_stride) to your .cfg.
[yolo] ## small anchor mask = 0,1,2 anchors = ... down_stride = 8 infer_thresh = 0.5 ... [yolo] ## mid anchor mask = 3,4,5 anchors = ... down_stride = 16 infer_thresh = 0.5 ... [yolo] ## big anchor mask = 6,7,8 anchors = ..... down_stride = 32 infer_thresh = 0.5 - Convert darknet yolo to onnx.
python3 tools/yolo_to_onnx.py --cfg model/yolov4.cfg --weights model/yolov4.weights --out model/yolov4.onnx
Example
git clone https://github.com/CaoWGG/TensorRT-YOLOv4.git
cd TensorRT-YOLOv4
mkdir build
cd build && cmake .. && make
cd ..
## yolov3
./buildEngine -i model/yolov3.onnx -o model/yolov3.engine -b 1 -m 0
./runDet -i model/yolov3.engine -p dog.jpg -v nuscenes_mini.mp4
## yolov4
./buildEngine -i model/yolov4.onnx -o model/yolov4.engine -b 1 -m 0
./runDet -i model/yolov4.engine -p dog.jpg -v nuscenes_mini.mp4