search

tjuskyzhang / Scaled-YOLOv4-TensorRT

Got 100fps on TX2. Got 500fps on GeForce GTX 1660 Ti. If the project is useful to you, please Star it.
179 stars 41 forks source link

Inference speed question #15

Open kiniavinash opened 3 years ago

kiniavinash commented 3 years ago

In the README.md, it is mentioned that the inference speed on TX2 is around 10-11ms. Is this speed measured around the function doInference here: https://github.com/tjuskyzhang/yolov4-tiny-tensorrt/blob/bc49483e49e4de698fd88b878799b8b0a979e88f/yolov4-tiny.cpp#L496.

Or around context.enqueue line here: https://github.com/tjuskyzhang/yolov4-tiny-tensorrt/blob/bc49483e49e4de698fd88b878799b8b0a979e88f/yolov4-tiny.cpp#L392

Thank you for sharing this project.

tjuskyzhang commented 3 years ago

In the README.md, it is mentioned that the inference speed on TX2 is around 10-11ms. Is this speed measured around the function doInference here: https://github.com/tjuskyzhang/yolov4-tiny-tensorrt/blob/bc49483e49e4de698fd88b878799b8b0a979e88f/yolov4-tiny.cpp#L496.

Or around context.enqueue line here: https://github.com/tjuskyzhang/yolov4-tiny-tensorrt/blob/bc49483e49e4de698fd88b878799b8b0a979e88f/yolov4-tiny.cpp#L392

Thank you for sharing this project.

The first one, #L496