isarsoft / yolov4-triton-tensorrt

This repository deploys YOLOv4 as an optimized TensorRT engine to Triton Inference Server
http://www.isarsoft.com
Other
276 stars 63 forks source link

where is test time? #61

Closed wxr521314 closed 2 years ago

wxr521314 commented 2 years ago

Hi: I would like to ask, what is the time of 200ms and 3.00185s?

image

My results are as follows: which is the inference time of the test?

image

philipp-schmidt commented 2 years ago

The times that you highlighted are not very important. The values under "performance summary" matter. You get a throughput of 2.8 inferences per second. For all the other metrics you can call the verbose logs for explanations, exactly as the screenshot says ;)