cyrusbehr / YOLOv8-TensorRT-CPP

YOLOv8 TensorRT C++ Implementation
MIT License
568 stars 70 forks source link

Untrusted benchmark test?? #34

Closed vvxt closed 7 months ago

vvxt commented 1 year ago

2000 iterations fast, but 100000 times, very, very slow. why??

2000 iterations Avg time: 4.8025 ms,Avg FPS:208 fps. 100000 iterations More than 5 minutes outputting results, still working...

start... Avg Preprocess time: 0.42 ms Avg Inference time: 1.447 ms Avg Postprocess time: 2.915 ms

Avg Preprocess time: 0.42 ms Avg Inference time: 1.447 ms Avg Postprocess time: 2.915 ms

Avg Preprocess time: 0.419 ms Avg Inference time: 1.447 ms Avg Postprocess time: 2.914 ms

... After 1 minute...

Avg Preprocess time: 1.18 ms Avg Inference time: 4.677 ms Avg Postprocess time: 3.895 ms

Avg Preprocess time: 1.18 ms Avg Inference time: 4.677 ms Avg Postprocess time: 3.895 ms

Avg Preprocess time: 1.18 ms Avg Inference time: 4.677 ms Avg Postprocess time: 3.895 ms

... After 3 minutes ...

Avg Preprocess time: 1.245 ms Avg Inference time: 4.911 ms Avg Postprocess time: 3.894 ms

Avg Preprocess time: 1.245 ms Avg Inference time: 4.911 ms Avg Postprocess time: 3.894 ms

Avg Preprocess time: 1.245 ms Avg Inference time: 4.911 ms Avg Postprocess time: 3.894 ms


Why is it getting slower and slower??

cyrusbehr commented 7 months ago

Was not able to reproduce