第一次推理时间慢，后面正常

wang-xinyu / tensorrtx

Implementation of popular deep learning networks with TensorRT network definition API

MIT License

6.89k stars 1.76k forks source link

第一次推理时间慢，后面正常 #1007

Closed hnothing2016 closed 2 years ago

hnothing2016 commented 2 years ago

Env

GPU, RTX1660
OS, Win10
Cuda version 11.1
TensorRT 8.2.1

About this repo

which branch/tag/commit are you using? 6.0
which model? yolov5x

Your problem

第一次推理时间要 531ms后面就快了，50ms左右，这个是正常情况吗？

微信截图_20220531140415

wang-xinyu commented 2 years ago

This is normal, GPU needs warmup.

stale[bot] commented 2 years ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.