rmccorm4 / tensorrt-utils

⚡ Useful scripts when using TensorRT
Apache License 2.0
237 stars 55 forks source link

How to do inference with the saved int8 trt engine file? #30

Open xiongjun19 opened 3 years ago

xiongjun19 commented 3 years ago

I'm wondering how to do inference with the saved int8 trt engine file. Dose the process of inference is just the same as normal.