Jetson Xavier NX上无法实现trt_int8推理

PaddlePaddle / PaddleDetection

Object Detection toolkit based on PaddlePaddle. It supports object detection, instance segmentation, multiple object tracking and real-time multi-person keypoint detection.

Apache License 2.0

12.56k stars 2.86k forks source link

Jetson Xavier NX上无法实现trt_int8推理 #8819

Open bbilixzc opened 6 months ago

bbilixzc commented 6 months ago

问题确认 Search before asking

[X] 我已经搜索过问题，但是没有找到解答。I have searched the question and found no related answer.

请提出你的问题 Please ask your question

在Jetson Xavier NX上使用Paddle Inference部署PaddleSlim量化的PPYOLOE模型： 1708271463198 但是推理时的输出信息表示int8的推理没有实现，实际速度也没有获得提升： 1708271680760

请问如何才能正确的使用Paddle Inference部署int8量化模型？

lyuwenyu commented 6 months ago

参考这里的文档 https://github.com/PaddlePaddle/PaddleDetection/tree/release/2.7/deploy/python

配置参数 --run_mode