PaddlePaddle / PaddleDetection

Object Detection toolkit based on PaddlePaddle. It supports object detection, instance segmentation, multiple object tracking and real-time multi-person keypoint detection.
Apache License 2.0
12.86k stars 2.9k forks source link

RuntimeError: (NotFound) Operator (preln_residual_bias) is not registered. #8007

Closed matakk closed 1 year ago

matakk commented 1 year ago

问题确认 Search before asking

Bug组件 Bug Component

Inference

Bug描述 Describe the Bug

paddledetection pipeline 推理: 使用paddle模式推理,是可以的,入下图 image

改用tensorrt: image

fp32 fp16 int8都是这个错误. 我搜索也没有相关的说明. 请问如何调试啊?

复现环境 Environment

环境: Windows 10,miniconda,python 3.10 gpu:p40单颗 cuda环境版本: cuda_10.2.89_441.22_win10.exe cudnn-10.2-windows10-x64-v7.6.5.32.zip TensorRT-7.0.0.11.Windows10.x86_64.cuda-10.2.cudnn7.6.zip

Bug描述确认 Bug description confirmation

是否愿意提交PR? Are you willing to submit a PR?

matakk commented 1 year ago

仔细看了文档: 重新部署环境,安装的官方的这个文件 paddlepaddle_gpu-2.3.2-cp38-cp38-win_amd64.whl 可以推理, 需要调整 trt shape的参数.部分图像可以推理.

参考: https://github.com/PaddlePaddle/PaddleDetection/blob/05ab413e2b5406416733ca1674e954fc80638fed/deploy/TENSOR_RT.md