open-mmlab / mmdeploy

OpenMMLab Model Deployment Framework
https://mmdeploy.readthedocs.io/en/latest/
Apache License 2.0
2.69k stars 617 forks source link

在RK3588上用MMDeploy部署MMPose的RTMPose模型 #2576

Open JokerCai opened 9 months ago

JokerCai commented 9 months ago

Checklist

Describe the bug

在Host上交叉编译MMDeploy,并推到RK3588上,调用以下命令时报错: ./bin/pose_detection cpu ../rtmpose-l_pre_train-int8_rknn/ ../basketball_test_18.jpeg

Reproduction

(base) embed@Embed:~$ cd install (base) embed@Embed:~/install$ export LD_LIBRARY_PATH=$(pwd)/lib:${LD_LIBRARY_PATH} (base) embed@Embed:~/install$ ./bin/pose_detection cpu ../rtmpose-l_pre_train-int8_rknn/ ../basketball_test_18.jpeg [2023-11-29 09:17:46.771] [mmdeploy] [info] [model.cpp:35] [DirectoryModel] Load model: "../rtmpose-l_pre_train-int8_rknn/" [2023-11-29 09:17:46.837] [mmdeploy] [info] [rknn_net.cpp:105] input tensors: [2023-11-29 09:17:46.837] [mmdeploy] [info] [rknn_net.cpp:107] - index=0, name=input, type=INT8, n_dims=4, dims=[1, 256, 192, 3], n_elems=147456, size=147456, fmt=NHWC, qnt_type=AFFINE, zp=-14, scale=0.018658448 [2023-11-29 09:17:46.837] [mmdeploy] [info] [rknn_net.cpp:105] output tensors: [2023-11-29 09:17:46.837] [mmdeploy] [info] [rknn_net.cpp:107] - index=0, name=output, type=INT8, n_dims=4, dims=[1, 133, 384, 1], n_elems=51072, size=51072, fmt=NCHW, qnt_type=AFFINE, zp=-15, scale=0.0052240603 [2023-11-29 09:17:46.837] [mmdeploy] [info] [rknn_net.cpp:107] - index=1, name=874, type=INT8, n_dims=4, dims=[1, 133, 512, 1], n_elems=68096, size=68096, fmt=NCHW, qnt_type=AFFINE, zp=-43, scale=0.0052813073 [2023-11-29 09:17:46.860] [mmdeploy] [error] [module_adapter.h:31] unhandled exception: invalid argument (1) @ /home/legymsport/mmdeploy/csrc/mmdeploy/core/value.h:436 terminate called after throwing an instance of 'system_error2::status_error<mmdeploy::StatusDomain>' what(): unknown (6) @ /home/legymsport/mmdeploy/csrc/mmdeploy/experimental/module_adapter.h:32 Aborted (core dumped) (base) embed@Embed:~/install$

Environment

11/29 17:54:04 - mmengine - INFO - 

11/29 17:54:04 - mmengine - INFO - **********Environmental information**********
11/29 17:54:04 - mmengine - INFO - sys.platform: linux
11/29 17:54:04 - mmengine - INFO - Python: 3.8.18 (default, Sep 11 2023, 13:40:15) [GCC 11.2.0]
11/29 17:54:04 - mmengine - INFO - CUDA available: False
11/29 17:54:04 - mmengine - INFO - numpy_random_seed: 2147483648
11/29 17:54:04 - mmengine - INFO - GCC: gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0
11/29 17:54:04 - mmengine - INFO - PyTorch: 1.8.1
11/29 17:54:04 - mmengine - INFO - PyTorch compiling details: PyTorch built with:
  - GCC 7.3
  - C++ Version: 201402
  - Intel(R) oneAPI Math Kernel Library Version 2023.1-Product Build 20230303 for Intel(R) 64 architecture applications
  - Intel(R) MKL-DNN v1.7.0 (Git Hash 7aed236906b1f7a05c0917e5257a1af05e9ff683)
  - OpenMP 201511 (a.k.a. OpenMP 4.5)
  - NNPACK is enabled
  - CPU capability usage: AVX2
  - Build settings: BLAS_INFO=mkl, BUILD_TYPE=Release, CXX_COMPILER=/opt/rh/devtoolset-7/root/usr/bin/c++, CXX_FLAGS= -Wno-deprecated -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -fopenmp -DNDEBUG -DUSE_FBGEMM -DUSE_QNNPACK -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -O2 -fPIC -Wno-narrowing -Wall -Wextra -Werror=return-type -Wno-missing-field-initializers -Wno-type-limits -Wno-array-bounds -Wno-unknown-pragmas -Wno-sign-compare -Wno-unused-parameter -Wno-unused-variable -Wno-unused-function -Wno-unused-result -Wno-unused-local-typedefs -Wno-strict-overflow -Wno-strict-aliasing -Wno-error=deprecated-declarations -Wno-stringop-overflow -Wno-psabi -Wno-error=pedantic -Wno-error=redundant-decls -Wno-error=old-style-cast -fdiagnostics-color=always -faligned-new -Wno-unused-but-set-variable -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Wno-stringop-overflow, LAPACK_INFO=mkl, PERF_WITH_AVX=1, PERF_WITH_AVX2=1, PERF_WITH_AVX512=1, TORCH_VERSION=1.8.1, USE_CUDA=0, USE_CUDNN=OFF, USE_EXCEPTION_PTR=1, USE_GFLAGS=OFF, USE_GLOG=OFF, USE_MKL=ON, USE_MKLDNN=ON, USE_MPI=OFF, USE_NCCL=OFF, USE_NNPACK=ON, USE_OPENMP=ON, 

11/29 17:54:04 - mmengine - INFO - TorchVision: 0.9.1
11/29 17:54:04 - mmengine - INFO - OpenCV: 4.8.1
11/29 17:54:04 - mmengine - INFO - MMEngine: 0.10.1
11/29 17:54:04 - mmengine - INFO - MMCV: 2.0.1
11/29 17:54:04 - mmengine - INFO - MMCV Compiler: GCC 7.3
11/29 17:54:04 - mmengine - INFO - MMCV CUDA Compiler: not available
11/29 17:54:04 - mmengine - INFO - MMDeploy: 1.3.0+8b19586
11/29 17:54:04 - mmengine - INFO - 

11/29 17:54:04 - mmengine - INFO - **********Backend information**********
11/29 17:54:04 - mmengine - INFO - tensorrt:    None
11/29 17:54:04 - mmengine - INFO - ONNXRuntime: 1.11.0
11/29 17:54:04 - mmengine - INFO - ONNXRuntime-gpu: None
11/29 17:54:04 - mmengine - INFO - ONNXRuntime custom ops:  Available
11/29 17:54:04 - mmengine - INFO - pplnn:   None
11/29 17:54:04 - mmengine - INFO - ncnn:    None
11/29 17:54:04 - mmengine - INFO - snpe:    None
11/29 17:54:04 - mmengine - INFO - openvino:    None
11/29 17:54:04 - mmengine - INFO - torchscript: 1.8.1
11/29 17:54:04 - mmengine - INFO - torchscript custom ops:  NotAvailable
11/29 17:54:04 - mmengine - INFO - rknn-toolkit:    None
11/29 17:54:04 - mmengine - INFO - rknn-toolkit2:   1.5.2+b642f30c
11/29 17:54:04 - mmengine - INFO - ascend:  None
11/29 17:54:04 - mmengine - INFO - coreml:  None
11/29 17:54:04 - mmengine - INFO - tvm: None
11/29 17:54:04 - mmengine - INFO - vacc:    None
11/29 17:54:04 - mmengine - INFO - 

11/29 17:54:04 - mmengine - INFO - **********Codebase information**********
11/29 17:54:05 - mmengine - INFO - mmdet:   3.2.0
11/29 17:54:05 - mmengine - INFO - mmseg:   None
11/29 17:54:05 - mmengine - INFO - mmpretrain:  1.1.1
11/29 17:54:05 - mmengine - INFO - mmocr:   None
11/29 17:54:05 - mmengine - INFO - mmagic:  None
11/29 17:54:05 - mmengine - INFO - mmdet3d: None
11/29 17:54:05 - mmengine - INFO - mmpose:  1.2.0
11/29 17:54:05 - mmengine - INFO - mmrotate:    None
11/29 17:54:05 - mmengine - INFO - mmaction:    None
11/29 17:54:05 - mmengine - INFO - mmrazor: None
11/29 17:54:05 - mmengine - INFO - mmyolo:  0.6.0

Error traceback

No response

lsm140 commented 3 months ago

大佬 你有解决吗