search

PaddlePaddle / FastDeploy

⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization, multi-platform and multi-framework support.
https://www.paddlepaddle.org.cn/fastdeploy
Apache License 2.0
2.83k stars 444 forks source link

FastDeploy with_capi 调用GpuInfer报错 #2220

Open zhengxiaoqing opened 9 months ago

zhengxiaoqing commented 9 months ago

在openeular20.03上将CAPI example编译成so，调用后报错

问题日志及出现问题的操作流程

2、把examples下的infer_demo编译成so共享库，另写一个main测试，也可正常运行 CMakeLists.txt PROJECT(infer_demo C) CMAKE_MINIMUM_REQUIRED (VERSION 3.10)

指定下载解压后的fastdeploy库路径

option(FASTDEPLOY_INSTALL_DIR "Path of downloaded fastdeploy sdk.")

include(${FASTDEPLOY_INSTALL_DIR}/FastDeploy.cmake)

添加FastDeploy依赖头文件

include_directories(${FASTDEPLOY_INCS}) include_directories(${PROJECT_SOURCE_DIR}) add_library(infer_demo SHARED ${PROJECT_SOURCE_DIR}/infer.c)

target_link_libraries(infer_demo ${FASTDEPLOY_LIBS})

Main.c

include "/root/FastDeploy/examples/vision/ocr/PP-OCR/cpu-gpu/c/infer.h"

int main() { const char det_model_dir1 = "/root/packet-box/config/models/ocr/det"; const char cls_model_dir1 = "/root/packet-box/config/models/ocr/cls"; const char rec_model_dir1 = "/root/packet-box/config/models/ocr/rec"; const char rec_label_file1 = "/root/packet-box/config/models/ocr/ppocr_keys_v1.txt"; const char *image1 = "/root/FastDeploy/examples/vision/ocr/PP-OCR/cpu-gpu/c/build/12.jpg"; GpuInfer(det_model_dir1, cls_model_dir1, rec_model_dir1, rec_label_file1, image1); return 0; } 结果正常 [INFO] fastdeploy/runtime/runtime.cc(266)::CreatePaddleBackend Runtime initialized with Backend::PDINFER in Device::GPU. [INFO] fastdeploy/runtime/runtime.cc(266)::CreatePaddleBackend Runtime initialized with Backend::PDINFER in Device::GPU. [INFO] fastdeploy/runtime/runtime.cc(266)::CreatePaddleBackend Runtime initialized with Backend::PDINFER in Device::GPU. det boxes: [[42,413],[483,391],[484,428],[43,450]]rec text: 上海斯格威铂尔大酒店 rec score:0.980085 cls label: 0 cls score: 1.000000 det boxes: [[187,456],[399,448],[400,480],[188,488]]rec text: 打浦路15号 rec score:0.964993 cls label: 0 cls score: 1.000000 det boxes: [[23,507],[513,488],[515,529],[24,548]]rec text: 绿洲仕格维花园公寓args)0 rec score:0.993726 cls label: 0 cls score: 1.000000 det boxes: [[74,553],[427,542],[428,571],[75,582]]rec text: 打浦路252935号 rec score:0.947723 cls label: 0 cls score: 1.000000 Visualized result saved in ./vis_result.jpg

3、在自己工程中调用上面的so共享库，报错 部分代码： int reuslt = is_image_file(img_dir); if (reuslt) { const char det_model_dir1 = "/root/packet-box/config/models/ocr/det"; const char cls_model_dir1 = "/root/packet-box/config/models/ocr/cls"; const char rec_model_dir1 = "/root/packet-box/config/models/ocr/rec"; const char rec_label_file1 = "/root/packet-box/config/models/ocr/ppocr_keys_v1.txt"; const char *image1 = "/root/FastDeploy/examples/vision/ocr/PP-OCR/cpu-gpu/c/build/12.jpg"; GpuInfer(det_model_dir1, cls_model_dir1, rec_model_dir1, rec_label_file1, image1); }

相关报错日志 terminate called after throwing an instance of 'phi::enforce::EnforceNotMet' what():

C++ Traceback (most recent call last):

0 cm_dpdk_actor_exec 1 GpuInfer 2 paddle_infer::CreatePredictor(paddle::AnalysisConfig const&) 3 paddle_infer::Predictor::Predictor(paddle::AnalysisConfig const&) 4 std::unique_ptr<paddle::PaddlePredictor, std::default_delete > paddle::CreatePaddlePredictor<paddle::AnalysisConfig, (paddle::PaddleEngineKind)2>(paddle::AnalysisConfig const&) 5 paddle::AnalysisConfig::fraction_of_gpu_memory_for_pool() const 6 phi::backends::gpu::SetDeviceId(int) 7 phi::backends::gpu::GetGPUDeviceCount() 8 phi::enforce::EnforceNotMet::EnforceNotMet(phi::ErrorSummary const&, char const*, int) 9 phi::enforce::GetCurrentTraceBackStringabi:cxx11

Error Message Summary:

ExternalError: CUDA error(2), out of memory. [Hint: Please search for the error code(2) on website (https://docs.nvidia.com/cuda/cuda-runtime-api/group__CUDART__TYPES.html#group__CUDART__TYPES_1g3f51e3575c2178246db0a94a430e0038) to get Nvidia's official solution and advice about CUDA Error.] (at /workspace/qiuyanjun/fastdeploy/Paddle/paddle/phi/backends/gpu/cuda/cuda_info.cc:65)

另外，使用CpuInfer也会报错 1 CpuInfer 2 paddle_infer::CreatePredictor(paddle::AnalysisConfig const&) 3 paddle_infer::Predictor::Predictor(paddle::AnalysisConfig const&) 4 std::unique_ptr<paddle::PaddlePredictor, std::default_delete > paddle::CreatePaddlePredictor<paddle::AnalysisConfig, (paddle::PaddleEngineKind)2>(paddle::AnalysisConfig const&) 5 paddle::AnalysisPredictor::Init(std::shared_ptr const&, std::shared_ptr const&) 6 paddle::AnalysisPredictor::PrepareProgram(std::shared_ptr const&) 7 paddle::AnalysisPredictor::OptimizeInferenceProgram() 8 paddle::inference::analysis::IrGraphBuildPass::RunImpl(paddle::inference::analysis::Argument) 9 paddle::inference::analysis::IrGraphBuildPass::LoadModel(std::string const&, std::string const&, paddle::framework::Scope, phi::Place const&, bool, bool) 10 paddle::inference::Load(paddle::framework::Executor, paddle::framework::Scope, std::string const&, std::string const&, bool) 11 paddle::inference::LoadPersistables(paddle::framework::Executor, paddle::framework::Scope, paddle::framework::ProgramDesc const&, std::string const&, std::string const&, bool) 12 paddle::framework::Executor::Run(paddle::framework::ProgramDesc const&, paddle::framework::Scope, int, bool, bool, std::vector<std::string, std::allocator > const&, bool, bool) 13 paddle::framework::Executor::RunPreparedContext(paddle::framework::ExecutorPrepareContext, paddle::framework::Scope, bool, bool, bool) 14 paddle::framework::Executor::RunPartialPreparedContext(paddle::framework::ExecutorPrepareContext, paddle::framework::Scope, long, long, bool, bool, bool) 15 paddle::framework::CPUGarbageCollector::CPUGarbageCollector(phi::CPUPlace const&, unsigned long) 16 paddle::framework::GarbageCollector::GarbageCollector(phi::Place const&, unsigned long) 17 phi::DeviceContextPool::Get(phi::Place const&) 18 std::__future_base::_Deferred_state<std::thread::_Invoker<std::tuple<std::unique_ptr<phi::DeviceContext, std::default_delete > ()(phi::Place const&, bool, int), phi::Place, bool, int> >, std::unique_ptr<phi::DeviceContext, std::default_delete > >::_M_complete_async() 19 std::_Function_handler<std::unique_ptr<std::__future_base::_Result_base, std::future_base::_Result_base::_Deleter> (), std::future_base::_Task_setter<std::unique_ptr<std::future_base::_Result<std::unique_ptr<phi::DeviceContext, std::default_delete > >, std::future_base::_Result_base::_Deleter>, std::thread::_Invoker<std::tuple<std::unique_ptr<phi::DeviceContext, std::default_delete > ()(phi::Place const&, bool, int), phi::Place, bool, int> >, std::unique_ptr<phi::DeviceContext, std::default_delete > > >::_M_invoke(std::_Any_data const&) 20 std::unique_ptr<phi::DeviceContext, std::default_delete > paddle::platform::CreateDeviceContext(phi::Place const&, bool, int) 21 paddle::memory::allocation::AllocatorFacade::Instance() 22 paddle::memory::allocation::AllocatorFacade::AllocatorFacade() 23 paddle::memory::allocation::AllocatorFacadePrivate::AllocatorFacadePrivate(bool) 24 phi::backends::gpu::GetGPUDeviceCount() 25 phi::enforce::EnforceNotMet::EnforceNotMet(phi::ErrorSummary const&, char const, int) 26 phi::enforce::GetCurrentTraceBackStringabi:cxx11

Error Message Summary:

ExternalError: CUDA error(2), out of memory. [Hint: Please search for the error code(2) on website (https://docs.nvidia.com/cuda/cuda-runtime-api/group__CUDART__TYPES.html#group__CUDART__TYPES_1g3f51e3575c2178246db0a94a430e0038) to get Nvidia's official solution and advice about CUDA Error.] (at /workspace/qiuyanjun/fastdeploy/Paddle/paddle/phi/backends/gpu/cuda/cuda_info.cc:65) 4、不带GPU编译时，CpuInfer是好使的

rainyfly commented 5 months ago

这个报错是out of memory，显存不足