⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization, multi-platform and multi-framework support.
(base) amax@amax:~/HUAWEI/FastDeploy$ mkdir build && cd build
(base) root@amax:/home/amax/HUAWEI/FastDeploy/build# cmake .. -DCMAKE_C_COMPILER=/opt/gcc-linaro-6.3.1-2017.05-x86_64_aarch64-linux-gnu/bin/aarch64-linux-gnu-gcc -DCMAKE_CXX_COMPILER=/opt/gcc-linaro-6.3.1-2017.05-x86_64_aarch64-linux-gnu/bin/aarch64-linux-gnu-g++ -DCMAKE_TOOLCHAIN_FILE=./../cmake/toolchain.cmake -DTARGET_ABI=arm64 -DWITH_ASCEND=ON -DENABLE_VISION=ON -DENABLE_LITE_BACKEND=ON -DCMAKE_INSTALL_PREFIX=fastdeploy-ascend
-- The C compiler identification is GNU 6.3.1
-- The CXX compiler identification is GNU 6.3.1
-- Check for working C compiler: /opt/gcc-linaro-6.3.1-2017.05-x86_64_aarch64-linux-gnu/bin/aarch64-linux-gnu-gcc
-- Check for working C compiler: /opt/gcc-linaro-6.3.1-2017.05-x86_64_aarch64-linux-gnu/bin/aarch64-linux-gnu-gcc -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
-- Check for working CXX compiler: /opt/gcc-linaro-6.3.1-2017.05-x86_64_aarch64-linux-gnu/bin/aarch64-linux-gnu-g++
-- Check for working CXX compiler: /opt/gcc-linaro-6.3.1-2017.05-x86_64_aarch64-linux-gnu/bin/aarch64-linux-gnu-g++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
Downloading file from https://bj.bcebos.com/fastdeploy/third_libs/patchelf-0.15.0-x86_64.tar.gz to /home/amax/HUAWEI/FastDeploy/build/patchelf-0.15.0-x86_64.tar.gz ...
-- [download 1% complete]
-- [download 6% complete]
-- [download 11% complete]
-- [download 17% complete]
-- [download 22% complete]
-- [download 27% complete]
-- [download 32% complete]
-- [download 37% complete]
-- [download 43% complete]
-- [download 48% complete]
-- [download 53% complete]
-- [download 58% complete]
-- [download 64% complete]
-- [download 69% complete]
-- [download 74% complete]
......
......
......
Decompress file /home/amax/HUAWEI/FastDeploy/build/opencv-linux-aarch64-4.6.0.tgz ...
-- Found OpenCV: /home/amax/HUAWEI/FastDeploy/build/third_libs/install/opencv (found version "4.6.0")
--
-- *****FastDeploy Building Summary**
-- CMake version : 3.16.3
-- CMake command : /usr/bin/cmake
-- System : Linux
-- C++ compiler : /opt/gcc-linaro-6.3.1-2017.05-x86_64_aarch64-linux-gnu/bin/aarch64-linux-gnu-g++
-- C++ compiler version : 6.3.1
-- CXX flags : -Wno-format -g0 -O3
-- EXE linker flags :
-- Shared linker flags :
-- Build type : MinSizeRel
-- Compile definitions : _GLIBCXX_USE_CXX11_ABI=1;FASTDEPLOY_LIB;CMAKE_BUILD_TYPE=Release;ENABLE_LITE_BACKEND;ENABLE_VISION
-- CMAKE_PREFIX_PATH :
-- CMAKE_INSTALL_PREFIX : /home/amax/HUAWEI/FastDeploy/build/fastdeploy-ascend
-- CMAKE_MODULE_PATH :
--
-- FastDeploy version : 1.0.6
-- ENABLE_ORT_BACKEND : OFF
-- ENABLE_RKNPU2_BACKEND : OFF
-- ENABLE_SOPHGO_BACKEND : OFF
-- ENABLE_PADDLE_BACKEND : OFF
-- ENABLE_LITE_BACKEND : ON
-- ENABLE_POROS_BACKEND : OFF
-- ENABLE_TRT_BACKEND : OFF
-- ENABLE_OPENVINO_BACKEND : OFF
-- ENABLE_BENCHMARK : OFF
-- ENABLE_VISION : ON
-- ENABLE_TEXT : OFF
-- ENABLE_ENCRYPTION : OFF
-- ENABLE_FLYCV : OFF
-- ENABLE_CVCUDA : OFF
-- WITH_GPU : OFF
-- WITH_IPU : OFF
-- WITH_TESTING : OFF
-- WITH_ASCEND : ON
-- WITH_DIRECTML : OFF
-- WITH_TIMVX : OFF
-- WITH_KUNLUNXIN : OFF
-- WITH_CAPI : OFF
-- WITH_CSHARPAPI : OFF
-- Configuring done
-- Generating done
CMake Warning:
Manually-specified variables were not used by the project:
CMAKE_TOOLCHAIN_FILE
-- Build files have been written to: /home/amax/HUAWEI/FastDeploy/build
(base) root@amax:/home/amax/HUAWEI/FastDeploy/build# make -j8
Scanning dependencies of target extern_paddlelite
Scanning dependencies of target yaml-cpp
[ 1%] Creating directories for 'extern_paddlelite'
[ 1%] Building CXX object third_party/yaml-cpp/CMakeFiles/yaml-cpp.dir/src/contrib/graphbuilder.cpp.o
[ 2%] Building CXX object third_party/yaml-cpp/CMakeFiles/yaml-cpp.dir/src/contrib/graphbuilderadapter.cpp.o
[ 2%] Building CXX object third_party/yaml-cpp/CMakeFiles/yaml-cpp.dir/src/binary.cpp.o
[ 2%] Building CXX object third_party/yaml-cpp/CMakeFiles/yaml-cpp.dir/src/convert.cpp.o
[ 3%] Building CXX object third_party/yaml-cpp/CMakeFiles/yaml-cpp.dir/src/depthguard.cpp.o
[ 4%] Building CXX object third_party/yaml-cpp/CMakeFiles/yaml-cpp.dir/src/emit.cpp.o
[ 4%] Building CXX object third_party/yaml-cpp/CMakeFiles/yaml-cpp.dir/src/directives.cpp.o
......
......
......
......
[100%] Linking CXX shared library libfastdeploy.so
[100%] Built target fastdeploy
(base) root@amax:/home/amax/HUAWEI/FastDeploy/build# make install
[ 14%] Built target yaml-cpp
[ 17%] Built target extern_paddlelite
[ 97%] Built target fastdeploy
[ 98%] Built target yaml-cpp-read
[ 99%] Built target yaml-cpp-parse
[100%] Built target yaml-cpp-sandbox
Install the project...
-- Install configuration: "MinSizeRel"
-- Installing: /home/amax/HUAWEI/FastDeploy/build/fastdeploy-ascend/lib/libfastdeploy.so.1.0.6
-- Set runtime path of "/home/amax/HUAWEI/FastDeploy/build/fastdeploy-ascend/lib/libfastdeploy.so.1.0.6" to ""
-- Installing: /home/amax/HUAWEI/FastDeploy/build/fastdeploy-ascend/lib/libfastdeploy.so
-- Installing: /home/amax/HUAWEI/FastDeploy/build/fastdeploy-ascend/include/fastdeploy
-- Installing: /home/amax/HUAWEI/FastDeploy/build/fastdeploy-ascend/include/fastdeploy/runtime
............
环境
问题日志及出现问题的操作流程
examples
下的PPOCR和yolov5部署示例,无法运行,会出现“Check failed: !nodes_.count(id): duplicate Node 'elementwise_mul_0'”报错,具体运行日志如下所示:(base) amax@amax:~/HUAWEI/FastDeploy$ mkdir build && cd build (base) root@amax:/home/amax/HUAWEI/FastDeploy/build# cmake .. -DCMAKE_C_COMPILER=/opt/gcc-linaro-6.3.1-2017.05-x86_64_aarch64-linux-gnu/bin/aarch64-linux-gnu-gcc -DCMAKE_CXX_COMPILER=/opt/gcc-linaro-6.3.1-2017.05-x86_64_aarch64-linux-gnu/bin/aarch64-linux-gnu-g++ -DCMAKE_TOOLCHAIN_FILE=./../cmake/toolchain.cmake -DTARGET_ABI=arm64 -DWITH_ASCEND=ON -DENABLE_VISION=ON -DENABLE_LITE_BACKEND=ON -DCMAKE_INSTALL_PREFIX=fastdeploy-ascend -- The C compiler identification is GNU 6.3.1 -- The CXX compiler identification is GNU 6.3.1 -- Check for working C compiler: /opt/gcc-linaro-6.3.1-2017.05-x86_64_aarch64-linux-gnu/bin/aarch64-linux-gnu-gcc -- Check for working C compiler: /opt/gcc-linaro-6.3.1-2017.05-x86_64_aarch64-linux-gnu/bin/aarch64-linux-gnu-gcc -- works -- Detecting C compiler ABI info -- Detecting C compiler ABI info - done -- Detecting C compile features -- Detecting C compile features - done -- Check for working CXX compiler: /opt/gcc-linaro-6.3.1-2017.05-x86_64_aarch64-linux-gnu/bin/aarch64-linux-gnu-g++ -- Check for working CXX compiler: /opt/gcc-linaro-6.3.1-2017.05-x86_64_aarch64-linux-gnu/bin/aarch64-linux-gnu-g++ -- works -- Detecting CXX compiler ABI info -- Detecting CXX compiler ABI info - done -- Detecting CXX compile features -- Detecting CXX compile features - done Downloading file from https://bj.bcebos.com/fastdeploy/third_libs/patchelf-0.15.0-x86_64.tar.gz to /home/amax/HUAWEI/FastDeploy/build/patchelf-0.15.0-x86_64.tar.gz ... -- [download 1% complete] -- [download 6% complete] -- [download 11% complete] -- [download 17% complete] -- [download 22% complete] -- [download 27% complete] -- [download 32% complete] -- [download 37% complete] -- [download 43% complete] -- [download 48% complete] -- [download 53% complete] -- [download 58% complete] -- [download 64% complete] -- [download 69% complete] -- [download 74% complete] ...... ...... ...... Decompress file /home/amax/HUAWEI/FastDeploy/build/opencv-linux-aarch64-4.6.0.tgz ... -- Found OpenCV: /home/amax/HUAWEI/FastDeploy/build/third_libs/install/opencv (found version "4.6.0") -- -- *****FastDeploy Building Summary** -- CMake version : 3.16.3 -- CMake command : /usr/bin/cmake -- System : Linux -- C++ compiler : /opt/gcc-linaro-6.3.1-2017.05-x86_64_aarch64-linux-gnu/bin/aarch64-linux-gnu-g++ -- C++ compiler version : 6.3.1 -- CXX flags : -Wno-format -g0 -O3 -- EXE linker flags : -- Shared linker flags : -- Build type : MinSizeRel -- Compile definitions : _GLIBCXX_USE_CXX11_ABI=1;FASTDEPLOY_LIB;CMAKE_BUILD_TYPE=Release;ENABLE_LITE_BACKEND;ENABLE_VISION -- CMAKE_PREFIX_PATH : -- CMAKE_INSTALL_PREFIX : /home/amax/HUAWEI/FastDeploy/build/fastdeploy-ascend -- CMAKE_MODULE_PATH : -- -- FastDeploy version : 1.0.6 -- ENABLE_ORT_BACKEND : OFF -- ENABLE_RKNPU2_BACKEND : OFF -- ENABLE_SOPHGO_BACKEND : OFF -- ENABLE_PADDLE_BACKEND : OFF -- ENABLE_LITE_BACKEND : ON -- ENABLE_POROS_BACKEND : OFF -- ENABLE_TRT_BACKEND : OFF -- ENABLE_OPENVINO_BACKEND : OFF -- ENABLE_BENCHMARK : OFF -- ENABLE_VISION : ON -- ENABLE_TEXT : OFF -- ENABLE_ENCRYPTION : OFF -- ENABLE_FLYCV : OFF -- ENABLE_CVCUDA : OFF -- WITH_GPU : OFF -- WITH_IPU : OFF -- WITH_TESTING : OFF -- WITH_ASCEND : ON -- WITH_DIRECTML : OFF -- WITH_TIMVX : OFF -- WITH_KUNLUNXIN : OFF -- WITH_CAPI : OFF -- WITH_CSHARPAPI : OFF -- Configuring done -- Generating done CMake Warning: Manually-specified variables were not used by the project:
-- Build files have been written to: /home/amax/HUAWEI/FastDeploy/build (base) root@amax:/home/amax/HUAWEI/FastDeploy/build# make -j8 Scanning dependencies of target extern_paddlelite Scanning dependencies of target yaml-cpp [ 1%] Creating directories for 'extern_paddlelite' [ 1%] Building CXX object third_party/yaml-cpp/CMakeFiles/yaml-cpp.dir/src/contrib/graphbuilder.cpp.o [ 2%] Building CXX object third_party/yaml-cpp/CMakeFiles/yaml-cpp.dir/src/contrib/graphbuilderadapter.cpp.o [ 2%] Building CXX object third_party/yaml-cpp/CMakeFiles/yaml-cpp.dir/src/binary.cpp.o [ 2%] Building CXX object third_party/yaml-cpp/CMakeFiles/yaml-cpp.dir/src/convert.cpp.o [ 3%] Building CXX object third_party/yaml-cpp/CMakeFiles/yaml-cpp.dir/src/depthguard.cpp.o [ 4%] Building CXX object third_party/yaml-cpp/CMakeFiles/yaml-cpp.dir/src/emit.cpp.o [ 4%] Building CXX object third_party/yaml-cpp/CMakeFiles/yaml-cpp.dir/src/directives.cpp.o ...... ...... ...... ...... [100%] Linking CXX shared library libfastdeploy.so [100%] Built target fastdeploy (base) root@amax:/home/amax/HUAWEI/FastDeploy/build# make install [ 14%] Built target yaml-cpp [ 17%] Built target extern_paddlelite [ 97%] Built target fastdeploy [ 98%] Built target yaml-cpp-read [ 99%] Built target yaml-cpp-parse [100%] Built target yaml-cpp-sandbox Install the project... -- Install configuration: "MinSizeRel" -- Installing: /home/amax/HUAWEI/FastDeploy/build/fastdeploy-ascend/lib/libfastdeploy.so.1.0.6 -- Set runtime path of "/home/amax/HUAWEI/FastDeploy/build/fastdeploy-ascend/lib/libfastdeploy.so.1.0.6" to "" -- Installing: /home/amax/HUAWEI/FastDeploy/build/fastdeploy-ascend/lib/libfastdeploy.so -- Installing: /home/amax/HUAWEI/FastDeploy/build/fastdeploy-ascend/include/fastdeploy -- Installing: /home/amax/HUAWEI/FastDeploy/build/fastdeploy-ascend/include/fastdeploy/runtime ............
....... ...... ...... -- Installing: /home/amax/HUAWEI/FastDeploy/build/fastdeploy-ascend/third_libs/install/paddlelite/include/paddle_image_preprocess.h -- Installing: /home/amax/HUAWEI/FastDeploy/build/fastdeploy-ascend/third_libs/install/paddlelite/include/._paddle_place.h -- Installing: /home/amax/HUAWEI/FastDeploy/build/fastdeploy-ascend/third_libs/install/paddlelite/include/._paddle_use_passes.h -- Installing: /home/amax/HUAWEI/FastDeploy/build/fastdeploy-ascend/third_libs/install/paddlelite/include/._paddle_use_ops.h -- Installing: /home/amax/HUAWEI/FastDeploy/build/fastdeploy-ascend/third_libs/install/paddlelite/include/._paddle_use_kernels.h -- Installing: /home/amax/HUAWEI/FastDeploy/build/fastdeploy-ascend/third_libs/install/paddlelite/include/._paddle_lite_factory_helper.h -- Installing: /home/amax/HUAWEI/FastDeploy/build/fastdeploy-ascend/third_libs/install/paddlelite/include/paddle_lite_factory_helper.h -- Installing: /home/amax/HUAWEI/FastDeploy/build/fastdeploy-ascend/third_libs/install/paddlelite/include/paddle_place.h -- Installing: /home/amax/HUAWEI/FastDeploy/build/fastdeploy-ascend/third_libs/install/paddlelite/include/paddle_api.h -- Installing: /home/amax/HUAWEI/FastDeploy/build/fastdeploy-ascend/third_libs/install/paddlelite/lib -- Installing: /home/amax/HUAWEI/FastDeploy/build/fastdeploy-ascend/third_libs/install/paddlelite/lib/libpaddle_full_api_shared.so -- Installing: /home/amax/HUAWEI/FastDeploy/build/fastdeploy-ascend/third_libs/install/paddlelite/lib/._libpaddle_full_api_shared.so -- Installing: /home/amax/HUAWEI/FastDeploy/build/fastdeploy-ascend/LICENSE -- Installing: /home/amax/HUAWEI/FastDeploy/build/fastdeploy-ascend/ThirdPartyNotices.txt -- Installing: /home/amax/HUAWEI/FastDeploy/build/fastdeploy-ascend/VERSION_NUMBER -- Installing: /home/amax/HUAWEI/FastDeploy/build/fastdeploy-ascend/FastDeploy.cmake -- Installing: /home/amax/HUAWEI/FastDeploy/build/fastdeploy-ascend/FastDeployCSharp.cmake -- Installing: /home/amax/HUAWEI/FastDeploy/build/fastdeploy-ascend/FastDeployConfig.cmake -- Installing: /home/amax/HUAWEI/FastDeploy/build/fastdeploy-ascend/utils.cmake -- Installing: /home/amax/HUAWEI/FastDeploy/build/fastdeploy-ascend/summary.cmake -- Installing: /home/amax/HUAWEI/FastDeploy/build/fastdeploy-ascend/openmp.cmake -- Installing: /home/amax/HUAWEI/FastDeploy/build/fastdeploy-ascend/utils/gflags.cmake -- Installing: /home/amax/HUAWEI/FastDeploy/build/fastdeploy-ascend/fastdeploy_init.sh -- Installing: /home/amax/HUAWEI/FastDeploy/build/fastdeploy-ascend/ascend_init.sh