PaddlePaddle / Paddle

PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice (『飞桨』核心框架,深度学习&机器学习高性能单机、分布式训练和跨平台部署)
http://www.paddlepaddle.org/
Apache License 2.0
21.94k stars 5.52k forks source link

在华为Atlas310pro编译Paddle_npu版本,cmake有警告,make报错 #63739

Open ZCCFighting opened 3 months ago

ZCCFighting commented 3 months ago

问题描述 Issue Description

根据当前网址https://www.paddlepaddle.org.cn/documentation/docs/zh/guides/hardware_support/npu_docs/paddle_install_cn.html#anzhuangfangshi-tongguoyuanmabianyianzhuang%EF%BC%8C 先拉取镜像,创建容器,我的代码环境是python3.8, 在进入容器之后用conda 创建了python3.8的虚拟环境,执行了 cmake .. -DPY_VERSION=3.8 -DWITH_ASCEND=OFF -DWITH_ARM=ON -DWITH_ASCEND_CL=ON \ -DWITH_ASCEND_INT64=ON -DWITH_DISTRIBUTE=ON -DWITH_TESTING=ON -DON_INFER=ON \ -DCMAKE_BUILD_TYPE=Release -DCMAKE_EXPORT_COMPILE_COMMANDS=ON

结尾警告 Automatic code generation for paddle/fluid/primitive succeed. Automatic code generation for decomp interface succeed. WITH_DLNNE: -- PT Disabled OpTest: set FLAGS_enable_pir_with_pt_in_dy2st to False for test_legacy_error -- PT Disabled OpTest: set FLAGS_enable_pir_with_pt_in_dy2st to False for test_pylayer -- PT Disabled OpTest: set FLAGS_enable_pir_with_pt_in_dy2st to False for test_local_cast -- Download inference test stuff from http://paddle-inference-dist.bj.bcebos.com/word2vec.inference.model.tar.gz -- Download inference test stuff from http://paddle-inference-dist.bj.bcebos.com/image_classification_resnet.inference.model.tgz Total cpp tests using dynamic link: 183 -- PIR Copied OpTest: test_fuse_elewise_add_act_pass_pir in legacy_test -- PIR Copied OpTest: test_sequence_mask_pir in sequence test -- Configuring done CMake Warning at paddle/fluid/pybind/CMakeLists.txt:301 (add_executable): Cannot generate a safe runtime search path for target eager_legacy_op_function_generator because files in some directories may conflict with libraries in implicit directories: runtime library [libssl.so.1.1] in /usr/lib/aarch64-linux-gnu may be hidden by files in: /opt/conda/envs/pd/lib runtime library [libcrypto.so.1.1] in /usr/lib/aarch64-linux-gnu may be hidden by files in: /opt/conda/envs/pd/lib Some of these libraries may not be found correctly. CMake Warning at paddle/fluid/pybind/CMakeLists.txt:310 (add_executable): Cannot generate a safe runtime search path for target kernel_signature_generator because files in some directories may conflict with libraries in implicit directories: runtime library [libssl.so.1.1] in /usr/lib/aarch64-linux-gnu may be hidden by files in: /opt/conda/envs/pd/lib runtime library [libcrypto.so.1.1] in /usr/lib/aarch64-linux-gnu may be hidden by files in: /opt/conda/envs/pd/lib Some of these libraries may not be found correctly. -- Generating done CMake Warning: Manually-specified variables were not used by the project: WITH_ASCEND_INT64 -- Build files have been written to: /home/paddle/Paddle/build

然后执行 make TARGET=ARMV8 -j$(nproc) 报错了

报错如下 -- Installing: /home/paddle/Paddle/build/third_party/install/brpc/include/mcpack2pb/serializer.h -- Installing: /home/paddle/Paddle/build/third_party/install/brpc/include/idl_options.pb.h -- Installing: /home/paddle/Paddle/build/third_party/install/brpc/lib/pkgconfig/brpc.pc -- Installing: /home/paddle/Paddle/build/third_party/install/brpc/lib/libbrpc.so -- Installing: /home/paddle/Paddle/build/third_party/install/brpc/lib/libbrpc.a -- Installing: /home/paddle/Paddle/build/third_party/install/brpc/bin/parallel_http -- Installing: /home/paddle/Paddle/build/third_party/install/brpc/bin/rpc_press -- Installing: /home/paddle/Paddle/build/third_party/install/brpc/bin/rpc_replay -- Installing: /home/paddle/Paddle/build/third_party/install/brpc/bin/rpc_view -- Installing: /home/paddle/Paddle/build/third_party/install/brpc/bin/trackme_server [ 36%] Completed 'extern_brpc' [ 36%] Built target extern_brpc ar: u' modifier ignored sinceD' is the default (see U') ar:u' modifier ignored since D' is the default (seeU') [ 36%] Performing install step for 'extern_jemalloc' make[3]: warning: jobserver unavailable: using -j1. Add '+' to parent make rule. /usr/bin/install -c -m 755 bin/jemalloc-config /home/paddle/Paddle/build/third_party/install/jemalloc/bin /usr/bin/install -c -m 755 bin/jemalloc.sh /home/paddle/Paddle/build/third_party/install/jemalloc/bin /usr/bin/install -c -m 755 bin/jeprof /home/paddle/Paddle/build/third_party/install/jemalloc/bin /usr/bin/install -c -m 644 include/jemalloc/jemalloc.h /home/paddle/Paddle/build/third_party/install/jemalloc/include/jemalloc /usr/bin/install -c -m 755 lib/libjemalloc.a /home/paddle/Paddle/build/third_party/install/jemalloc/lib /usr/bin/install -c -m 755 lib/libjemalloc_pic.a /home/paddle/Paddle/build/third_party/install/jemalloc/lib /usr/bin/install -c -m 644 jemalloc.pc /home/paddle/Paddle/build/third_party/install/jemalloc/lib/pkgconfig /usr/bin/install -c -m 644 doc/jemalloc.html /home/paddle/Paddle/build/third_party/install/jemalloc/share/doc/jemalloc /usr/bin/install -c -m 644 doc/jemalloc.3 /home/paddle/Paddle/build/third_party/install/jemalloc/share/man/man3 [ 36%] Completed 'extern_jemalloc' [ 36%] Built target extern_jemalloc Makefile:159: recipe for target 'all' failed make: *** [all] Error 2

版本&环境信息 Version & Environment Information

python版本是3.8.8 paddle下载是最新的

yangjianfengo1 commented 3 months ago

有可能是make 给的线程数太多了,make TARGET=ARMV8 -j8 试试

ZCCFighting commented 3 months ago

有可能是make 给的线程数太多了,make TARGET=ARMV8 -j8 试试

试了下还是不行

qili93 commented 3 months ago

您好,之前的文档已经过期了,当前Paddle的官方支持文档已经更新到 https://www.paddlepaddle.org.cn/documentation/docs/zh/develop/guides/hardware_support/npu/install_cn.html 会随着下个Paddle正式版本发布。

目前Paddle仅支持对 Ascend 910A 和 Ascend 910B 两款芯片,如果您要支持 Atlas310Pro 可以参考 https://github.com/PaddlePaddle/PaddleCustomDevice/issues/965 这PR对容器镜像和代码进修改尝试支持。

您在修改过程中有任何问题可以随时联系我们,谢谢!