Open ZhangYuef opened 1 month ago
Related to ISSUEs #43741 #52807 #50935 .
您好,由于K100是昆仑一代芯片,Paddle develop分支的最新代码已经不再支持此芯片。建议您可以切换到 release/2.3 或者 release/2.2 分支尝试编译一下看下,谢谢!
您可以参考下这个文档试试看 https://www.paddlepaddle.org.cn/documentation/docs/zh/2.2/guides/09_hardware_support/xpu_docs/paddle_install_cn.html
@TingquanGao
您好,由于K100是昆仑一代芯片,Paddle develop分支的最新代码已经不再支持此芯片。建议您可以切换到 release/2.3 或者 release/2.2 分支尝试编译一下看下,谢谢!
您可以参考下这个文档试试看 https://www.paddlepaddle.org.cn/documentation/docs/zh/2.2/guides/09_hardware_support/xpu_docs/paddle_install_cn.html
@qili93 您好,切换到 release/2.3
分支后可以 正常执行 cmake,但在 make 阶段出现报错,看上去是某个依赖包下载链改变:
cd /home/EVC/Paddle/build && /usr/bin/cmake -E cmake_depends "Unix Makefiles" /home/EVC/Paddle /home/EVC/Paddle /home/EVC/Paddle/build /home/EVC/Paddle/build /home/EVC/Paddle/build/CMakeFiles/extern_xpu.dir/DependInfo.cmake --color=
Dependee "/home/EVC/Paddle/build/CMakeFiles/extern_xpu.dir/DependInfo.cmake" is newer than depender "/home/EVC/Paddle/build/CMakeFiles/extern_xpu.dir/depend.internal".
Dependee "/home/EVC/Paddle/build/CMakeFiles/CMakeDirectoryInformation.cmake" is newer than depender "/home/EVC/Paddle/build/CMakeFiles/extern_xpu.dir/depend.internal".
Scanning dependencies of target extern_xpu
make[2]: 离开目录“/home/EVC/Paddle/build”
make -f CMakeFiles/extern_xpu.dir/build.make CMakeFiles/extern_xpu.dir/build
make[2]: 进入目录“/home/EVC/Paddle/build”
[ 1%] Creating directories for 'extern_xpu'
/usr/bin/cmake -E make_directory /home/EVC/Paddle/build/third_party/xpu/src/extern_xpu
/usr/bin/cmake -E make_directory /home/EVC/Paddle/build/third_party/xpu/src/extern_xpu-build
/usr/bin/cmake -E make_directory /home/EVC/Paddle/build/third_party/xpu
/usr/bin/cmake -E make_directory /home/EVC/Paddle/build/third_party/xpu/tmp
/usr/bin/cmake -E make_directory /home/EVC/Paddle/build/third_party/xpu/src/extern_xpu-stamp
/usr/bin/cmake -E make_directory /home/EVC/Paddle/build/third_party/xpu/src/extern_xpu
/usr/bin/cmake -E make_directory /home/EVC/Paddle/build/third_party/xpu/src/extern_xpu-stamp
/usr/bin/cmake -E touch /home/EVC/Paddle/build/third_party/xpu/src/extern_xpu-stamp/extern_xpu-mkdir
[ 1%] Performing download step for 'extern_xpu'
cd /home/EVC/Paddle/build/third_party/xpu/src/extern_xpu && wget https://baidu-kunlun-public.su.bcebos.com/paddle_depence/pack_paddle_depence.sh && bash pack_paddle_depence.sh https://baidu-kunlun-product.cdn.bcebos.com/KL-SDK/klsdk-dev/20220415/xre-kylin_aarch64.tar.gz xre-kylin_aarch64 https://baidu-kunlun-product.cdn.bcebos.com/KL-SDK/klsdk-dev/20220415/xdnn-kylin_aarch64.tar.gz xdnn-kylin_aarch64 https://baidu-kunlun-product.cdn.bcebos.com/KL-SDK/klsdk-dev/20220411/xccl-kylin_aarch64.tar.gz xccl-kylin_aarch64
--2024-06-11 09:57:46-- https://baidu-kunlun-public.su.bcebos.com/paddle_depence/pack_paddle_depence.sh
正在解析主机 baidu-kunlun-public.su.bcebos.com (baidu-kunlun-public.su.bcebos.com)... 36.155.132.104, 36.155.132.7
正在连接 baidu-kunlun-public.su.bcebos.com (baidu-kunlun-public.su.bcebos.com)|36.155.132.104|:443... 已连接。
已发出 HTTP 请求,正在等待回应... 200 OK
长度:676 [text/x-sh]
正在保存至: “pack_paddle_depence.sh”
pack_paddle_depence 100%[===================>] 676 --.-KB/s 用时 0s
2024-06-11 09:57:46 (143 MB/s) - 已保存 “pack_paddle_depence.sh” [676/676])
+ XRE_URL=https://baidu-kunlun-product.cdn.bcebos.com/KL-SDK/klsdk-dev/20220415/xre-kylin_aarch64.tar.gz
+ XRE_DIR_NAME=xre-kylin_aarch64
+ XDNN_URL=https://baidu-kunlun-product.cdn.bcebos.com/KL-SDK/klsdk-dev/20220415/xdnn-kylin_aarch64.tar.gz
+ XDNN_DIR_NAME=xdnn-kylin_aarch64
+ XCCL_URL=https://baidu-kunlun-product.cdn.bcebos.com/KL-SDK/klsdk-dev/20220411/xccl-kylin_aarch64.tar.gz
+ XCCL_DIR_NAME=xccl-kylin_aarch64
+ wget --no-check-certificate https://baidu-kunlun-product.cdn.bcebos.com/KL-SDK/klsdk-dev/20220415/xre-kylin_aarch64.tar.gz -c -q -O xre.tar.gz
make[2]: *** [CMakeFiles/extern_xpu.dir/build.make:90:third_party/xpu/src/extern_xpu-stamp/extern_xpu-download] 错误 4
make[2]: 离开目录“/home/EVC/Paddle/build”
make[1]: *** [CMakeFiles/Makefile2:5658:CMakeFiles/extern_xpu.dir/all] 错误 2
make[1]: 离开目录“/home/EVC/Paddle/build”
make: *** [Makefile:130:all] 错误 2
切换到 release/2.2 分支 make 阶段发生类似错误:
/usr/bin/cmake -S/home/EVC/Paddle -B/home/EVC/Paddle/build --check-build-system CMakeFiles/Makefile.cmake 0
/usr/bin/cmake -E cmake_progress_start /home/EVC/Paddle/build/CMakeFiles /home/EVC/Paddle/build/CMakeFiles/progress.marks
make -f CMakeFiles/Makefile2 all
make[1]: 进入目录“/home/EVC/Paddle/build”
make -f CMakeFiles/extern_xpu.dir/build.make CMakeFiles/extern_xpu.dir/depend
make[2]: 进入目录“/home/EVC/Paddle/build”
cd /home/EVC/Paddle/build && /usr/bin/cmake -E cmake_depends "Unix Makefiles" /home/EVC/Paddle /home/EVC/Paddle /home/EVC/Paddle/build /home/EVC/Paddle/build /home/EVC/Paddle/build/CMakeFiles/extern_xpu.dir/DependInfo.cmake --color=
Dependee "/home/EVC/Paddle/build/CMakeFiles/extern_xpu.dir/DependInfo.cmake" is newer than depender "/home/EVC/Paddle/build/CMakeFiles/extern_xpu.dir/depend.internal".
Dependee "/home/EVC/Paddle/build/CMakeFiles/CMakeDirectoryInformation.cmake" is newer than depender "/home/EVC/Paddle/build/CMakeFiles/extern_xpu.dir/depend.internal".
Scanning dependencies of target extern_xpu
make[2]: 离开目录“/home/EVC/Paddle/build”
make -f CMakeFiles/extern_xpu.dir/build.make CMakeFiles/extern_xpu.dir/build
make[2]: 进入目录“/home/EVC/Paddle/build”
[ 0%] Creating directories for 'extern_xpu'
/usr/bin/cmake -E make_directory /home/EVC/Paddle/build/third_party/xpu/src/extern_xpu
/usr/bin/cmake -E make_directory /home/EVC/Paddle/build/third_party/xpu/src/extern_xpu-build
/usr/bin/cmake -E make_directory /home/EVC/Paddle/build/third_party/xpu
/usr/bin/cmake -E make_directory /home/EVC/Paddle/build/third_party/xpu/tmp
/usr/bin/cmake -E make_directory /home/EVC/Paddle/build/third_party/xpu/src/extern_xpu-stamp
/usr/bin/cmake -E make_directory /home/EVC/Paddle/build/third_party/xpu/src/extern_xpu
/usr/bin/cmake -E make_directory /home/EVC/Paddle/build/third_party/xpu/src/extern_xpu-stamp
/usr/bin/cmake -E touch /home/EVC/Paddle/build/third_party/xpu/src/extern_xpu-stamp/extern_xpu-mkdir
[ 0%] Performing download step for 'extern_xpu'
cd /home/EVC/Paddle/build/third_party/xpu/src/extern_xpu && wget https://baidu-kunlun-public.su.bcebos.com/paddle_depence/pack_paddle_depence.sh && bash pack_paddle_depence.sh https://baidu-kunlun-product.cdn.bcebos.com/KL-SDK/klsdk-dev/20210921/xre-kylin_aarch64.tar.gz xre-kylin_aarch64 https://baidu-kunlun-product.cdn.bcebos.com/KL-SDK/klsdk-dev/20210921/xdnn-kylin_aarch64.tar.gz xdnn-kylin_aarch64 https://baidu-kunlun-product.cdn.bcebos.com/KL-SDK/klsdk-dev/20210623/xccl-kylin_aarch64.tar.gz xccl-kylin_aarch64
--2024-06-11 11:25:56-- https://baidu-kunlun-public.su.bcebos.com/paddle_depence/pack_paddle_depence.sh
正在解析主机 baidu-kunlun-public.su.bcebos.com (baidu-kunlun-public.su.bcebos.com)... 36.155.132.7, 36.155.132.104
正在连接 baidu-kunlun-public.su.bcebos.com (baidu-kunlun-public.su.bcebos.com)|36.155.132.7|:443... 失败:没有到主机的路由。
正在连接 baidu-kunlun-public.su.bcebos.com (baidu-kunlun-public.su.bcebos.com)|36.155.132.104|:443... 失败:没有到主机的路由。
make[2]: *** [CMakeFiles/extern_xpu.dir/build.make:90:third_party/xpu/src/extern_xpu-stamp/extern_xpu-download] 错误 4
make[2]: 离开目录“/home/EVC/Paddle/build”
make[1]: *** [CMakeFiles/Makefile2:3439:CMakeFiles/extern_xpu.dir/all] 错误 2
make[1]: 离开目录“/home/EVC/Paddle/build”
make: *** [Makefile:130:all] 错误 2
操作步骤参考:
@TingquanGao @qili93 @jzhang533 @wanglun 希望帮忙解决
cc: @QingshuChen @houj04
在BOS存储的古老依赖路径有所变化,可以参考下图改一下看看。
在BOS存储的古老依赖路径有所变化,可以参考下图改一下看看。
@houj04 您好,感谢您的帮助!下载 XPU 依赖部分通过修改 下载链接现在已经可以正常下载,但在编译阶段出现新的问题,具体如下:
make -f paddle/fluid/inference/api/details/CMakeFiles/reset_tensor_array.dir/build.make paddle/fluid/inference/api/details/CMakeFiles/reset_tensor_array.dir/depend
make[2]: 进入目录“/home/EVC/Paddle/build”
cd /home/EVC/Paddle/build && /usr/bin/cmake -E cmake_depends "Unix Makefiles" /home/EVC/Paddle /home/EVC/Paddle/paddle/fluid/inference/api/details /home/EVC/Paddle/build /home/EVC/Paddle/build/paddle/fluid/inference/api/details /home/EVC/Paddle/build/paddle/fluid/inference/api/details/CMakeFiles/reset_tensor_array.dir/DependInfo.cmake --color=
make[2]: 离开目录“/home/EVC/Paddle/build”
make -f paddle/fluid/inference/api/details/CMakeFiles/reset_tensor_array.dir/build.make paddle/fluid/inference/api/details/CMakeFiles/reset_tensor_array.dir/build
make[2]: 进入目录“/home/EVC/Paddle/build”
make[2]: 对“paddle/fluid/inference/api/details/CMakeFiles/reset_tensor_array.dir/build”无需做任何事。
make[2]: 离开目录“/home/EVC/Paddle/build”
[ 8%] Built target reset_tensor_array
make -f CMakeFiles/extern_pocketfft.dir/build.make CMakeFiles/extern_pocketfft.dir/depend
make[2]: 进入目录“/home/EVC/Paddle/build”
cd /home/EVC/Paddle/build && /usr/bin/cmake -E cmake_depends "Unix Makefiles" /home/EVC/Paddle /home/EVC/Paddle /home/EVC/Paddle/build /home/EVC/Paddle/build /home/EVC/Paddle/build/CMakeFiles/extern_pocketfft.dir/DependInfo.cmake --color=
make[2]: 离开目录“/home/EVC/Paddle/build”
make -f CMakeFiles/extern_pocketfft.dir/build.make CMakeFiles/extern_pocketfft.dir/build
make[2]: 进入目录“/home/EVC/Paddle/build”
make[2]: 对“CMakeFiles/extern_pocketfft.dir/build”无需做任何事。
make[2]: 离开目录“/home/EVC/Paddle/build”
[ 8%] Built target extern_pocketfft
make -f CMakeFiles/extern_lite.dir/build.make CMakeFiles/extern_lite.dir/depend
make[2]: 进入目录“/home/EVC/Paddle/build”
cd /home/EVC/Paddle/build && /usr/bin/cmake -E cmake_depends "Unix Makefiles" /home/EVC/Paddle /home/EVC/Paddle /home/EVC/Paddle/build /home/EVC/Paddle/build /home/EVC/Paddle/build/CMakeFiles/extern_lite.dir/DependInfo.cmake --color=
make[2]: 离开目录“/home/EVC/Paddle/build”
make -f CMakeFiles/extern_lite.dir/build.make CMakeFiles/extern_lite.dir/build
make[2]: 进入目录“/home/EVC/Paddle/build”
[ 8%] Performing download step (git clone) for 'extern_lite'
cd /home/EVC/Paddle/build/third_party/lite/src && /usr/bin/cmake -P /home/EVC/Paddle/build/third_party/lite/tmp/extern_lite-gitclone.cmake
正克隆到 'extern_lite'...
fatal: 无效引用:release/v2.2
CMake Error at /home/EVC/Paddle/build/third_party/lite/tmp/extern_lite-gitclone.cmake:40 (message):
Failed to checkout tag: 'release/v2.2'
make[2]: *** [CMakeFiles/extern_lite.dir/build.make:91:third_party/lite/src/extern_lite-stamp/extern_lite-download] 错误 1
make[2]: 离开目录“/home/EVC/Paddle/build”
make[1]: *** [CMakeFiles/Makefile2:2909:CMakeFiles/extern_lite.dir/all] 错误 2
make[1]: 离开目录“/home/EVC/Paddle/build”
make: *** [Makefile:130:all] 错误 2
当前 git 分支信息:
(paddle_py37) xxx@pc:~/EVC/Paddle/build$ git branch -v
develop d2117f9541 [PIR] Mark more random ops as has side effects (#64786)
* release/2.2 0ee230a7d3 shuffle_channel pass fix (#39735)
release/2.3 a5875319fe fix_slice_convert_varlen (#46874)
将 /home/EVC/Paddle/build/third_party/lite/tmp/extern_lite-gitclone.cmake:40
中版本从 release/v2.2
改为 release/2.2
。
仍存在如下报错:
make[2]: 进入目录“/home/EVC/Paddle/build”
[ 8%] Performing download step (git clone) for 'extern_lite'
cd /home/EVC/Paddle/build/third_party/lite/src && /usr/bin/cmake -P /home/EVC/Paddle/build/third_party/lite/tmp/extern_lite-gitclone.cmake
正克隆到 'extern_lite'...
fatal: 无法访问 'https://github.com/PaddlePaddle/Paddle-Lite.git/':GnuTLS recv error (-54): 在 pull 函数中出错。
正克隆到 'extern_lite'...
-- Had to git clone more than once:
2 times.
fatal: 无效引用:release/2.2
CMake Error at /home/EVC/Paddle/build/third_party/lite/tmp/extern_lite-gitclone.cmake:40 (message):
Failed to checkout tag: 'release/v2.2'
cc: @jzhang533 @TingquanGao @qili93 @houj04 希望帮忙解决
不确定是不是paddle-lite改过tag的名字,我看有个叫做2.2.0的: https://github.com/PaddlePaddle/Paddle-Lite/tree/v2.2.0
不确定是不是paddle-lite改过tag的名字,我看有个叫做2.2.0的: https://github.com/PaddlePaddle/Paddle-Lite/tree/v2.2.0
@houj04 想请教下 应该怎么修改呢
这里改成v2.2.0
试一下看看?
这里改成
v2.2.0
试一下看看?
@houj04 感谢指点!经修改 Paddle-Lite 可以继续编译,但会出现内存不够的情况,当前编译环境内存 16GB. 在参考 ISSUE #58460 解决
问题描述 Issue Description
因为官方不提供 ARM 架构对应 wheel 安装包,因此需要从源码进行手动编译。选取目标 PaddlePaddle 版本为最新
develop
分支。cmake 执行命令:
make
执行
make VERBOSE=1 TARGET=ARMV8 -j1
后发生如下报错:版本&环境信息 Version & Environment Information
Paddle version: N/A Paddle With CUDA: N/A
OS: kylin V10 GCC version: (Ubuntu 9.3.0-10kylin2) 9.3.0 Clang version: N/A CMake version: version 3.16.3 Libc version: glibc 2.31 Python version: 3.8.19
CUDA version: N/A cuDNN version: N/A Nvidia driver version: N/A Nvidia driver List: N/A