wraprnnt编译失败

[huwei02]

问题描述 Issue Description

编译报错： error: pathspec '.' did not match any file(s) known to git. CMakeFiles/extern_warprnnt.dir/build.make:114: recipe for target 'third_party/warprnnt/src/extern_warprnnt-stamp/extern_warprnnt-patch' failed make[2]: [third_party/warprnnt/src/extern_warprnnt-stamp/extern_warprnnt-patch] Error 1 make[2]: Target 'CMakeFiles/extern_warprnnt.dir/build' not remade because of errors. CMakeFiles/Makefile2:4287: recipe for target 'CMakeFiles/extern_warprnnt.dir/all' failed make[1]: [CMakeFiles/extern_warprnnt.dir/all] Error 2

编译命令： ~/cmake-3.28.1-linux-x86_64/bin/cmake .. -DPY_VERSION=3.8 \ -DWITH_GPU=ON \ -DWITH_DISTRIBUTE=ON \ -DWITH_TESTING=OFF \ -DPYTHON_EXECUTABLE=/usr/bin/python3.8 \ -DPYTHON_LIBRARY=/usr/lib/python3.8/ \ -DCMAKE_BUILD_TYPE=Release \ -DCUDA_ARCH_NAME=Manual \ -DCUDA_ARCH_BIN=70,80

版本&环境信息 Version & Environment Information

Paddle develop分支 CUDA 11.2

[LiYuRio]

建议把third party清空，执行一下git submodule update --init，重新拉一下第三方库

[cse0001]

建议进入Paddle/third_party/warprnnt，检查是否为空，为空则手动clone https://github.com/PaddlePaddle/warp-transducer.git，并将文件夹更名为warprnnt，由于网络问题执行git submodule update --init时，third_party下可能有许多包clone失败，建议手动clone 附所有第三方库地址（develop分支）： Submodule 'third_party/absl' (https://github.com/abseil/abseil-cpp.git) registered for path 'third_party/absl' Submodule 'third_party/brpc' (https://github.com/apache/brpc.git) registered for path 'third_party/brpc' Submodule 'third_party/cccl' (https://github.com/NVIDIA/cccl.git) registered for path 'third_party/cccl' Submodule 'third_party/cryptopp' (https://github.com/weidai11/cryptopp.git) registered for path 'third_party/cryptopp' Submodule 'third_party/cryptopp-cmake' (https://github.com/noloader/cryptopp-cmake.git) registered for path 'third_party/cryptopp-cmake' Submodule 'third_party/cub' (https://github.com/NVIDIA/cub.git) registered for path 'third_party/cub' Submodule 'third_party/cutlass' (https://github.com/NVIDIA/cutlass.git) registered for path 'third_party/cutlass' Submodule 'third_party/dlpack' (https://github.com/dmlc/dlpack.git) registered for path 'third_party/dlpack' Submodule 'third_party/eigen3' (https://gitlab.com/libeigen/eigen.git) registered for path 'third_party/eigen3' Submodule 'third_party/flashattn' (https://github.com/PaddlePaddle/flash-attention.git) registered for path 'third_party/flashattn' Submodule 'third_party/gflags' (https://github.com/gflags/gflags.git) registered for path 'third_party/gflags' Submodule 'third_party/glog' (https://github.com/google/glog.git) registered for path 'third_party/glog' Submodule 'third_party/gloo' (https://github.com/ziyoujiyi/gloo.git) registered for path 'third_party/gloo' Submodule 'third_party/gtest' (https://github.com/google/googletest.git) registered for path 'third_party/gtest' Submodule 'third_party/jitify' (https://github.com/NVIDIA/jitify.git) registered for path 'third_party/jitify' Submodule 'third_party/leveldb' (https://github.com/google/leveldb.git) registered for path 'third_party/leveldb' Submodule 'third_party/nlohmann_json' (https://github.com/nlohmann/json.git) registered for path 'third_party/nlohmann_json' Submodule 'third_party/onednn' (https://github.com/oneapi-src/oneDNN.git) registered for path 'third_party/onednn' Submodule 'third_party/openblas' (https://github.com/xianyi/OpenBLAS.git) registered for path 'third_party/openblas' Submodule 'third_party/pocketfft' (https://gitlab.mpcdf.mpg.de/mtr/pocketfft.git) registered for path 'third_party/pocketfft' Submodule 'third_party/protobuf' (https://github.com/protocolbuffers/protobuf.git) registered for path 'third_party/protobuf' Submodule 'third_party/pybind' (https://github.com/pybind/pybind11.git) registered for path 'third_party/pybind' Submodule 'third_party/rocksdb' (https://github.com/Thunderbrook/rocksdb) registered for path 'third_party/rocksdb' Submodule 'third_party/snappy' (https://github.com/google/snappy.git) registered for path 'third_party/snappy' Submodule 'third_party/threadpool' (https://github.com/progschj/ThreadPool.git) registered for path 'third_party/threadpool' Submodule 'third_party/utf8proc' (https://github.com/JuliaStrings/utf8proc.git) registered for path 'third_party/utf8proc' Submodule 'third_party/warpctc' (https://github.com/baidu-research/warp-ctc.git) registered for path 'third_party/warpctc' Submodule 'third_party/warprnnt' (https://github.com/PaddlePaddle/warp-transducer.git) registered for path 'third_party/warprnnt' Submodule 'third_party/xbyak' (https://github.com/herumi/xbyak.git) registered for path 'third_party/xbyak' Submodule 'third_party/xxhash' (https://github.com/Cyan4973/xxHash.git) registered for path 'third_party/xxhash' Submodule 'third_party/yaml-cpp' (https://github.com/jbeder/yaml-cpp) registered for path 'third_party/yaml-cpp' Submodule 'third_party/zlib' (https://github.com/madler/zlib.git) registered for path 'third_party/zlib'

[burning-star-x]

@cse0001 我git clone一直失败 用下载的zip会有影响吗

[burning-star-x]

@cse0001 大佬能帮忙看一眼吗 我和楼主差不多一样的错(win10从源码编译) 我清空了third_party文件夹 然后写了一个用ssh拉取所有第三方库的脚本,拉取后cmake .. -GNinja -DWITH_GPU=OFF -DWITH_UNITY_BUILD=ON还是报错了,请问是我哪一步没做对,我比较菜能说详细一点吗,

拉取脚本在附件shh_clone_all.bat.txt

Synchronizing submodule url for 'third_party/xxhash' Synchronizing submodule url for 'third_party/yaml-cpp' Synchronizing submodule url for 'third_party/zlib' fatal: not a git repository: D:/AllMyProjects/AllIDEs/VisualStudio/000_VSProjects/Paddle/Paddle/third_party/eigen3/../../.git/modules/third_party/eigen3 Failed to clone 'third_party/eigen3'. Retry scheduled BUG: submodule considered for cloning, doesn't need cloning any more? Submodule path 'third_party/absl': checked out '278e0a071885a22dcd2fd1b5576cc44757299343' Submodule path 'third_party/brpc': checked out 'cf2a22000584f30309e49e01e634128b193abb3e' error: unable to create file libcudacxx/libcxx/test/std/thread/thread.mutex/thread.mutex.requirements/thread.sharedtimedmutex.requirements/thread.sharedtimedmutex.class/try_lock_until_deadlock_bug.pass.cpp: Filename too long Submodule path 'third_party/cccl': checked out '1f6e4bcae0fbf1bbed87f88544d8d2161c490fc1' Submodule path 'third_party/cryptopp': checked out '9dcc26c58213abb8351fbb1b2a7a1d2c667366e4' Submodule path 'third_party/cryptopp-cmake': checked out '6d0666c457fbbf6f81819fd2b80f0cb5b6646593' Submodule path 'third_party/cub': checked out 'c3cceac115c072fb63df1836ff46d8c60d9eb304' Submodule path 'third_party/cutlass': checked out '66d9cddc832c1cdc2b30a8755274f7f74640cfe6' Submodule path 'third_party/dlpack': checked out 'a07f962d446b577adf4baef2b347a0f3a2a20617' fatal: could not get a repository handle for submodule 'third_party/eigen3' CMake Error at cmake/third_party.cmake:84 (message): Failed to update submodule, please check your network ! Call Stack (most recent call first): CMakeLists.txt:603 (include)

-- Configuring incomplete, errors occurred!

D:\AllMyProjects\AllIDEs\VisualStudio\000_VSProjects\Paddle\Paddle\build>