PaddlePaddle / PaddleCustomDevice

PaddlePaddle custom device implementaion. (『飞桨』自定义硬件接入实现)
Apache License 2.0
70 stars 147 forks source link

submodule更新异常 #594

Closed parap1uie-s closed 1 year ago

parap1uie-s commented 1 year ago

运行git submodule update --remote --init --recursive时,Paddle的第三方依赖 leveldb无法拉取

[***@*** PaddleCustomDevice]$ git submodule update --remote --init --recursive
Submodule 'Paddle' (https://github.com/PaddlePaddle/Paddle.git) registered for path 'Paddle'
Cloning into 'Paddle'...
remote: Enumerating objects: 552541, done.
remote: Counting objects: 100% (887/887), done.
remote: Compressing objects: 100% (664/664), done.
remote: Total 552541 (delta 408), reused 406 (delta 221), pack-reused 551654
Receiving objects: 100% (552541/552541), 349.40 MiB | 335.00 KiB/s, done.
Resolving deltas: 100% (466820/466820), done.
remote: Enumerating objects: 45, done.
remote: Counting objects: 100% (45/45), done.
remote: Compressing objects: 100% (21/21), done.
remote: Total 24 (delta 22), reused 5 (delta 3), pack-reused 0
Unpacking objects: 100% (24/24), done.
From https://github.com/PaddlePaddle/Paddle
   a195ef3..cbeff5f  develop    -> origin/develop
Submodule path 'Paddle': checked out 'cbeff5fc580672ff0882ca6bd9a1341fe8bef1fc'
Submodule 'third_party/dlpack' (https://github.com/dmlc/dlpack.git) registered for path 'third_party/dlpack'
Submodule 'third_party/eigen3' (https://gitlab.com/libeigen/eigen.git) registered for path 'third_party/eigen3'
Submodule 'third_party/gflags' (https://github.com/gflags/gflags.git) registered for path 'third_party/gflags'
Submodule 'third_party/glog' (https://github.com/google/glog.git) registered for path 'third_party/glog'
Submodule 'third_party/gloo' (https://github.com/ziyoujiyi/gloo.git) registered for path 'third_party/gloo'
Submodule 'third_party/leveldb' (https://github.com/google/leveldb) registered for path 'third_party/leveldb'
Submodule 'third_party/protobuf' (https://github.com/protocolbuffers/protobuf.git) registered for path 'third_party/protobuf'
Submodule 'third_party/threadpool' (https://github.com/progschj/ThreadPool.git) registered for path 'third_party/threadpool'
Submodule 'third_party/utf8proc' (https://github.com/JuliaStrings/utf8proc.git) registered for path 'third_party/utf8proc'
Submodule 'third_party/warpctc' (https://github.com/baidu-research/warp-ctc.git) registered for path 'third_party/warpctc'
Submodule 'third_party/warprnnt' (https://github.com/PaddlePaddle/warp-transducer.git) registered for path 'third_party/warprnnt'
Submodule 'third_party/xxhash' (https://github.com/Cyan4973/xxHash.git) registered for path 'third_party/xxhash'
Submodule 'third_party/zlib' (https://github.com/madler/zlib.git) registered for path 'third_party/zlib'
Cloning into 'third_party/dlpack'...
remote: Enumerating objects: 462, done.
remote: Counting objects: 100% (99/99), done.
remote: Compressing objects: 100% (40/40), done.
remote: Total 462 (delta 74), reused 69 (delta 59), pack-reused 363
Receiving objects: 100% (462/462), 1.70 MiB | 191.00 KiB/s, done.
Resolving deltas: 100% (162/162), done.
Submodule path 'Paddle/third_party/dlpack': checked out '3ec04430e89a6834e5a1b99471f415fa939bf642'
Cloning into 'third_party/eigen3'...
remote: Enumerating objects: 119484, done.
remote: Counting objects: 100% (1163/1163), done.
remote: Compressing objects: 100% (375/375), done.
remote: Total 119484 (delta 812), reused 1117 (delta 787), pack-reused 118321
Receiving objects: 100% (119484/119484), 103.62 MiB | 10.13 MiB/s, done.
Resolving deltas: 100% (98647/98647), done.
Submodule path 'Paddle/third_party/eigen3': checked out '07e4604b1961a32bbe21841a1e97fc274b50c443'
Cloning into 'third_party/gflags'...
remote: Enumerating objects: 2458, done.
remote: Counting objects: 100% (71/71), done.
remote: Compressing objects: 100% (46/46), done.
remote: Total 2458 (delta 34), reused 52 (delta 25), pack-reused 2387
Receiving objects: 100% (2458/2458), 1.53 MiB | 1.12 MiB/s, done.
Resolving deltas: 100% (1436/1436), done.
Submodule path 'Paddle/third_party/gflags': checked out 'a738fdf9338412f83ab3f26f31ac11ed3f3ec4bd'
Cloning into 'third_party/glog'...
remote: Enumerating objects: 4005, done.
remote: Counting objects: 100% (267/267), done.
remote: Compressing objects: 100% (161/161), done.
remote: Total 4005 (delta 153), reused 191 (delta 95), pack-reused 3738
Receiving objects: 100% (4005/4005), 2.27 MiB | 237.00 KiB/s, done.
Resolving deltas: 100% (2755/2755), done.
Submodule path 'Paddle/third_party/glog': checked out '22491eb1236c8b5c1dcba2ed3a213c74ce699988'
Cloning into 'third_party/gloo'...
remote: Enumerating objects: 3613, done.
remote: Counting objects: 100% (7/7), done.
remote: Compressing objects: 100% (7/7), done.
remote: Total 3613 (delta 0), reused 1 (delta 0), pack-reused 3606
Receiving objects: 100% (3613/3613), 1.07 MiB | 694.00 KiB/s, done.
Resolving deltas: 100% (2762/2762), done.
Submodule path 'Paddle/third_party/gloo': checked out '9877014465775fac31df9297e5425e599031be76'
Cloning into 'third_party/leveldb'...
remote: Enumerating objects: 3525, done.
remote: Counting objects: 100% (68/68), done.
remote: Compressing objects: 100% (49/49), done.
remote: Total 3525 (delta 29), reused 29 (delta 15), pack-reused 3457
Receiving objects: 100% (3525/3525), 1.67 MiB | 173.00 KiB/s, done.
Resolving deltas: 100% (2460/2460), done.
fatal: Needed a single revision
Unable to find current origin/master revision in submodule path 'third_party/leveldb'
Failed to recurse into submodule path 'Paddle'
KimBioInfoStudio commented 1 year ago

PaddleCustomDevice 并没有用到 Paddle 中的 submodule 暂时不要 --remote 同步 Paddle, 使用 PaddleCustomDevice 中 freeze 的 submodule commit 即可

导致问题的原因是主库目前正在废弃使用 cmake 拉取代码转为 submodule, @qili93 @ronny1996 PaadleCustomDevice 各个 backends Readme 中 --remote 是否合理? 是否需要删除? 下次更新submodule 的 规划?

USTCKAY commented 1 year ago

@parap1uie-s 可以通过更新git到最新版本解决该问题。 参考链接 git更新方法