huggingface / optimum-nvidia

Apache License 2.0
887 stars 86 forks source link

can't build optimum-nvidia #96

Open dahwin opened 6 months ago

dahwin commented 6 months ago

!TARGET_SM="90-real;89-real" !git clone --recursive --depth=1 https://github.com/huggingface/optimum-nvidia.git !cd optimum-nvidia/third-party/tensorrt-llm !make -C docker release_build CUDA_ARCHS=$TARGET_SM !cd ../.. && docker build -t <organisation_name/image_name>: -f docker/Dockerfile .

Cloning into 'optimum-nvidia'... remote: Enumerating objects: 110, done. remote: Counting objects: 100% (110/110), done. remote: Compressing objects: 100% (94/94), done. remote: Total 110 (delta 20), reused 54 (delta 3), pack-reused 0 Receiving objects: 100% (110/110), 770.51 KiB | 6.26 MiB/s, done. Resolving deltas: 100% (20/20), done. Submodule 'third-party/tensorrt-llm' (https://github.com/nvidia/tensorrt-llm) registered for path 'third-party/tensorrt-llm' Cloning into '/kaggle/working/optimum-nvidia/third-party/tensorrt-llm'... remote: Enumerating objects: 11120, done.
remote: Counting objects: 100% (1080/1080), done.
remote: Compressing objects: 100% (685/685), done.
remote: Total 11120 (delta 382), reused 905 (delta 366), pack-reused 10040
Receiving objects: 100% (11120/11120), 132.15 MiB | 34.95 MiB/s, done. Resolving deltas: 100% (7362/7362), done. fatal: remote error: upload-pack: not our ref 37aa4499520eea1d6c6dbc04a66d77bef00014f5 fatal: the remote end hung up unexpectedly Fetched in submodule path 'third-party/tensorrt-llm', but it did not contain 37aa4499520eea1d6c6dbc04a66d77bef00014f5. Direct fetching of that commit failed. make: *** docker: No such file or directory. Stop. /bin/bash: organisation_name/image_name: No such file or directory

jmurphyq commented 6 months ago
cd third-party
rm -fr tensorrt-llm
git clone  https://github.com/nvidia/tensorrt-llm
cd tensorrt-llm
git submodule update --init --recursive
make -C docker release_build CUDA_ARCHS="90-real;89-real"
cd ../..
docker build -t <organisation_name/image_name>:<version> -f docker/Dockerfile .