search

NVIDIA / TensorRT-LLM

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.
https://nvidia.github.io/TensorRT-LLM
Apache License 2.0
7.51k stars 819 forks source link

TensorRT build failed #1150

Open BigFaceBoy opened 4 months ago

BigFaceBoy commented 4 months ago

run command: make -C docker release_build

output :

Building docker image: tensorrt_llm/release:latest
DOCKER_BUILDKIT=1 docker build --pull  \
        --progress auto \
         --build-arg BASE_IMAGE=nvcr.io/nvidia/pytorch \
         --build-arg BASE_TAG=23.12-py3 \
         --build-arg BUILD_WHEEL_ARGS="--clean --trt_root /usr/local/tensorrt --python_bindings --benchmarks" \
         --build-arg TORCH_INSTALL_TYPE="skip" \
         \
         \
         \
         \
         \
         --build-arg TRT_LLM_VER="0.9.0.dev2024022000" \
         \
         --build-arg GIT_COMMIT="3c373ebc5b5caf7e41198125131a153f3df08f09" \
         --target release \
        --file Dockerfile.multi \
        --tag tensorrt_llm/release:latest \
        ..
[+] Building 8.2s (7/39)
 => [internal] load build definition from Dockerfile.multi                                                                                        0.0s
 => => transferring dockerfile: 103B                                                                                                                       0.0s
 => [internal] load .dockerignore                                                                                                                             0.0s
 => => transferring context: 94B                                                                                                                             0.0s
 => [internal] load metadata for nvcr.io/nvidia/pytorch:23.12-py3                                                                         1.9s
 => [internal] load build context                                                                                                                              1.0s
 => => transferring context: 1.38MB                                                                                                                       0.9s
 => [base 1/1] FROM nvcr.io/nvidia/pytorch:23.12-py3@sha256:da3d1b690b9dca1fbf9beb3506120a63479e0cf1dc69c9256055125460eb44f7                                 0.0s
 => CACHED [devel 1/14] COPY docker/common/install_base.sh install_base.sh                                                   0.0s
 => ERROR [devel 2/14] RUN bash ./install_base.sh && rm install_base.sh                                                            5.2s
------
 > [devel 2/14] RUN bash ./install_base.sh && rm install_base.sh:
#7 0.629 ++ grep -oP '(?<=^ID=).+' /etc/os-release
#7 0.630 ++ tr -d '"'
#7 0.641 + ID=ubuntu
#7 0.641 + set_bash_env
#7 0.641 + '[' '!' -f /etc/bash.bashrc ']'
#7 0.641 + '[' '!' -f /etc/shinit_v2 ']'
#7 0.641 + case "$ID" in
#7 0.641 + init_ubuntu
#7 0.641 + apt-get update
#7 1.424 Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB]
#7 1.427 Get:2 http://archive.ubuntu.com/ubuntu jammy InRelease [270 kB]
#7 2.792 Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB]
#7 2.961 Err:1 http://security.ubuntu.com/ubuntu jammy-security InRelease
#7 2.961   The following signatures couldn't be verified because the public key is not available: NO_PUBKEY 871920D1991BC93C
#7 3.117 Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB]
#7 3.690 Err:2 http://archive.ubuntu.com/ubuntu jammy InRelease
#7 3.690   The following signatures couldn't be verified because the public key is not available: NO_PUBKEY 871920D1991BC93C
#7 4.417 Err:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease
#7 4.417   The following signatures couldn't be verified because the public key is not available: NO_PUBKEY 871920D1991BC93C
#7 5.097 Err:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease
#7 5.097   The following signatures couldn't be verified because the public key is not available: NO_PUBKEY 871920D1991BC93C
#7 5.101 Reading package lists...
#7 5.149 W: http://security.ubuntu.com/ubuntu/dists/jammy-security/InRelease: The key(s) in the keyring /etc/apt/trusted.gpg.d/ubuntu-keyring-2012-cdimage.gpg are ignored as the file is not readable by user '_apt' executing apt-key.
#7 5.149 W: http://security.ubuntu.com/ubuntu/dists/jammy-security/InRelease: The key(s) in the keyring /etc/apt/trusted.gpg.d/ubuntu-keyring-2018-archive.gpg are ignored as the file is not readable by user '_apt' executing apt-key.
#7 5.149 W: GPG error: http://security.ubuntu.com/ubuntu jammy-security InRelease: The following signatures couldn't be verified because the public key is not available: NO_PUBKEY 871920D1991BC93C
#7 5.149 E: The repository 'http://security.ubuntu.com/ubuntu jammy-security InRelease' is not signed.
#7 5.149 W: http://archive.ubuntu.com/ubuntu/dists/jammy/InRelease: The key(s) in the keyring /etc/apt/trusted.gpg.d/ubuntu-keyring-2012-cdimage.gpg are ignored as the file is not readable by user '_apt' executing apt-key.
#7 5.149 W: http://archive.ubuntu.com/ubuntu/dists/jammy/InRelease: The key(s) in the keyring /etc/apt/trusted.gpg.d/ubuntu-keyring-2018-archive.gpg are ignored as the file is not readable by user '_apt' executing apt-key.
#7 5.149 W: GPG error: http://archive.ubuntu.com/ubuntu jammy InRelease: The following signatures couldn't be verified because the public key is not available: NO_PUBKEY 871920D1991BC93C
#7 5.149 E: The repository 'http://archive.ubuntu.com/ubuntu jammy InRelease' is not signed.
#7 5.149 W: http://archive.ubuntu.com/ubuntu/dists/jammy-updates/InRelease: The key(s) in the keyring /etc/apt/trusted.gpg.d/ubuntu-keyring-2012-cdimage.gpg are ignored as the file is not readable by user '_apt' executing apt-key.
#7 5.149 W: http://archive.ubuntu.com/ubuntu/dists/jammy-updates/InRelease: The key(s) in the keyring /etc/apt/trusted.gpg.d/ubuntu-keyring-2018-archive.gpg are ignored as the file is not readable by user '_apt' executing apt-key.
#7 5.149 W: GPG error: http://archive.ubuntu.com/ubuntu jammy-updates InRelease: The following signatures couldn't be verified because the public key is not available: NO_PUBKEY 871920D1991BC93C
#7 5.149 E: The repository 'http://archive.ubuntu.com/ubuntu jammy-updates InRelease' is not signed.
#7 5.149 W: http://archive.ubuntu.com/ubuntu/dists/jammy-backports/InRelease: The key(s) in the keyring /etc/apt/trusted.gpg.d/ubuntu-keyring-2012-cdimage.gpg are ignored as the file is not readable by user '_apt' executing apt-key.
#7 5.149 W: http://archive.ubuntu.com/ubuntu/dists/jammy-backports/InRelease: The key(s) in the keyring /etc/apt/trusted.gpg.d/ubuntu-keyring-2018-archive.gpg are ignored as the file is not readable by user '_apt' executing apt-key.
#7 5.149 W: GPG error: http://archive.ubuntu.com/ubuntu jammy-backports InRelease: The following signatures couldn't be verified because the public key is not available: NO_PUBKEY 871920D1991BC93C
#7 5.149 E: The repository 'http://archive.ubuntu.com/ubuntu jammy-backports InRelease' is not signed.
#7 5.149 E: Problem executing scripts APT::Update::Post-Invoke 'rm -f /var/cache/apt/archives/*.deb /var/cache/apt/archives/partial/*.deb /var/cache/apt/*.bin || true'
#7 5.149 E: Sub-process returned an error code
------
failed to solve with frontend dockerfile.v0: failed to build LLB: executor failed running [/bin/bash -c bash ./install_base.sh && rm install_base.sh]: runc did not terminate sucessfully
litaotju commented 3 months ago

@BigFaceBoy

This seems to be apt update has meet some network issue. Have you resolved this one?

#7 5.149 E: Problem executing scripts APT::Update::Post-Invoke 'rm -f /var/cache/apt/archives/*.deb /var/cache/apt/archives/partial/*.deb /var/cache/apt/*.bin || true'
#7 5.149 E: Sub-process returned an error code
------
wayne-wang-1119 commented 3 months ago

try manual installation maybe? https://nvidia.github.io/TensorRT-LLM/build_from_source.html Working on the same problem