search

dusty-nv / jetson-containers

Machine Learning Containers for NVIDIA Jetson and JetPack-L4T
MIT License
2.3k stars 471 forks source link

Building Ollama Container for Jetson Xavier-NX failed for a reference to llm/generate #711

Open apulache opened 2 days ago

apulache commented 2 days ago

I run jetson-container build ollama and got an error:

Step 8/17 : ENV LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64:/usr/local/nvidia/compat:${LD_LIBRARY_PATH} CMAKE_CUDA_ARCHITECTURES=${CMAKE_CUDA_ARCHITECTURES} ---> Running in adf11ae4f612 Removing intermediate container adf11ae4f612 ---> 8d0320fcebd5 Step 9/17 : RUN cd /opt/ollama && export VERSION="0.0.0" && export GOFLAGS="'-ldflags=-w -s \"-X=github.com/ollama/ollama/version.Version=$VERSION\" \"-X=github.com/ollama/ollama/server.mode=release\"'" && export GOARCH=arm64 && echo "OLLAMA_VERSION=${VERSION} GOFLAGS=${GOFLAGS}" && cd llm/generate && sed 's|-j8|-j$(nproc)|' -i gen_common.sh && bash gen_linux.sh && cd ../../ && go build -trimpath . ---> Running in b57e5ae15583 /bin/sh: 1: cd: OLLAMA_VERSION=0.0.0 GOFLAGS='-ldflags=-w -s "-X=github.com/ollama/ollama/version.Version=0.0.0" "-X=github.com/ollama/ollama/server.mode=release"' can't cd to llm/generate The command '/bin/sh -c cd /opt/ollama && export VERSION="0.0.0" && export GOFLAGS="'-ldflags=-w -s \"-X=github.com/ollama/ollama/version.Version=$VERSION\" \"-X=github.com/ollama/ollama/server.mode=release\"'" && export GOARCH=arm64 && echo "OLLAMA_VERSION=${VERSION} GOFLAGS=${GOFLAGS}" && cd llm/generate && sed 's|-j8|-j$(nproc)|' -i gen_common.sh && bash gen_linux.sh && cd ../../ && go build -trimpath .' returned a non-zero code: 2 Traceback (most recent call last): File "/home/apulache/miniforge3/envs/jetson_containers/lib/python3.10/runpy.py", line 196, in _run_module_as_main return _run_code(code, main_globals, None, File "/home/apulache/miniforge3/envs/jetson_containers/lib/python3.10/runpy.py", line 86, in _run_code exec(code, run_globals) File "/home/apulache/Workspace/jetson-containers/jetson_containers/build.py", line 112, in build_container(args.name, args.packages, args.base, args.build_flags, args.build_args, args.simulate, args.skip_tests, args.test_only, args.push, args.no_github_api, args.skip_packages) File "/home/apulache/Workspace/jetson-containers/jetson_containers/container.py", line 147, in build_container status = subprocess.run(cmd.replace(NEWLINE, ' '), executable='/bin/bash', shell=True, check=True) File "/home/apulache/miniforge3/envs/jetson_containers/lib/python3.10/subprocess.py", line 526, in run raise CalledProcessError(retcode, process.args, subprocess.CalledProcessError: Command 'DOCKER_BUILDKIT=0 docker build --network=host --tag ollama:r35.5.0-ollama --file /home/apulache/Workspace/jetson-containers/packages/llm/ollama/Dockerfile --build-arg BASE_IMAGE=ollama:r35.5.0-cuda --build-arg OLLAMA_REPO="ollama/ollama" --build-arg OLLAMA_BRANCH="main" --build-arg GOLANG_VERSION="1.22.1" --build-arg CMAKE_VERSION="3.22.1" --build-arg JETPACK_VERSION="5.1" --build-arg CMAKE_CUDA_ARCHITECTURES="72;87" /home/apulache/Workspace/jetson-containers/packages/llm/ollama 2>&1 | tee /home/apulache/Workspace/jetson-containers/logs/20241103_011216/build/ollama_r35.5.0-ollama.txt; exit ${PIPESTATUS[0]}' returned non-zero exit status 2.

I'm using a Jetson Xavier-NX with Jetpack 5.1.3 and CUDA 11.4.315 on Ubuntu 20.04 My python environment was created with Mamba and has Python 3.10

Here the full log:

jetson-containers run $(autotag ollama) Namespace(packages=['ollama'], prefer=['local', 'registry', 'build'], disable=[''], user='dustynv', output='/tmp/autotag', quiet=False, verbose=False) -- L4T_VERSION=35.5.0 JETPACK_VERSION=5.1 CUDA_VERSION=11.4 -- Finding compatible container image for ['ollama']

Found compatible container dustynv/ollama:r35.4.1 (2024-06-25, 5.4GB) - would you like to pull it? [Y/n] n

Couldn't find a compatible container for ollama, would you like to build it? [y/N] y -- Package l4t-ml has missing dependencies, disabling... ("couldn't find package: tensorflow2") -- Package l4t-tensorflow:tf1 has missing dependencies, disabling... ("couldn't find package: tensorflow") -- Package l4t-tensorflow:tf2 has missing dependencies, disabling... ("couldn't find package: tensorflow2") -- Package comfyui has missing dependencies, disabling... ("couldn't find package: torchao") -- Building containers ['build-essential', 'pip_cache:cu114', 'cuda', 'ollama'] -- Building container ollama:r35.5.0-build-essential

DOCKER_BUILDKIT=0 docker build --network=host --tag ollama:r35.5.0-build-essential \ --file /home/apulache/Workspace/jetson-containers/packages/build/build-essential/Dockerfile \ --build-arg BASE_IMAGE=nvcr.io/nvidia/l4t-jetpack:r35.4.1 \ /home/apulache/Workspace/jetson-containers/packages/build/build-essential \ 2>&1 | tee /home/apulache/Workspace/jetson-containers/logs/20241103_005258/build/ollama_r35.5.0-build-essential.txt; exit ${PIPESTATUS[0]}

DEPRECATED: The legacy builder is deprecated and will be removed in a future release. BuildKit is currently disabled; enable it by removing the DOCKER_BUILDKIT=0 environment-variable.

Sending build context to Docker daemon 19.97kB Step 1/5 : ARG BASE_IMAGE Step 2/5 : FROM ${BASE_IMAGE} ---> 5c923ac521a3 Step 3/5 : ENV DEBIAN_FRONTEND=noninteractive LANGUAGE=en_US:en LANG=en_US.UTF-8 LC_ALL=en_US.UTF-8 ---> Running in 85833e70c483 Removing intermediate container 85833e70c483 ---> 7bab7e573b8a Step 4/5 : RUN set -ex && apt-get update && apt-get install -y --no-install-recommends locales locales-all tzdata && locale-gen en_US $LANG && update-locale LC_ALL=$LC_ALL LANG=$LANG && locale && apt-get install -y --no-install-recommends build-essential software-properties-common apt-transport-https ca-certificates lsb-release pkg-config gnupg git gdb wget curl nano zip unzip time sshpass ssh-client && apt-get clean && rm -rf /var/lib/apt/lists/* && gcc --version && g++ --version ---> Running in b9b5d38123e8

Current default time zone: 'Etc/UTC' Local time is now: Sun Nov 3 05:54:14 UTC 2024. Universal Time is now: Sun Nov 3 05:54:14 UTC 2024. Run 'dpkg-reconfigure tzdata' if you wish to change it.

Removing intermediate container b9b5d38123e8 ---> 6a4277ba2c46 Step 5/5 : COPY tarpack /usr/local/bin/ ---> efa1393a01b9 Successfully built efa1393a01b9 Successfully tagged ollama:r35.5.0-build-essential -- Building container ollama:r35.5.0-pip_cache_cu114

DOCKER_BUILDKIT=0 docker build --network=host --tag ollama:r35.5.0-pip_cache_cu114 \ --file /home/apulache/Workspace/jetson-containers/packages/cuda/cuda/Dockerfile.pip \ --build-arg BASE_IMAGE=ollama:r35.5.0-build-essential \ --build-arg TAR_INDEX_URL="http://jetson.webredirect.org:8000/jp5/cu114" \ --build-arg PIP_INDEX_REPO="http://jetson.webredirect.org/jp5/cu114" \ --build-arg PIP_TRUSTED_HOSTS="jetson.webredirect.org" \ --build-arg PIP_UPLOAD_REPO="http://localhost/jp5/cu114" \ --build-arg PIP_UPLOAD_USER="jp5" \ --build-arg PIP_UPLOAD_PASS="none" \ --build-arg SCP_UPLOAD_URL="localhost:/dist/jp5/cu114" \ --build-arg SCP_UPLOAD_USER="None" \ --build-arg SCP_UPLOAD_PASS="None" \ /home/apulache/Workspace/jetson-containers/packages/cuda/cuda \ 2>&1 | tee /home/apulache/Workspace/jetson-containers/logs/20241103_005258/build/ollama_r35.5.0-pip_cache_cu114.txt; exit ${PIPESTATUS[0]}

DEPRECATED: The legacy builder is deprecated and will be removed in a future release. BuildKit is currently disabled; enable it by removing the DOCKER_BUILDKIT=0 environment-variable.

Sending build context to Docker daemon 46.59kB Step 1/4 : ARG BASE_IMAGE Step 2/4 : FROM ${BASE_IMAGE} ---> efa1393a01b9 Step 3/4 : ARG PIP_INDEX_REPO PIP_UPLOAD_REPO PIP_UPLOAD_USER PIP_UPLOAD_PASS PIP_TRUSTED_HOSTS TAR_INDEX_URL SCP_UPLOAD_URL SCP_UPLOAD_USER SCP_UPLOAD_PASS ---> Running in 0f04cea5b8d9 Removing intermediate container 0f04cea5b8d9 ---> 83face5d7fd1 Step 4/4 : ENV TAR_INDEX_URL=${TAR_INDEX_URL} PIP_INDEX_URL=${PIP_INDEX_REPO} PIP_TRUSTED_HOST=${PIP_TRUSTED_HOSTS} TWINE_REPOSITORY_URL=${PIP_UPLOAD_REPO} TWINE_USERNAME=${PIP_UPLOAD_USER} TWINE_PASSWORD=${PIP_UPLOAD_PASS} SCP_UPLOAD_URL=${SCP_UPLOAD_URL} SCP_UPLOAD_USER=${SCP_UPLOAD_USER} SCP_UPLOAD_PASS=${SCP_UPLOAD_PASS} ---> Running in edbde9bb224a Removing intermediate container edbde9bb224a ---> a84beb606048 Successfully built a84beb606048 Successfully tagged ollama:r35.5.0-pip_cache_cu114 -- Building container ollama:r35.5.0-cuda

DOCKER_BUILDKIT=0 docker build --network=host --tag ollama:r35.5.0-cuda \ --file /home/apulache/Workspace/jetson-containers/packages/cuda/cuda/Dockerfile.builtin \ --build-arg BASE_IMAGE=ollama:r35.5.0-pip_cache_cu114 \ --build-arg CUDA_ARCH_LIST="72;87" \ --build-arg DISTRO="ubuntu2004" \ /home/apulache/Workspace/jetson-containers/packages/cuda/cuda \ 2>&1 | tee /home/apulache/Workspace/jetson-containers/logs/20241103_005258/build/ollama_r35.5.0-cuda.txt; exit ${PIPESTATUS[0]}

DEPRECATED: The legacy builder is deprecated and will be removed in a future release. BuildKit is currently disabled; enable it by removing the DOCKER_BUILDKIT=0 environment-variable.

Sending build context to Docker daemon 46.59kB Step 1/6 : ARG BASE_IMAGE Step 2/6 : FROM ${BASE_IMAGE} ---> a84beb606048 Step 3/6 : ARG CUDA_ARCH_LIST DISTRO="ubuntu2004" DEBIAN_FRONTEND=noninteractive ---> Running in 22ece34404ca Removing intermediate container 22ece34404ca ---> 150d4cbe7788 Step 4/6 : ENV CUDA_HOME="/usr/local/cuda" ---> Running in 91ab35b88d0d Removing intermediate container 91ab35b88d0d ---> b19994171dfe Step 5/6 : ENV NVCC_PATH="$CUDA_HOME/bin/nvcc" ---> Running in 47bbdc66e260 Removing intermediate container 47bbdc66e260 ---> a442a5f15cbc Step 6/6 : ENV CUDAARCHS=${CUDA_ARCH_LIST} CUDA_ARCHITECTURES=${CUDA_ARCH_LIST} CUDA_HOME="/usr/local/cuda" CUDNN_LIB_PATH="/usr/lib/aarch64-linux-gnu" CUDNN_LIB_INCLUDE_PATH="/usr/include" CMAKE_CUDA_COMPILER=${NVCC_PATH} CUDA_NVCC_EXECUTABLE=${NVCC_PATH} CUDACXX=${NVCC_PATH} TORCH_NVCC_FLAGS="-Xfatbin -compress-all" CUDA_BIN_PATH="${CUDA_HOME}/bin" CUDA_TOOLKIT_ROOT_DIR="${CUDA_HOME}" PATH="$CUDA_HOME/bin:${PATH}" LD_LIBRARY_PATH="${CUDA_HOME}/compat:${CUDA_HOME}/lib64:${LD_LIBRARY_PATH}" DEBIAN_FRONTEND=noninteractive ---> Running in e1f33f11a404 Removing intermediate container e1f33f11a404 ---> f0e3d2f6e348 Successfully built f0e3d2f6e348 Successfully tagged ollama:r35.5.0-cuda -- Testing container ollama:r35.5.0-cuda (cuda:11.4/test.sh)

docker run -t --rm --runtime=nvidia --network=host \ --volume /home/apulache/Workspace/jetson-containers/packages/cuda/cuda:/test \ --volume /home/apulache/Workspace/jetson-containers/data:/data \ --workdir /test \ ollama:r35.5.0-cuda \ /bin/bash -c '/bin/bash test.sh' \ 2>&1 | tee /home/apulache/Workspace/jetson-containers/logs/20241103_005258/test/ollama_r35.5.0-cuda_test.sh.txt; exit ${PIPESTATUS[0]}

{ "cuda" : { "name" : "CUDA SDK", "version" : "11.4.19" }, "cuda_compat" : { "name" : "CUDA Specific Libraries", "version" : "11.4.31478197" }, "cuda_cudart" : { "name" : "CUDA Runtime (cudart)", "version" : "11.4.298" }, "cuda_cuobjdump" : { "name" : "cuobjdump", "version" : "11.4.315" }, "cuda_cupti" : { "name" : "CUPTI", "version" : "11.4.298" }, "cuda_cuxxfilt" : { "name" : "CUDA cu++ filt", "version" : "11.4.300" }, "cuda_gdb" : { "name" : "CUDA GDB", "version" : "11.4.298" }, "cuda_nvcc" : { "name" : "CUDA NVCC", "version" : "11.4.315" }, "cuda_nvdisasm" : { "name" : "CUDA nvdisasm", "version" : "11.4.298" }, "cuda_nvml_dev" : { "name" : "CUDA NVML Headers", "version" : "11.4.298" }, "cuda_nvprune" : { "name" : "CUDA nvprune", "version" : "11.4.298" }, "cuda_nvrtc" : { "name" : "CUDA NVRTC", "version" : "11.4.300" }, "cuda_nvtx" : { "name" : "CUDA NVTX", "version" : "11.4.300" }, "cuda_samples" : { "name" : "CUDA Samples", "version" : "11.4.300" }, "cuda_sanitizer_api" : { "name" : "CUDA Compute Sanitizer API", "version" : "11.4.298" }, "cuda_thrust" : { "name" : "CUDA C++ Core Compute Libraries", "version" : "11.4.298" }, "libcublas" : { "name" : "CUDA cuBLAS", "version" : "11.6.6.84" }, "libcudla" : { "name" : "CUDA cuDLA", "version" : "11.4.298" }, "libcufft" : { "name" : "CUDA cuFFT", "version" : "10.6.0.202" }, "libcurand" : { "name" : "CUDA cuRAND", "version" : "10.2.5.297" }, "libcusolver" : { "name" : "CUDA cuSOLVER", "version" : "11.2.0.297" }, "libcusparse" : { "name" : "CUDA cuSPARSE", "version" : "11.6.0.299" }, "libnpp" : { "name" : "CUDA NPP", "version" : "11.4.0.287" }, "nsight_compute" : { "name" : "Nsight Compute", "version" : "2021.2.8.1" } } -- Building container ollama:r35.5.0-ollama

DOCKER_BUILDKIT=0 docker build --network=host --tag ollama:r35.5.0-ollama \ --file /home/apulache/Workspace/jetson-containers/packages/llm/ollama/Dockerfile \ --build-arg BASE_IMAGE=ollama:r35.5.0-cuda \ --build-arg OLLAMA_REPO="ollama/ollama" \ --build-arg OLLAMA_BRANCH="main" \ --build-arg GOLANG_VERSION="1.22.1" \ --build-arg CMAKE_VERSION="3.22.1" \ --build-arg JETPACK_VERSION="5.1" \ --build-arg CMAKE_CUDA_ARCHITECTURES="72;87" \ /home/apulache/Workspace/jetson-containers/packages/llm/ollama \ 2>&1 | tee /home/apulache/Workspace/jetson-containers/logs/20241103_005258/build/ollama_r35.5.0-ollama.txt; exit ${PIPESTATUS[0]}

DEPRECATED: The legacy builder is deprecated and will be removed in a future release. BuildKit is currently disabled; enable it by removing the DOCKER_BUILDKIT=0 environment-variable.

Sending build context to Docker daemon 29.7kB Step 1/17 : ARG BASE_IMAGE CMAKE_CUDA_ARCHITECTURES JETPACK_VERSION OLLAMA_REPO OLLAMA_BRANCH GOLANG_VERSION CMAKE_VERSION Step 2/17 : FROM ${BASE_IMAGE} AS ollama-l4t-build ---> f0e3d2f6e348 Step 3/17 : ARG OLLAMA_REPO OLLAMA_BRANCH GOLANG_VERSION CMAKE_VERSION CMAKE_CUDA_ARCHITECTURES ---> Running in 788f1df0458c Removing intermediate container 788f1df0458c ---> 4ac032ef319d Step 4/17 : ADD https://api.github.com/repos/${OLLAMA_REPO}/git/refs/heads/${OLLAMA_BRANCH} /tmp/ollama_version.json

---> 46150f663673 Step 5/17 : RUN git clone --branch=${OLLAMA_BRANCH} --depth=1 --recursive https://github.com/${OLLAMA_REPO} /opt/ollama ---> Running in 27215777ae9e Cloning into '/opt/ollama'... Removing intermediate container 27215777ae9e ---> f04f66ff5b88 Step 6/17 : COPY ollama_deps.sh /opt/ollama_deps.sh ---> b083aa5bc2f0 Step 7/17 : RUN CMAKE_VERSION=${CMAKE_VERSION} GOLANG_VERSION=${GOLANG_VERSION} sh /opt/ollama_deps.sh ---> Running in d2feb82aa2ea

WARNING: apt does not have a stable CLI interface. Use with caution in scripts.

Get:1 https://repo.download.nvidia.com/jetson/common r35.4 InRelease [2,555 B] Get:2 http://ports.ubuntu.com/ubuntu-ports focal InRelease [265 kB] Get:3 https://repo.download.nvidia.com/jetson/common r35.4/main arm64 Packages [19.6 kB] Get:4 http://ports.ubuntu.com/ubuntu-ports focal-updates InRelease [128 kB] Get:5 http://ports.ubuntu.com/ubuntu-ports focal-backports InRelease [128 kB] Get:6 http://ports.ubuntu.com/ubuntu-ports focal-security InRelease [128 kB] Get:7 http://ports.ubuntu.com/ubuntu-ports focal/multiverse arm64 Packages [139 kB] Get:8 http://ports.ubuntu.com/ubuntu-ports focal/universe arm64 Packages [11.1 MB] Get:9 http://ports.ubuntu.com/ubuntu-ports focal/main arm64 Packages [1,234 kB] Get:10 http://ports.ubuntu.com/ubuntu-ports focal/restricted arm64 Packages [1,317 B] Get:11 http://ports.ubuntu.com/ubuntu-ports focal-updates/universe arm64 Packages [1,467 kB] Get:12 http://ports.ubuntu.com/ubuntu-ports focal-updates/main arm64 Packages [3,488 kB] Get:13 http://ports.ubuntu.com/ubuntu-ports focal-updates/multiverse arm64 Packages [12.0 kB] Get:14 http://ports.ubuntu.com/ubuntu-ports focal-updates/restricted arm64 Packages [60.3 kB] Get:15 http://ports.ubuntu.com/ubuntu-ports focal-backports/main arm64 Packages [54.8 kB] Get:16 http://ports.ubuntu.com/ubuntu-ports focal-backports/universe arm64 Packages [27.8 kB] Get:17 http://ports.ubuntu.com/ubuntu-ports focal-security/main arm64 Packages [3,113 kB] Get:18 http://ports.ubuntu.com/ubuntu-ports focal-security/restricted arm64 Packages [60.0 kB] Get:19 http://ports.ubuntu.com/ubuntu-ports focal-security/multiverse arm64 Packages [5,907 B] Get:20 http://ports.ubuntu.com/ubuntu-ports focal-security/universe arm64 Packages [1,176 kB] Fetched 22.6 MB in 6s (3,583 kB/s) Reading package lists... Building dependency tree... Reading state information... 143 packages can be upgraded. Run 'apt list --upgradable' to see them.

WARNING: apt does not have a stable CLI interface. Use with caution in scripts.

Reading package lists... Building dependency tree... Reading state information... ca-certificates is already the newest version (20240203~20.04.1). git is already the newest version (1:2.25.1-1ubuntu3.13). The following additional packages will be installed: cpp-10 gcc-10-base libasan6 libatomic1 libcc1-0 libgcc-10-dev libgcc-s1 libgfortran5 libgomp1 libitm1 liblsan0 libstdc++-10-dev libstdc++6 libtsan0 libubsan1 Suggested packages: gcc-10-locales gcc-10-doc libstdc++-10-doc The following NEW packages will be installed: cpp-10 g++-10 gcc-10 libasan6 libgcc-10-dev libstdc++-10-dev The following packages will be upgraded: gcc-10-base libatomic1 libcc1-0 libgcc-s1 libgfortran5 libgomp1 libitm1 liblsan0 libstdc++6 libtsan0 libubsan1 11 upgraded, 6 newly installed, 0 to remove and 132 not upgraded. Need to get 41.8 MB of archives. After this operation, 134 MB of additional disk space will be used. Get:1 http://ports.ubuntu.com/ubuntu-ports focal-updates/main arm64 libatomic1 arm64 10.5.0-1ubuntu1~20.04 [9,808 B] Get:2 http://ports.ubuntu.com/ubuntu-ports focal-updates/main arm64 libubsan1 arm64 10.5.0-1ubuntu1~20.04 [765 kB] Get:3 http://ports.ubuntu.com/ubuntu-ports focal-updates/main arm64 libtsan0 arm64 10.5.0-1ubuntu1~20.04 [1,972 kB] Get:4 http://ports.ubuntu.com/ubuntu-ports focal-updates/main arm64 gcc-10-base arm64 10.5.0-1ubuntu1~20.04 [20.8 kB] Get:5 http://ports.ubuntu.com/ubuntu-ports focal-updates/main arm64 libstdc++6 arm64 10.5.0-1ubuntu1~20.04 [461 kB] Get:6 http://ports.ubuntu.com/ubuntu-ports focal-updates/main arm64 liblsan0 arm64 10.5.0-1ubuntu1~20.04 [800 kB] Get:7 http://ports.ubuntu.com/ubuntu-ports focal-updates/main arm64 libitm1 arm64 10.5.0-1ubuntu1~20.04 [24.1 kB] Get:8 http://ports.ubuntu.com/ubuntu-ports focal-updates/main arm64 libgomp1 arm64 10.5.0-1ubuntu1~20.04 [93.5 kB] Get:9 http://ports.ubuntu.com/ubuntu-ports focal-updates/main arm64 libgfortran5 arm64 10.5.0-1ubuntu1~20.04 [346 kB] Get:10 http://ports.ubuntu.com/ubuntu-ports focal-updates/main arm64 libcc1-0 arm64 10.5.0-1ubuntu1~20.04 [46.2 kB] Get:11 http://ports.ubuntu.com/ubuntu-ports focal-updates/main arm64 libgcc-s1 arm64 10.5.0-1ubuntu1~20.04 [34.6 kB] Get:12 http://ports.ubuntu.com/ubuntu-ports focal-updates/universe arm64 cpp-10 arm64 10.5.0-1ubuntu1~20.04 [7,794 kB] Get:13 http://ports.ubuntu.com/ubuntu-ports focal-updates/main arm64 libasan6 arm64 10.5.0-1ubuntu1~20.04 [2,027 kB] Get:14 http://ports.ubuntu.com/ubuntu-ports focal-updates/main arm64 libgcc-10-dev arm64 10.5.0-1ubuntu1~20.04 [907 kB] Get:15 http://ports.ubuntu.com/ubuntu-ports focal-updates/universe arm64 gcc-10 arm64 10.5.0-1ubuntu1~20.04 [15.8 MB] Get:16 http://ports.ubuntu.com/ubuntu-ports focal-updates/universe arm64 libstdc++-10-dev arm64 10.5.0-1ubuntu1~20.04 [1,746 kB] Get:17 http://ports.ubuntu.com/ubuntu-ports focal-updates/universe arm64 g++-10 arm64 10.5.0-1ubuntu1~20.04 [8,948 kB] debconf: delaying package configuration, since apt-utils is not installed Fetched 41.8 MB in 6s (6,469 kB/s) (Reading database ... 52689 files and directories currently installed.) Preparing to unpack .../libatomic1_10.5.0-1ubuntu1~20.04_arm64.deb ... Unpacking libatomic1:arm64 (10.5.0-1ubuntu1~20.04) over (10.3.0-1ubuntu1~20.04) ... Preparing to unpack .../libubsan1_10.5.0-1ubuntu1~20.04_arm64.deb ... Unpacking libubsan1:arm64 (10.5.0-1ubuntu1~20.04) over (10.3.0-1ubuntu1~20.04) ... Preparing to unpack .../libtsan0_10.5.0-1ubuntu1~20.04_arm64.deb ... Unpacking libtsan0:arm64 (10.5.0-1ubuntu1~20.04) over (10.3.0-1ubuntu1~20.04) ... Preparing to unpack .../gcc-10-base_10.5.0-1ubuntu1~20.04_arm64.deb ... Unpacking gcc-10-base:arm64 (10.5.0-1ubuntu1~20.04) over (10.3.0-1ubuntu1~20.04) ... Setting up gcc-10-base:arm64 (10.5.0-1ubuntu1~20.04) ... (Reading database ... 52688 files and directories currently installed.) Preparing to unpack .../libstdc++6_10.5.0-1ubuntu1~20.04_arm64.deb ... Unpacking libstdc++6:arm64 (10.5.0-1ubuntu1~20.04) over (10.3.0-1ubuntu1~20.04) ... Setting up libstdc++6:arm64 (10.5.0-1ubuntu1~20.04) ... (Reading database ... 52688 files and directories currently installed.) Preparing to unpack .../0-liblsan0_10.5.0-1ubuntu1~20.04_arm64.deb ... Unpacking liblsan0:arm64 (10.5.0-1ubuntu1~20.04) over (10.3.0-1ubuntu1~20.04) ... Preparing to unpack .../1-libitm1_10.5.0-1ubuntu1~20.04_arm64.deb ... Unpacking libitm1:arm64 (10.5.0-1ubuntu1~20.04) over (10.3.0-1ubuntu1~20.04) ... Preparing to unpack .../2-libgomp1_10.5.0-1ubuntu1~20.04_arm64.deb ... Unpacking libgomp1:arm64 (10.5.0-1ubuntu1~20.04) over (10.3.0-1ubuntu1~20.04) ... Preparing to unpack .../3-libgfortran5_10.5.0-1ubuntu1~20.04_arm64.deb ... Unpacking libgfortran5:arm64 (10.5.0-1ubuntu1~20.04) over (10.3.0-1ubuntu1~20.04) ... Preparing to unpack .../4-libcc1-0_10.5.0-1ubuntu1~20.04_arm64.deb ... Unpacking libcc1-0:arm64 (10.5.0-1ubuntu1~20.04) over (10.3.0-1ubuntu1~20.04) ... Preparing to unpack .../5-libgcc-s1_10.5.0-1ubuntu1~20.04_arm64.deb ... Unpacking libgcc-s1:arm64 (10.5.0-1ubuntu1~20.04) over (10.3.0-1ubuntu1~20.04) ... Setting up libgcc-s1:arm64 (10.5.0-1ubuntu1~20.04) ... Selecting previously unselected package cpp-10. (Reading database ... 52688 files and directories currently installed.) Preparing to unpack .../0-cpp-10_10.5.0-1ubuntu1~20.04_arm64.deb ... Unpacking cpp-10 (10.5.0-1ubuntu1~20.04) ... Selecting previously unselected package libasan6:arm64. Preparing to unpack .../1-libasan6_10.5.0-1ubuntu1~20.04_arm64.deb ... Unpacking libasan6:arm64 (10.5.0-1ubuntu1~20.04) ... Selecting previously unselected package libgcc-10-dev:arm64. Preparing to unpack .../2-libgcc-10-dev_10.5.0-1ubuntu1~20.04_arm64.deb ... Unpacking libgcc-10-dev:arm64 (10.5.0-1ubuntu1~20.04) ... Selecting previously unselected package gcc-10. Preparing to unpack .../3-gcc-10_10.5.0-1ubuntu1~20.04_arm64.deb ... Unpacking gcc-10 (10.5.0-1ubuntu1~20.04) ... Selecting previously unselected package libstdc++-10-dev:arm64. Preparing to unpack .../4-libstdc++-10-dev_10.5.0-1ubuntu1~20.04_arm64.deb ... Unpacking libstdc++-10-dev:arm64 (10.5.0-1ubuntu1~20.04) ... Selecting previously unselected package g++-10. Preparing to unpack .../5-g++-10_10.5.0-1ubuntu1~20.04_arm64.deb ... Unpacking g++-10 (10.5.0-1ubuntu1~20.04) ... Setting up libgomp1:arm64 (10.5.0-1ubuntu1~20.04) ... Setting up libasan6:arm64 (10.5.0-1ubuntu1~20.04) ... Setting up libatomic1:arm64 (10.5.0-1ubuntu1~20.04) ... Setting up libgfortran5:arm64 (10.5.0-1ubuntu1~20.04) ... Setting up libubsan1:arm64 (10.5.0-1ubuntu1~20.04) ... Setting up libcc1-0:arm64 (10.5.0-1ubuntu1~20.04) ... Setting up liblsan0:arm64 (10.5.0-1ubuntu1~20.04) ... Setting up cpp-10 (10.5.0-1ubuntu1~20.04) ... Setting up libitm1:arm64 (10.5.0-1ubuntu1~20.04) ... Setting up libtsan0:arm64 (10.5.0-1ubuntu1~20.04) ... Setting up libgcc-10-dev:arm64 (10.5.0-1ubuntu1~20.04) ... Setting up gcc-10 (10.5.0-1ubuntu1~20.04) ... Setting up libstdc++-10-dev:arm64 (10.5.0-1ubuntu1~20.04) ... Setting up g++-10 (10.5.0-1ubuntu1~20.04) ... Processing triggers for libc-bin (2.31-0ubuntu9.9) ...

Usage: docker run [OPTIONS] IMAGE [COMMAND] [ARG...]

Create and run a new container from an image

dusty-nv commented 13 hours ago

Hi @apulache, ollama updated their build process in https://github.com/ollama/ollama/commit/b754f5a6a36d6f3068e938af525d8b056c7f9bce#diff-76ed074a9305c04054cdebb9e9aad2d818052b07091de1f20cad0bbac34ffb52 , and I just updated jetson-containers for it with https://github.com/dusty-nv/jetson-containers/commit/43406820000146896b72ec946d93ac0f60343ce0 - let me know if you encounter additional errors after pulling the latest :+1: