Closed bert269 closed 1 year ago
I don't think the container library supports Ubuntu 23.04. Per the documentation at https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/install-guide.html:
Shoot!...... Thanks....
And by the way, when I went BACK to the documentation, this is what I saw: For CUDA support you will need to have the NVIDIA drivers for your supported hardware installed.
Shoot!...... Thanks....
And by the way, when I went BACK to the documentation, this is what I saw: For CUDA support you will need to have the NVIDIA drivers for your supported hardware installed.
Yeah so the host that will be running the container would need to have the legit NVIDIA drivers installed, most people are using 530 or better, I am using 530.41.03 presently.
First install on a ne Ubuntu 2304 server. When running ./deps/ubuntu.sh, I get this:
bert@wis:~/willow-inference-server$ ./deps/ubuntu.sh % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 100 21926 100 21926 0 0 86801 0 --:--:-- --:--:-- --:--:-- 87007
Executing docker install script, commit: c2de0811708b6d9015ed1a2c80f02c9b70c8ce7b
Server: Docker Engine - Community Engine: Version: 24.0.2 API version: 1.43 (minimum version 1.12) Go version: go1.20.4 Git commit: 659604f Built: Thu May 25 21:52:14 2023 OS/Arch: linux/amd64 Experimental: false containerd: Version: 1.6.21 GitCommit: 3dce8eb055cbb6872793272b4f20ed16117344f8 runc: Version: 1.1.7 GitCommit: v1.1.7-0-g860f061 docker-init: Version: 0.19.0 GitCommit: de40ad0
================================================================================
To run Docker as a non-privileged user, consider setting up the Docker daemon in rootless mode for your user:
Visit https://docs.docker.com/go/rootless/ to learn about rootless mode.
To run the Docker daemon as a fully privileged service, but granting non-root users access, refer to https://docs.docker.com/go/daemon-access/
WARNING: Access to the remote API on a privileged Docker daemon is equivalent to root access on the host. Refer to the 'Docker daemon attack surface' documentation for details: https://docs.docker.com/go/attack-surface/
================================================================================
Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install. Executing: /lib/systemd/systemd-sysv-install enable docker # Unsupported distribution! Check https://nvidia.github.io/libnvidia-container Hit:1 https://download.docker.com/linux/ubuntu lunar InRelease Hit:2 http://us.archive.ubuntu.com/ubuntu lunar InRelease Hit:3 http://us.archive.ubuntu.com/ubuntu lunar-updates InRelease Hit:4 http://us.archive.ubuntu.com/ubuntu lunar-backports InRelease Hit:5 http://us.archive.ubuntu.com/ubuntu lunar-security InRelease Reading package lists... Done Reading package lists... Done Building dependency tree... Done Reading state information... Done E: Unable to locate package nvidia-container-toolkit
The installation instructions refer to: "Ensure you have nvidia-container-toolkit and not nvidia-docker On Arch Linux: yay -S libnvidia-container-tools libnvidia-container nvidia-container-toolkit docker-buildx" Does this mean for ubuntu also, or jsut Arch Linux?
When I do: sudo apt install libnvidia-container-tools libnvidia-container nvidia-container-toolkit docker-buildx -y Reading package lists... Done Building dependency tree... Done Reading state information... Done E: Unable to locate package libnvidia-container-tools E: Unable to locate package libnvidia-container E: Unable to locate package nvidia-container-toolkit E: Unable to locate package docker-buildx
Am I missing something obvious?