No output when running nvidia-smi with docker

[xxRockOnxx]

For context:

Model: GTX 1660 Ti Driver version: 510.60.02 CUDA version: 11.6 nvidia-container-toolkit version: 1.9.0 nvidia-container-runtime version: 3.9.0

OS: Arch Kernel: 5.17.3-arch1-1

When running the following commands:

• docker run --rm --gpus all nvidia/cuda:11.6.2-runtime-ubuntu20.04 nvidia-smi
• docker run --runtime=nvidia -e NVIDIA_VISIBLE_DEVICES=all nvidia/cuda:11.6.2-runtime-ubuntu20.04 nvidia-smi -L
• docker run --rm --gpus '"device=0"' --device /dev/nvidia-caps --device /dev/nvidia0 --device /dev/nvidiactl --device /dev/nvidia-modeset --device /dev/nvidia-uvm --device /dev/nvidia-uvm-tools nvidia/cuda:11.0.3-base-ubuntu20.04 nvidia-smi

gives no output. It's hard to figure what's happening because even an error isn't being given.

I tried the following:

• setting systemd.unified_cgroup_hierarchy=false
• setting no-cgroups = false in /etc/nvidia-container-runtime/config.toml
• setting user in /etc/nvidia-container-runtime/config.toml as mentioned in https://github.com/NVIDIA/nvidia-docker/issues/850
• creating /etc/docker/daemon.json as mentioned in https://github.com/NVIDIA/nvidia-container-toolkit/issues/12

Related issues:

• https://github.com/NVIDIA/nvidia-container-toolkit/issues/12 but was closed without any solution
• https://github.com/NVIDIA/nvidia-docker/issues/1582 but no response yet

Guide tried: https://forum.manjaro.org/t/howto-installing-docker-and-nvidia-runtime-my-experience-and-howto/97017

I'm ran out of things to try at this point.

[elezar]

@xxRockOnxx could you uncomment the #debug = lines in /etc/nvidia-container-runtime/config.toml repeat one of the tests and attach the contents of /var/log/nvidia-container-toolkit.log and (if it exists -- depending on the test) /var/log/nvidia-container-runtime.log?

[xxRockOnxx]

Here's the requested log:

``` -- WARNING, the following logs are for debugging purposes only -- I0525 12:44:32.586914 383591 nvc.c:376] initializing library context (version=1.9.0, build=0000000000000000000000000000000000000000) I0525 12:44:32.587045 383591 nvc.c:350] using root / I0525 12:44:32.587071 383591 nvc.c:351] using ldcache /etc/ld.so.cache I0525 12:44:32.587094 383591 nvc.c:352] using unprivileged user 0:0 I0525 12:44:32.587150 383591 nvc.c:393] attempting to load dxcore to see if we are running under Windows Subsystem for Linux (WSL) I0525 12:44:32.587389 383591 nvc.c:395] dxcore initialization failed, continuing assuming a non-WSL environment I0525 12:44:32.590416 383597 nvc.c:278] loading kernel module nvidia I0525 12:44:32.590900 383597 nvc.c:282] running mknod for /dev/nvidiactl I0525 12:44:32.591000 383597 nvc.c:286] running mknod for /dev/nvidia0 I0525 12:44:32.591075 383597 nvc.c:290] running mknod for all nvcaps in /dev/nvidia-caps I0525 12:44:32.606198 383597 nvc.c:218] running mknod for /dev/nvidia-caps/nvidia-cap1 from /proc/driver/nvidia/capabilities/mig/config I0525 12:44:32.606521 383597 nvc.c:218] running mknod for /dev/nvidia-caps/nvidia-cap2 from /proc/driver/nvidia/capabilities/mig/monitor I0525 12:44:32.612073 383597 nvc.c:296] loading kernel module nvidia_uvm I0525 12:44:32.612319 383597 nvc.c:300] running mknod for /dev/nvidia-uvm I0525 12:44:32.612536 383597 nvc.c:305] loading kernel module nvidia_modeset I0525 12:44:32.612790 383597 nvc.c:309] running mknod for /dev/nvidia-modeset I0525 12:44:32.613591 383598 rpc.c:71] starting driver rpc service I0525 12:44:32.632390 383599 rpc.c:71] starting nvcgo rpc service I0525 12:44:32.641648 383591 nvc_container.c:240] configuring container with 'compute utility supervised' I0525 12:44:32.643515 383591 nvc_container.c:88] selecting /var/lib/docker/btrfs/subvolumes/fa72427ba5b74f1aa4b6d082a8cb37272bfb6de2fdde4ec9a2b29714ad35fb39/usr/local/cuda-11.6/compat/libcuda.so.510.47.03 I0525 12:44:32.644213 383591 nvc_container.c:88] selecting /var/lib/docker/btrfs/subvolumes/fa72427ba5b74f1aa4b6d082a8cb37272bfb6de2fdde4ec9a2b29714ad35fb39/usr/local/cuda-11.6/compat/libnvidia-nvvm.so.4.0.0 I0525 12:44:32.644823 383591 nvc_container.c:88] selecting /var/lib/docker/btrfs/subvolumes/fa72427ba5b74f1aa4b6d082a8cb37272bfb6de2fdde4ec9a2b29714ad35fb39/usr/local/cuda-11.6/compat/libnvidia-ptxjitcompiler.so.510.47.03 I0525 12:44:32.645913 383591 nvc_container.c:262] setting pid to 383585 I0525 12:44:32.645972 383591 nvc_container.c:263] setting rootfs to /var/lib/docker/btrfs/subvolumes/fa72427ba5b74f1aa4b6d082a8cb37272bfb6de2fdde4ec9a2b29714ad35fb39 I0525 12:44:32.645998 383591 nvc_container.c:264] setting owner to 0:0 I0525 12:44:32.646022 383591 nvc_container.c:265] setting bins directory to /usr/bin I0525 12:44:32.646046 383591 nvc_container.c:266] setting libs directory to /usr/lib/x86_64-linux-gnu I0525 12:44:32.646070 383591 nvc_container.c:267] setting libs32 directory to /usr/lib/i386-linux-gnu I0525 12:44:32.646093 383591 nvc_container.c:268] setting cudart directory to /usr/local/cuda I0525 12:44:32.646117 383591 nvc_container.c:269] setting ldconfig to @/sbin/ldconfig (host relative) I0525 12:44:32.646141 383591 nvc_container.c:270] setting mount namespace to /proc/383585/ns/mnt I0525 12:44:32.646164 383591 nvc_container.c:272] detected cgroupv1 I0525 12:44:32.646188 383591 nvc_container.c:273] setting devices cgroup to /sys/fs/cgroup/devices/docker/829aa15b103957bab6022d8614706836bb8e36f2198759edc39f17f69670409e I0525 12:44:32.646226 383591 nvc_info.c:765] requesting driver information with '' I0525 12:44:32.654610 383591 nvc_info.c:172] selecting /usr/lib/libnvoptix.so.510.60.02 I0525 12:44:32.654968 383591 nvc_info.c:172] selecting /usr/lib/libnvidia-tls.so.510.60.02 I0525 12:44:32.664110 383591 nvc_info.c:172] selecting /usr/lib/libnvidia-rtcore.so.510.60.02 I0525 12:44:32.669545 383591 nvc_info.c:172] selecting /usr/lib/libnvidia-ptxjitcompiler.so.510.60.02 I0525 12:44:32.674833 383591 nvc_info.c:172] selecting /usr/lib/libnvidia-opticalflow.so.510.60.02 I0525 12:44:32.682276 383591 nvc_info.c:172] selecting /usr/lib/libnvidia-opencl.so.510.60.02 I0525 12:44:32.687056 383591 nvc_info.c:172] selecting /usr/lib/libnvidia-ngx.so.510.60.02 I0525 12:44:32.687366 383591 nvc_info.c:172] selecting /usr/lib/libnvidia-ml.so.510.60.02 I0525 12:44:32.687565 383591 nvc_info.c:172] selecting /usr/lib/libnvidia-glvkspirv.so.510.60.02 I0525 12:44:32.687771 383591 nvc_info.c:172] selecting /usr/lib/libnvidia-glsi.so.510.60.02 I0525 12:44:32.687966 383591 nvc_info.c:172] selecting /usr/lib/libnvidia-glcore.so.510.60.02 I0525 12:44:32.690750 383591 nvc_info.c:172] selecting /usr/lib/libnvidia-fbc.so.510.60.02 I0525 12:44:32.692732 383591 nvc_info.c:172] selecting /usr/lib/libnvidia-encode.so.510.60.02 I0525 12:44:32.693016 383591 nvc_info.c:172] selecting /usr/lib/libnvidia-eglcore.so.510.60.02 I0525 12:44:32.700601 383591 nvc_info.c:172] selecting /usr/lib/libnvidia-compiler.so.510.60.02 I0525 12:44:32.706489 383591 nvc_info.c:172] selecting /usr/lib/libnvidia-cfg.so.510.60.02 I0525 12:44:32.707789 383591 nvc_info.c:172] selecting /usr/lib/libnvidia-allocator.so.510.60.02 I0525 12:44:32.712580 383591 nvc_info.c:172] selecting /usr/lib/libnvcuvid.so.510.60.02 I0525 12:44:32.714920 383591 nvc_info.c:172] selecting /usr/lib/libcuda.so.510.60.02 I0525 12:44:32.716287 383591 nvc_info.c:172] selecting /usr/lib/libGLX_nvidia.so.510.60.02 I0525 12:44:32.717425 383591 nvc_info.c:172] selecting /usr/lib/libGLESv2_nvidia.so.510.60.02 I0525 12:44:32.718395 383591 nvc_info.c:172] selecting /usr/lib/libGLESv1_CM_nvidia.so.510.60.02 I0525 12:44:32.718657 383591 nvc_info.c:172] selecting /usr/lib/libEGL_nvidia.so.510.60.02 I0525 12:44:32.720032 383591 nvc_info.c:172] selecting /usr/lib32/libnvidia-tls.so.510.60.02 I0525 12:44:32.730194 383591 nvc_info.c:172] selecting /usr/lib32/libnvidia-ptxjitcompiler.so.510.60.02 I0525 12:44:32.732326 383591 nvc_info.c:172] selecting /usr/lib32/libnvidia-opticalflow.so.510.60.02 I0525 12:44:32.735604 383591 nvc_info.c:172] selecting /usr/lib32/libnvidia-ml.so.510.60.02 I0525 12:44:32.745732 383591 nvc_info.c:172] selecting /usr/lib32/libnvidia-glvkspirv.so.510.60.02 I0525 12:44:32.747959 383591 nvc_info.c:172] selecting /usr/lib32/libnvidia-glsi.so.510.60.02 I0525 12:44:32.756424 383591 nvc_info.c:172] selecting /usr/lib32/libnvidia-glcore.so.510.60.02 I0525 12:44:32.758090 383591 nvc_info.c:172] selecting /usr/lib32/libnvidia-fbc.so.510.60.02 I0525 12:44:32.759430 383591 nvc_info.c:172] selecting /usr/lib32/libnvidia-encode.so.510.60.02 I0525 12:44:32.767521 383591 nvc_info.c:172] selecting /usr/lib32/libnvidia-eglcore.so.510.60.02 I0525 12:44:32.768919 383591 nvc_info.c:172] selecting /usr/lib32/libnvidia-allocator.so.510.60.02 I0525 12:44:32.776565 383591 nvc_info.c:172] selecting /usr/lib32/libnvcuvid.so.510.60.02 I0525 12:44:32.784956 383591 nvc_info.c:172] selecting /usr/lib32/libcuda.so.510.60.02 I0525 12:44:32.789126 383591 nvc_info.c:172] selecting /usr/lib32/libGLX_nvidia.so.510.60.02 I0525 12:44:32.790539 383591 nvc_info.c:172] selecting /usr/lib32/libGLESv2_nvidia.so.510.60.02 I0525 12:44:32.791512 383591 nvc_info.c:172] selecting /usr/lib32/libGLESv1_CM_nvidia.so.510.60.02 I0525 12:44:32.794726 383591 nvc_info.c:172] selecting /usr/lib32/libEGL_nvidia.so.510.60.02 W0525 12:44:32.794949 383591 nvc_info.c:398] missing library libnvidia-nscq.so W0525 12:44:32.794995 383591 nvc_info.c:398] missing library libnvidia-fatbinaryloader.so W0525 12:44:32.795022 383591 nvc_info.c:398] missing library libnvidia-pkcs11.so W0525 12:44:32.795049 383591 nvc_info.c:398] missing library libvdpau_nvidia.so W0525 12:44:32.795076 383591 nvc_info.c:398] missing library libnvidia-ifr.so W0525 12:44:32.795113 383591 nvc_info.c:398] missing library libnvidia-cbl.so W0525 12:44:32.795156 383591 nvc_info.c:402] missing compat32 library libnvidia-cfg.so W0525 12:44:32.795202 383591 nvc_info.c:402] missing compat32 library libnvidia-nscq.so W0525 12:44:32.795244 383591 nvc_info.c:402] missing compat32 library libnvidia-opencl.so W0525 12:44:32.795286 383591 nvc_info.c:402] missing compat32 library libnvidia-fatbinaryloader.so W0525 12:44:32.795356 383591 nvc_info.c:402] missing compat32 library libnvidia-compiler.so W0525 12:44:32.795399 383591 nvc_info.c:402] missing compat32 library libnvidia-pkcs11.so W0525 12:44:32.795441 383591 nvc_info.c:402] missing compat32 library libnvidia-ngx.so W0525 12:44:32.795482 383591 nvc_info.c:402] missing compat32 library libvdpau_nvidia.so W0525 12:44:32.795525 383591 nvc_info.c:402] missing compat32 library libnvidia-ifr.so W0525 12:44:32.795566 383591 nvc_info.c:402] missing compat32 library libnvidia-rtcore.so W0525 12:44:32.795608 383591 nvc_info.c:402] missing compat32 library libnvoptix.so W0525 12:44:32.795650 383591 nvc_info.c:402] missing compat32 library libnvidia-cbl.so I0525 12:44:32.796411 383591 nvc_info.c:298] selecting /usr/bin/nvidia-smi I0525 12:44:32.796528 383591 nvc_info.c:298] selecting /usr/bin/nvidia-debugdump I0525 12:44:32.796627 383591 nvc_info.c:298] selecting /usr/bin/nvidia-persistenced I0525 12:44:32.796770 383591 nvc_info.c:298] selecting /usr/bin/nvidia-cuda-mps-control I0525 12:44:32.796868 383591 nvc_info.c:298] selecting /usr/bin/nvidia-cuda-mps-server W0525 12:44:32.797189 383591 nvc_info.c:424] missing binary nv-fabricmanager I0525 12:44:32.798246 383591 nvc_info.c:342] listing firmware path /usr/lib/firmware/nvidia/510.60.02/gsp.bin I0525 12:44:32.798356 383591 nvc_info.c:528] listing device /dev/nvidiactl I0525 12:44:32.798387 383591 nvc_info.c:528] listing device /dev/nvidia-uvm I0525 12:44:32.798413 383591 nvc_info.c:528] listing device /dev/nvidia-uvm-tools I0525 12:44:32.798439 383591 nvc_info.c:528] listing device /dev/nvidia-modeset W0525 12:44:32.798527 383591 nvc_info.c:348] missing ipc path /var/run/nvidia-persistenced/socket W0525 12:44:32.798614 383591 nvc_info.c:348] missing ipc path /var/run/nvidia-fabricmanager/socket W0525 12:44:32.798682 383591 nvc_info.c:348] missing ipc path /tmp/nvidia-mps I0525 12:44:32.798714 383591 nvc_info.c:821] requesting device information with '' I0525 12:44:32.807108 383591 nvc_info.c:712] listing device /dev/nvidia0 (GPU-d1e79d9c-2a4a-bf69-12b2-86ad1a59b472 at 00000000:01:00.0) I0525 12:44:32.807377 383591 nvc_mount.c:366] mounting tmpfs at /var/lib/docker/btrfs/subvolumes/fa72427ba5b74f1aa4b6d082a8cb37272bfb6de2fdde4ec9a2b29714ad35fb39/proc/driver/nvidia I0525 12:44:32.809249 383591 nvc_mount.c:134] mounting /usr/bin/nvidia-smi at /var/lib/docker/btrfs/subvolumes/fa72427ba5b74f1aa4b6d082a8cb37272bfb6de2fdde4ec9a2b29714ad35fb39/usr/bin/nvidia-smi I0525 12:44:32.809445 383591 nvc_mount.c:134] mounting /usr/bin/nvidia-debugdump at /var/lib/docker/btrfs/subvolumes/fa72427ba5b74f1aa4b6d082a8cb37272bfb6de2fdde4ec9a2b29714ad35fb39/usr/bin/nvidia-debugdump I0525 12:44:32.809609 383591 nvc_mount.c:134] mounting /usr/bin/nvidia-persistenced at /var/lib/docker/btrfs/subvolumes/fa72427ba5b74f1aa4b6d082a8cb37272bfb6de2fdde4ec9a2b29714ad35fb39/usr/bin/nvidia-persistenced I0525 12:44:32.810342 383591 nvc_mount.c:134] mounting /usr/bin/nvidia-cuda-mps-control at /var/lib/docker/btrfs/subvolumes/fa72427ba5b74f1aa4b6d082a8cb37272bfb6de2fdde4ec9a2b29714ad35fb39/usr/bin/nvidia-cuda-mps-control I0525 12:44:32.810598 383591 nvc_mount.c:134] mounting /usr/bin/nvidia-cuda-mps-server at /var/lib/docker/btrfs/subvolumes/fa72427ba5b74f1aa4b6d082a8cb37272bfb6de2fdde4ec9a2b29714ad35fb39/usr/bin/nvidia-cuda-mps-server I0525 12:44:32.812727 383591 nvc_mount.c:134] mounting /usr/lib/libnvidia-ml.so.510.60.02 at /var/lib/docker/btrfs/subvolumes/fa72427ba5b74f1aa4b6d082a8cb37272bfb6de2fdde4ec9a2b29714ad35fb39/usr/lib/x86_64-linux-gnu/libnvidia-ml.so.510.60.02 I0525 12:44:32.812910 383591 nvc_mount.c:134] mounting /usr/lib/libnvidia-cfg.so.510.60.02 at /var/lib/docker/btrfs/subvolumes/fa72427ba5b74f1aa4b6d082a8cb37272bfb6de2fdde4ec9a2b29714ad35fb39/usr/lib/x86_64-linux-gnu/libnvidia-cfg.so.510.60.02 I0525 12:44:32.813072 383591 nvc_mount.c:134] mounting /usr/lib/libcuda.so.510.60.02 at /var/lib/docker/btrfs/subvolumes/fa72427ba5b74f1aa4b6d082a8cb37272bfb6de2fdde4ec9a2b29714ad35fb39/usr/lib/x86_64-linux-gnu/libcuda.so.510.60.02 I0525 12:44:32.813638 383591 nvc_mount.c:134] mounting /usr/lib/libnvidia-opencl.so.510.60.02 at /var/lib/docker/btrfs/subvolumes/fa72427ba5b74f1aa4b6d082a8cb37272bfb6de2fdde4ec9a2b29714ad35fb39/usr/lib/x86_64-linux-gnu/libnvidia-opencl.so.510.60.02 I0525 12:44:32.813863 383591 nvc_mount.c:134] mounting /usr/lib/libnvidia-ptxjitcompiler.so.510.60.02 at /var/lib/docker/btrfs/subvolumes/fa72427ba5b74f1aa4b6d082a8cb37272bfb6de2fdde4ec9a2b29714ad35fb39/usr/lib/x86_64-linux-gnu/libnvidia-ptxjitcompiler.so.510.60.02 I0525 12:44:32.814035 383591 nvc_mount.c:134] mounting /usr/lib/libnvidia-allocator.so.510.60.02 at /var/lib/docker/btrfs/subvolumes/fa72427ba5b74f1aa4b6d082a8cb37272bfb6de2fdde4ec9a2b29714ad35fb39/usr/lib/x86_64-linux-gnu/libnvidia-allocator.so.510.60.02 I0525 12:44:32.814197 383591 nvc_mount.c:134] mounting /usr/lib/libnvidia-compiler.so.510.60.02 at /var/lib/docker/btrfs/subvolumes/fa72427ba5b74f1aa4b6d082a8cb37272bfb6de2fdde4ec9a2b29714ad35fb39/usr/lib/x86_64-linux-gnu/libnvidia-compiler.so.510.60.02 I0525 12:44:32.814276 383591 nvc_mount.c:527] creating symlink /var/lib/docker/btrfs/subvolumes/fa72427ba5b74f1aa4b6d082a8cb37272bfb6de2fdde4ec9a2b29714ad35fb39/usr/lib/x86_64-linux-gnu/libcuda.so -> libcuda.so.1 I0525 12:44:32.814874 383591 nvc_mount.c:85] mounting /usr/lib/firmware/nvidia/510.60.02/gsp.bin at /var/lib/docker/btrfs/subvolumes/fa72427ba5b74f1aa4b6d082a8cb37272bfb6de2fdde4ec9a2b29714ad35fb39/lib/firmware/nvidia/510.60.02/gsp.bin with flags 0x7 I0525 12:44:32.815051 383591 nvc_mount.c:230] mounting /dev/nvidiactl at /var/lib/docker/btrfs/subvolumes/fa72427ba5b74f1aa4b6d082a8cb37272bfb6de2fdde4ec9a2b29714ad35fb39/dev/nvidiactl I0525 12:44:32.815840 383591 nvc_mount.c:230] mounting /dev/nvidia-uvm at /var/lib/docker/btrfs/subvolumes/fa72427ba5b74f1aa4b6d082a8cb37272bfb6de2fdde4ec9a2b29714ad35fb39/dev/nvidia-uvm I0525 12:44:32.816421 383591 nvc_mount.c:230] mounting /dev/nvidia-uvm-tools at /var/lib/docker/btrfs/subvolumes/fa72427ba5b74f1aa4b6d082a8cb37272bfb6de2fdde4ec9a2b29714ad35fb39/dev/nvidia-uvm-tools I0525 12:44:32.816987 383591 nvc_mount.c:230] mounting /dev/nvidia0 at /var/lib/docker/btrfs/subvolumes/fa72427ba5b74f1aa4b6d082a8cb37272bfb6de2fdde4ec9a2b29714ad35fb39/dev/nvidia0 I0525 12:44:32.817295 383591 nvc_mount.c:440] mounting /proc/driver/nvidia/gpus/0000:01:00.0 at /var/lib/docker/btrfs/subvolumes/fa72427ba5b74f1aa4b6d082a8cb37272bfb6de2fdde4ec9a2b29714ad35fb39/proc/driver/nvidia/gpus/0000:01:00.0 I0525 12:44:32.817800 383591 nvc_ldcache.c:372] executing /sbin/ldconfig from host at /var/lib/docker/btrfs/subvolumes/fa72427ba5b74f1aa4b6d082a8cb37272bfb6de2fdde4ec9a2b29714ad35fb39 W0525 12:44:32.862034 383591 utils.c:121] /sbin/ldconfig: file /usr/lib/x86_64-linux-gnu/libdb-5.3.so is truncated W0525 12:44:32.862120 383591 utils.c:121] W0525 12:44:32.865208 383591 utils.c:121] /sbin/ldconfig: file /usr/lib/x86_64-linux-gnu/libext2fs.so.2 is truncated W0525 12:44:32.865299 383591 utils.c:121] W0525 12:44:32.865347 383591 utils.c:121] /sbin/ldconfig: file /usr/lib/x86_64-linux-gnu/libext2fs.so.2.4 is truncated W0525 12:44:32.865384 383591 utils.c:121] W0525 12:44:32.866518 383591 utils.c:121] /sbin/ldconfig: file /usr/lib/x86_64-linux-gnu/libfdisk.so.1 is truncated W0525 12:44:32.866576 383591 utils.c:121] W0525 12:44:32.866599 383591 utils.c:121] /sbin/ldconfig: file /usr/lib/x86_64-linux-gnu/libfdisk.so.1.1.0 is truncated W0525 12:44:32.866623 383591 utils.c:121] W0525 12:44:32.877192 383591 utils.c:121] /sbin/ldconfig: File /usr/lib/x86_64-linux-gnu/libgmp.so.10 is empty, not checked. W0525 12:44:32.877252 383591 utils.c:121] /sbin/ldconfig: File /usr/lib/x86_64-linux-gnu/libgmp.so.10.4.0 is empty, not checked. W0525 12:44:32.878414 383591 utils.c:121] /sbin/ldconfig: file /usr/lib/x86_64-linux-gnu/libgnutls.so.30 is truncated W0525 12:44:32.878475 383591 utils.c:121] W0525 12:44:32.878499 383591 utils.c:121] /sbin/ldconfig: file /usr/lib/x86_64-linux-gnu/libgnutls.so.30.27.0 is truncated W0525 12:44:32.878523 383591 utils.c:121] W0525 12:44:32.883459 383591 utils.c:121] /sbin/ldconfig: File /usr/lib/x86_64-linux-gnu/liblz4.so.1 is empty, not checked. W0525 12:44:32.883548 383591 utils.c:121] /sbin/ldconfig: File /usr/lib/x86_64-linux-gnu/liblz4.so.1.9.2 is empty, not checked. W0525 12:44:32.886321 383591 utils.c:121] /sbin/ldconfig: file /usr/lib/x86_64-linux-gnu/libm-2.31.so is truncated W0525 12:44:32.886382 383591 utils.c:121] W0525 12:44:32.886405 383591 utils.c:121] /sbin/ldconfig: file /usr/lib/x86_64-linux-gnu/libm.so.6 is truncated W0525 12:44:32.886430 383591 utils.c:121] W0525 12:44:32.889801 383591 utils.c:121] /sbin/ldconfig: file /usr/lib/x86_64-linux-gnu/libmount.so.1 is truncated W0525 12:44:32.889871 383591 utils.c:121] W0525 12:44:32.889894 383591 utils.c:121] /sbin/ldconfig: file /usr/lib/x86_64-linux-gnu/libmount.so.1.1.0 is truncated W0525 12:44:32.889919 383591 utils.c:121] W0525 12:44:32.891153 383591 utils.c:121] /sbin/ldconfig: File /usr/lib/x86_64-linux-gnu/libncurses.so.6 is empty, not checked. W0525 12:44:32.891211 383591 utils.c:121] /sbin/ldconfig: File /usr/lib/x86_64-linux-gnu/libncurses.so.6.2 is empty, not checked. W0525 12:44:32.891240 383591 utils.c:121] /sbin/ldconfig: File /usr/lib/x86_64-linux-gnu/libncursesw.so.6 is empty, not checked. W0525 12:44:32.891265 383591 utils.c:121] /sbin/ldconfig: File /usr/lib/x86_64-linux-gnu/libncursesw.so.6.2 is empty, not checked. W0525 12:44:32.905191 383591 utils.c:121] /sbin/ldconfig: File /usr/lib/x86_64-linux-gnu/libpcre.so.3 is empty, not checked. W0525 12:44:32.905249 383591 utils.c:121] /sbin/ldconfig: File /usr/lib/x86_64-linux-gnu/libpcre.so.3.13.3 is empty, not checked. W0525 12:44:32.905279 383591 utils.c:121] /sbin/ldconfig: File /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0 is empty, not checked. W0525 12:44:32.905303 383591 utils.c:121] /sbin/ldconfig: File /usr/lib/x86_64-linux-gnu/libpcre2-8.so.0.9.0 is empty, not checked. W0525 12:44:32.910811 383591 utils.c:121] /sbin/ldconfig: File /usr/lib/x86_64-linux-gnu/libselinux.so.1 is empty, not checked. W0525 12:44:32.912564 383591 utils.c:121] /sbin/ldconfig: File /usr/lib/x86_64-linux-gnu/libsepol.so.1 is empty, not checked. W0525 12:44:32.912622 383591 utils.c:121] /sbin/ldconfig: File /usr/lib/x86_64-linux-gnu/libsmartcols.so.1 is empty, not checked. W0525 12:44:32.912651 383591 utils.c:121] /sbin/ldconfig: File /usr/lib/x86_64-linux-gnu/libsmartcols.so.1.1.0 is empty, not checked. W0525 12:44:32.913273 383591 utils.c:121] /sbin/ldconfig: File /usr/lib/x86_64-linux-gnu/libstdc++.so.6 is empty, not checked. W0525 12:44:32.913331 383591 utils.c:121] /sbin/ldconfig: File /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.28 is empty, not checked. W0525 12:44:32.914806 383591 utils.c:121] /sbin/ldconfig: file /usr/lib/x86_64-linux-gnu/libsystemd.so.0 is truncated W0525 12:44:32.914864 383591 utils.c:121] W0525 12:44:32.914887 383591 utils.c:121] /sbin/ldconfig: file /usr/lib/x86_64-linux-gnu/libsystemd.so.0.28.0 is truncated W0525 12:44:32.914912 383591 utils.c:121] W0525 12:44:32.918904 383591 utils.c:121] /sbin/ldconfig: File /usr/lib/x86_64-linux-gnu/libudev.so.1 is empty, not checked. W0525 12:44:32.918963 383591 utils.c:121] /sbin/ldconfig: File /usr/lib/x86_64-linux-gnu/libudev.so.1.6.17 is empty, not checked. W0525 12:44:32.920724 383591 utils.c:121] /sbin/ldconfig: file /usr/lib/x86_64-linux-gnu/libunistring.so.2 is truncated W0525 12:44:32.920797 383591 utils.c:121] W0525 12:44:32.920835 383591 utils.c:121] /sbin/ldconfig: file /usr/lib/x86_64-linux-gnu/libunistring.so.2.1.0 is truncated W0525 12:44:32.920878 383591 utils.c:121] W0525 12:44:32.921928 383591 utils.c:121] /sbin/ldconfig: File /usr/lib/x86_64-linux-gnu/libz.so.1 is empty, not checked. W0525 12:44:32.921987 383591 utils.c:121] /sbin/ldconfig: File /usr/lib/x86_64-linux-gnu/libz.so.1.2.11 is empty, not checked. W0525 12:44:32.922016 383591 utils.c:121] /sbin/ldconfig: File /usr/lib/x86_64-linux-gnu/libzstd.so.1 is empty, not checked. W0525 12:44:32.922041 383591 utils.c:121] /sbin/ldconfig: File /usr/lib/x86_64-linux-gnu/libzstd.so.1.4.4 is empty, not checked. I0525 12:44:33.271590 383591 nvc.c:430] shutting down library context I0525 12:44:33.271740 383599 rpc.c:95] terminating nvcgo rpc service I0525 12:44:33.272098 383591 rpc.c:132] nvcgo rpc service terminated successfully I0525 12:44:33.273355 383598 rpc.c:95] terminating driver rpc service I0525 12:44:33.273488 383591 rpc.c:132] driver rpc service terminated successfully ```