NVIDIA / nvidia-docker

Build and run Docker containers leveraging NVIDIA GPUs
Apache License 2.0
17.24k stars 2.03k forks source link

Couldn't find libnvidia-ml.so library in your system #876

Closed leichangqing closed 5 years ago

leichangqing commented 5 years ago

The template below is mostly useful for bug reports and support questions. Feel free to remove anything which doesn't apply to you and add more information where it makes sense.

Also, before reporting a new issue, please make sure that:


1. Issue or feature description

aigpu@aiPC1:~$ docker run --runtime=nvidia --rm -ti -e NVIDIA_DRIVER_CAPABILITIES=video,compute,utility nvidia/cuda:9.0-base nvidia-smi ldconfig -p | grep libnvidia-ml NVIDIA-SMI couldn't find libnvidia-ml.so library in your system. Please make sure that the NVIDIA Display Driver is properly installed and present in your system. Please also try adding directory that contains libnvidia-ml.so to your system PATH. aigpu@aiPC1:~$ docker run --runtime=nvidia --rm nvidia/cuda:9.0-base nvidia-smi NVIDIA-SMI couldn't find libnvidia-ml.so library in your system. Please make sure that the NVIDIA Display Driver is properly installed and present in your system. Please also try adding directory that contains libnvidia-ml.so to your system PATH.

2. Steps to reproduce the issue

install nvidia-docker2 on ubuntu18.10, docker-ce version is 18.06.1-1.

3. Information to attach (optional if deemed irrelevant)

==============NVSMI LOG==============

Timestamp : Thu Dec 6 09:31:07 2018 Driver Version : 390.87

Attached GPUs : 2 GPU 00000000:01:00.0 Product Name : GeForce GTX 1080 Ti Product Brand : GeForce Display Mode : Enabled Display Active : Disabled Persistence Mode : Disabled Accounting Mode : Disabled Accounting Mode Buffer Size : 4000 Driver Model Current : N/A Pending : N/A Serial Number : N/A GPU UUID : GPU-52e239a8-0113-dd67-5657-4d23cbd17bea Minor Number : 0 VBIOS Version : 86.02.39.40.6B MultiGPU Board : No Board ID : 0x100 GPU Part Number : N/A Inforom Version Image Version : G001.0000.01.04 OEM Object : 1.1 ECC Object : N/A Power Management Object : N/A GPU Operation Mode Current : N/A Pending : N/A GPU Virtualization Mode Virtualization mode : None PCI Bus : 0x01 Device : 0x00 Domain : 0x0000 Device Id : 0x1B0610DE Bus Id : 00000000:01:00.0 Sub System Id : 0x374C1458 GPU Link Info PCIe Generation Max : 3 Current : 1 Link Width Max : 16x Current : 8x Bridge Chip Type : N/A Firmware : N/A Replays since reset : 0 Tx Throughput : 0 KB/s Rx Throughput : 0 KB/s Fan Speed : 0 % Performance State : P8 Clocks Throttle Reasons Idle : Active Applications Clocks Setting : Not Active SW Power Cap : Not Active HW Slowdown : Not Active HW Thermal Slowdown : Not Active HW Power Brake Slowdown : Not Active Sync Boost : Not Active SW Thermal Slowdown : Not Active Display Clock Setting : Not Active FB Memory Usage Total : 11175 MiB Used : 4981 MiB Free : 6194 MiB BAR1 Memory Usage Total : 256 MiB Used : 2 MiB Free : 254 MiB Compute Mode : Default Utilization Gpu : 0 % Memory : 1 % Encoder : 0 % Decoder : 0 % Encoder Stats Active Sessions : 0 Average FPS : 0 Average Latency : 0 Ecc Mode Current : N/A Pending : N/A ECC Errors Volatile Single Bit
Device Memory : N/A Register File : N/A L1 Cache : N/A L2 Cache : N/A Texture Memory : N/A Texture Shared : N/A CBU : N/A Total : N/A Double Bit
Device Memory : N/A Register File : N/A L1 Cache : N/A L2 Cache : N/A Texture Memory : N/A Texture Shared : N/A CBU : N/A Total : N/A Aggregate Single Bit
Device Memory : N/A Register File : N/A L1 Cache : N/A L2 Cache : N/A Texture Memory : N/A Texture Shared : N/A CBU : N/A Total : N/A Double Bit
Device Memory : N/A Register File : N/A L1 Cache : N/A L2 Cache : N/A Texture Memory : N/A Texture Shared : N/A CBU : N/A Total : N/A Retired Pages Single Bit ECC : N/A Double Bit ECC : N/A Pending : N/A Temperature GPU Current Temp : 45 C GPU Shutdown Temp : 96 C GPU Slowdown Temp : 93 C GPU Max Operating Temp : N/A Memory Current Temp : N/A Memory Max Operating Temp : N/A Power Readings Power Management : Supported Power Draw : 19.05 W Power Limit : 250.00 W Default Power Limit : 250.00 W Enforced Power Limit : 250.00 W Min Power Limit : 125.00 W Max Power Limit : 300.00 W Clocks Graphics : 139 MHz SM : 139 MHz Memory : 405 MHz Video : 544 MHz Applications Clocks Graphics : N/A Memory : N/A Default Applications Clocks Graphics : N/A Memory : N/A Max Clocks Graphics : 1949 MHz SM : 1949 MHz Memory : 5505 MHz Video : 1620 MHz Max Customer Boost Clocks Graphics : N/A Clock Policy Auto Boost : N/A Auto Boost Default : N/A Processes Process ID : 12304 Type : C Name : /opt/anaconda3/envs/tf18p36/bin/ctpn Used GPU Memory : 4971 MiB

GPU 00000000:02:00.0 Product Name : GeForce GTX 1080 Ti Product Brand : GeForce Display Mode : Disabled Display Active : Disabled Persistence Mode : Disabled Accounting Mode : Disabled Accounting Mode Buffer Size : 4000 Driver Model Current : N/A Pending : N/A Serial Number : N/A GPU UUID : GPU-4d0faadf-72fd-2360-2f5b-02126199ef87 Minor Number : 1 VBIOS Version : 86.02.39.40.6B MultiGPU Board : No Board ID : 0x200 GPU Part Number : N/A Inforom Version Image Version : G001.0000.01.04 OEM Object : 1.1 ECC Object : N/A Power Management Object : N/A GPU Operation Mode Current : N/A Pending : N/A GPU Virtualization Mode Virtualization mode : None PCI Bus : 0x02 Device : 0x00 Domain : 0x0000 Device Id : 0x1B0610DE Bus Id : 00000000:02:00.0 Sub System Id : 0x374C1458 GPU Link Info PCIe Generation Max : 3 Current : 2 Link Width Max : 16x Current : 8x Bridge Chip Type : N/A Firmware : N/A Replays since reset : 0 Tx Throughput : 0 KB/s Rx Throughput : 0 KB/s Fan Speed : 0 % Performance State : P5 Clocks Throttle Reasons Idle : Not Active Applications Clocks Setting : Not Active SW Power Cap : Active HW Slowdown : Not Active HW Thermal Slowdown : Not Active HW Power Brake Slowdown : Not Active Sync Boost : Not Active SW Thermal Slowdown : Not Active Display Clock Setting : Not Active FB Memory Usage Total : 11178 MiB Used : 0 MiB Free : 11178 MiB BAR1 Memory Usage Total : 256 MiB Used : 2 MiB Free : 254 MiB Compute Mode : Default Utilization Gpu : 1 % Memory : 0 % Encoder : 0 % Decoder : 0 % Encoder Stats Active Sessions : 0 Average FPS : 0 Average Latency : 0 Ecc Mode Current : N/A Pending : N/A ECC Errors Volatile Single Bit
Device Memory : N/A Register File : N/A L1 Cache : N/A L2 Cache : N/A Texture Memory : N/A Texture Shared : N/A CBU : N/A Total : N/A Double Bit
Device Memory : N/A Register File : N/A L1 Cache : N/A L2 Cache : N/A Texture Memory : N/A Texture Shared : N/A CBU : N/A Total : N/A Aggregate Single Bit
Device Memory : N/A Register File : N/A L1 Cache : N/A L2 Cache : N/A Texture Memory : N/A Texture Shared : N/A CBU : N/A Total : N/A Double Bit
Device Memory : N/A Register File : N/A L1 Cache : N/A L2 Cache : N/A Texture Memory : N/A Texture Shared : N/A CBU : N/A Total : N/A Retired Pages Single Bit ECC : N/A Double Bit ECC : N/A Pending : N/A Temperature GPU Current Temp : 41 C GPU Shutdown Temp : 96 C GPU Slowdown Temp : 93 C GPU Max Operating Temp : N/A Memory Current Temp : N/A Memory Max Operating Temp : N/A Power Readings Power Management : Supported Power Draw : 13.71 W Power Limit : 250.00 W Default Power Limit : 250.00 W Enforced Power Limit : 250.00 W Min Power Limit : 125.00 W Max Power Limit : 300.00 W Clocks Graphics : 139 MHz SM : 139 MHz Memory : 810 MHz Video : 734 MHz Applications Clocks Graphics : N/A Memory : N/A Default Applications Clocks Graphics : N/A Memory : N/A Max Clocks Graphics : 1949 MHz SM : 1949 MHz Memory : 5505 MHz Video : 1620 MHz Max Customer Boost Clocks Graphics : N/A Clock Policy Auto Boost : N/A Auto Boost Default : N/A Processes : None

Server: Engine: Version: 18.06.1-ce API version: 1.38 (minimum version 1.12) Go version: go1.10.3 Git commit: e68fc7a Built: Tue Aug 21 17:23:15 2018 OS/Arch: linux/amd64 Experimental: false

RenaudWasTaken commented 5 years ago

Is the NVIDIA driver installed?

If so can you run nvidia-smi and a CUDA program outside of a container? What is the output?

mxmathieu commented 5 years ago

@RenaudWasTaken same issue on my side.

nvidia-smi is working as well on the host:

Sat Dec 8 22:26:32 2018 +-----------------------------------------------------------------------------+ | NVIDIA-SMI 415.22 Driver Version: 415.22 CUDA Version: 10.0 | |-------------------------------+----------------------+----------------------+ | GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC | | Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. | |===============================+======================+======================| | 0 GeForce GT 1030 Off | 00000000:06:00.0 Off | N/A | | 41% 36C P0 N/A / 30W | 0MiB / 2000MiB | 0% Default | +-------------------------------+----------------------+----------------------+

+-----------------------------------------------------------------------------+ | Processes: GPU Memory | | GPU PID Type Process name Usage | |=============================================================================| | No running processes found | +-----------------------------------------------------------------------------+

RenaudWasTaken commented 5 years ago

What's the output of ldconfig -p? I suspect that neither of you can run a normal CUDA / Tensorflow / ... outside a container.

mxmathieu commented 5 years ago

Hi @RenaudWasTaken, thanks for your comment, here is the output of ldconfig -p on the host :

512 libs found in cache `/etc/ld.so.cache' p11-kit-trust.so (libc6,x86-64) => /lib64/p11-kit-trust.so libzstd.so.1 (libc6,x86-64) => /lib64/libzstd.so.1 libzck.so.1 (libc6,x86-64) => /lib64/libzck.so.1 libz.so.1 (libc6,x86-64) => /lib64/libz.so.1 libz.so (libc6,x86-64) => /lib64/libz.so libyaml-0.so.2 (libc6,x86-64) => /lib64/libyaml-0.so.2 libxtables.so.12 (libc6,x86-64) => /lib64/libxtables.so.12 libxshmfence.so.1 (libc6,x86-64) => /lib64/libxshmfence.so.1 libxml2.so.2 (libc6,x86-64) => /lib64/libxml2.so.2 libxkbcommon.so.0 (libc6,x86-64) => /lib64/libxkbcommon.so.0 libxcb.so.1 (libc6,x86-64) => /lib64/libxcb.so.1 libxcb.so (libc6,x86-64) => /lib64/libxcb.so libxcb-xvmc.so.0 (libc6,x86-64) => /lib64/libxcb-xvmc.so.0 libxcb-xvmc.so (libc6,x86-64) => /lib64/libxcb-xvmc.so libxcb-xv.so.0 (libc6,x86-64) => /lib64/libxcb-xv.so.0 libxcb-xv.so (libc6,x86-64) => /lib64/libxcb-xv.so libxcb-xtest.so.0 (libc6,x86-64) => /lib64/libxcb-xtest.so.0 libxcb-xtest.so (libc6,x86-64) => /lib64/libxcb-xtest.so libxcb-xselinux.so.0 (libc6,x86-64) => /lib64/libxcb-xselinux.so.0 libxcb-xselinux.so (libc6,x86-64) => /lib64/libxcb-xselinux.so libxcb-xkb.so.1 (libc6,x86-64) => /lib64/libxcb-xkb.so.1 libxcb-xkb.so (libc6,x86-64) => /lib64/libxcb-xkb.so libxcb-xinput.so.0 (libc6,x86-64) => /lib64/libxcb-xinput.so.0 libxcb-xinput.so (libc6,x86-64) => /lib64/libxcb-xinput.so libxcb-xinerama.so.0 (libc6,x86-64) => /lib64/libxcb-xinerama.so.0 libxcb-xinerama.so (libc6,x86-64) => /lib64/libxcb-xinerama.so libxcb-xf86dri.so.0 (libc6,x86-64) => /lib64/libxcb-xf86dri.so.0 libxcb-xf86dri.so (libc6,x86-64) => /lib64/libxcb-xf86dri.so libxcb-xfixes.so.0 (libc6,x86-64) => /lib64/libxcb-xfixes.so.0 libxcb-xfixes.so (libc6,x86-64) => /lib64/libxcb-xfixes.so libxcb-sync.so.1 (libc6,x86-64) => /lib64/libxcb-sync.so.1 libxcb-sync.so (libc6,x86-64) => /lib64/libxcb-sync.so libxcb-shm.so.0 (libc6,x86-64) => /lib64/libxcb-shm.so.0 libxcb-shm.so (libc6,x86-64) => /lib64/libxcb-shm.so libxcb-shape.so.0 (libc6,x86-64) => /lib64/libxcb-shape.so.0 libxcb-shape.so (libc6,x86-64) => /lib64/libxcb-shape.so libxcb-screensaver.so.0 (libc6,x86-64) => /lib64/libxcb-screensaver.so.0 libxcb-screensaver.so (libc6,x86-64) => /lib64/libxcb-screensaver.so libxcb-res.so.0 (libc6,x86-64) => /lib64/libxcb-res.so.0 libxcb-res.so (libc6,x86-64) => /lib64/libxcb-res.so libxcb-render.so.0 (libc6,x86-64) => /lib64/libxcb-render.so.0 libxcb-render.so (libc6,x86-64) => /lib64/libxcb-render.so libxcb-record.so.0 (libc6,x86-64) => /lib64/libxcb-record.so.0 libxcb-record.so (libc6,x86-64) => /lib64/libxcb-record.so libxcb-randr.so.0 (libc6,x86-64) => /lib64/libxcb-randr.so.0 libxcb-randr.so (libc6,x86-64) => /lib64/libxcb-randr.so libxcb-present.so.0 (libc6,x86-64) => /lib64/libxcb-present.so.0 libxcb-present.so (libc6,x86-64) => /lib64/libxcb-present.so libxcb-glx.so.0 (libc6,x86-64) => /lib64/libxcb-glx.so.0 libxcb-glx.so (libc6,x86-64) => /lib64/libxcb-glx.so libxcb-dri3.so.0 (libc6,x86-64) => /lib64/libxcb-dri3.so.0 libxcb-dri3.so (libc6,x86-64) => /lib64/libxcb-dri3.so libxcb-dri2.so.0 (libc6,x86-64) => /lib64/libxcb-dri2.so.0 libxcb-dri2.so (libc6,x86-64) => /lib64/libxcb-dri2.so libxcb-dpms.so.0 (libc6,x86-64) => /lib64/libxcb-dpms.so.0 libxcb-dpms.so (libc6,x86-64) => /lib64/libxcb-dpms.so libxcb-damage.so.0 (libc6,x86-64) => /lib64/libxcb-damage.so.0 libxcb-damage.so (libc6,x86-64) => /lib64/libxcb-damage.so libxcb-composite.so.0 (libc6,x86-64) => /lib64/libxcb-composite.so.0 libxcb-composite.so (libc6,x86-64) => /lib64/libxcb-composite.so libwbclient.so.0 (libc6,x86-64) => /lib64/libwbclient.so.0 libwayland-server.so.0 (libc6,x86-64) => /lib64/libwayland-server.so.0 libwayland-client.so.0 (libc6,x86-64) => /lib64/libwayland-client.so.0 libverto.so.1 (libc6,x86-64) => /lib64/libverto.so.1 libverto-libev.so.1 (libc6,x86-64) => /lib64/libverto-libev.so.1 libvdpau_nvidia.so (libc6,x86-64, OS ABI: Linux 2.3.99) => /lib64/libvdpau_nvidia.so libvdpau_nvidia.so (libc6, OS ABI: Linux 2.3.99) => /lib/libvdpau_nvidia.so libvdpau.so.1 (libc6,x86-64) => /lib64/libvdpau.so.1 libva.so.2 (libc6,x86-64) => /lib64/libva.so.2 libva-x11.so.2 (libc6,x86-64) => /lib64/libva-x11.so.2 libva-wayland.so.2 (libc6,x86-64) => /lib64/libva-wayland.so.2 libva-glx.so.2 (libc6,x86-64) => /lib64/libva-glx.so.2 libva-drm.so.2 (libc6,x86-64) => /lib64/libva-drm.so.2 libuuid.so.1 (libc6,x86-64) => /lib64/libuuid.so.1 libutil.so.1 (libc6,x86-64, OS ABI: Linux 3.2.0) => /lib64/libutil.so.1 libutil.so (libc6,x86-64, OS ABI: Linux 3.2.0) => /lib64/libutil.so libutempter.so.0 (libc6,x86-64) => /lib64/libutempter.so.0 libuser.so.1 (libc6,x86-64) => /lib64/libuser.so.1 libusb-1.0.so.0 (libc6,x86-64) => /lib64/libusb-1.0.so.0 libunistring.so.2 (libc6,x86-64) => /lib64/libunistring.so.2 libunbound.so.8 (libc6,x86-64) => /lib64/libunbound.so.8 libulockmgr.so.1 (libc6,x86-64) => /lib64/libulockmgr.so.1 libudev.so.1 (libc6,x86-64) => /lib64/libudev.so.1 libtspi.so.1 (libc6,x86-64) => /lib64/libtspi.so.1 libtirpc.so.3 (libc6,x86-64) => /lib64/libtirpc.so.3 libtinfo.so.6 (libc6,x86-64) => /lib64/libtinfo.so.6 libtic.so.6 (libc6,x86-64) => /lib64/libtic.so.6 libthread_db.so.1 (libc6,x86-64, OS ABI: Linux 3.2.0) => /lib64/libthread_db.so.1 libthread_db.so (libc6,x86-64, OS ABI: Linux 3.2.0) => /lib64/libthread_db.so libtevent.so.0 (libc6,x86-64) => /lib64/libtevent.so.0 libtevent-util.so.0 (libc6,x86-64) => /lib64/libtevent-util.so.0 libtdb.so.1 (libc6,x86-64) => /lib64/libtdb.so.1 libtasn1.so.6 (libc6,x86-64) => /lib64/libtasn1.so.6 libtalloc.so.2 (libc6,x86-64) => /lib64/libtalloc.so.2 libsystemd.so.0 (libc6,x86-64) => /lib64/libsystemd.so.0 libstdc++.so.6 (libc6,x86-64) => /lib64/libstdc++.so.6 libsss_sudo.so (libc6,x86-64) => /lib64/libsss_sudo.so libsss_nss_idmap.so.0 (libc6,x86-64) => /lib64/libsss_nss_idmap.so.0 libsss_idmap.so.0 (libc6,x86-64) => /lib64/libsss_idmap.so.0 libsss_certmap.so.0 (libc6,x86-64) => /lib64/libsss_certmap.so.0 libssl.so.1.1 (libc6,x86-64) => /lib64/libssl.so.1.1 libssh.so.4 (libc6,x86-64) => /lib64/libssh.so.4 libss.so.2 (libc6,x86-64) => /lib64/libss.so.2 libsqlite3.so.0 (libc6,x86-64) => /lib64/libsqlite3.so.0 libsolvext.so.1 (libc6,x86-64) => /lib64/libsolvext.so.1 libsolv.so.1 (libc6,x86-64) => /lib64/libsolv.so.1 libsmbldap.so.2 (libc6,x86-64) => /lib64/libsmbldap.so.2 libsmbconf.so.0 (libc6,x86-64) => /lib64/libsmbconf.so.0 libsmbclient.so.0 (libc6,x86-64) => /lib64/libsmbclient.so.0 libsmartcols.so.1 (libc6,x86-64) => /lib64/libsmartcols.so.1 libslapi-2.4.so.2 (libc6,x86-64) => /lib64/libslapi-2.4.so.2 libsigsegv.so.2 (libc6,x86-64) => /lib64/libsigsegv.so.2 libsepol.so.1 (libc6,x86-64) => /lib64/libsepol.so.1 libsemanage.so.1 (libc6,x86-64) => /lib64/libsemanage.so.1 libselinux.so.1 (libc6,x86-64) => /lib64/libselinux.so.1 libsecret-1.so.0 (libc6,x86-64) => /lib64/libsecret-1.so.0 libseccomp.so.2 (libc6,x86-64) => /lib64/libseccomp.so.2 libsasl2.so.3 (libc6,x86-64) => /lib64/libsasl2.so.3 libsamdb.so.0 (libc6,x86-64) => /lib64/libsamdb.so.0 libsamba-util.so.0 (libc6,x86-64) => /lib64/libsamba-util.so.0 libsamba-passdb.so.0 (libc6,x86-64) => /lib64/libsamba-passdb.so.0 libsamba-hostconfig.so.0 (libc6,x86-64) => /lib64/libsamba-hostconfig.so.0 libsamba-errors.so.1 (libc6,x86-64) => /lib64/libsamba-errors.so.1 libsamba-credentials.so.0 (libc6,x86-64) => /lib64/libsamba-credentials.so.0 librt.so.1 (libc6,x86-64, OS ABI: Linux 3.2.0) => /lib64/librt.so.1 librt.so (libc6,x86-64, OS ABI: Linux 3.2.0) => /lib64/librt.so librpmsign.so.8 (libc6,x86-64) => /lib64/librpmsign.so.8 librpmio.so.8 (libc6,x86-64) => /lib64/librpmio.so.8 librpmbuild.so.8 (libc6,x86-64) => /lib64/librpmbuild.so.8 librpm.so.8 (libc6,x86-64) => /lib64/librpm.so.8 libresolv.so.2 (libc6,x86-64, OS ABI: Linux 3.2.0) => /lib64/libresolv.so.2 libresolv.so (libc6,x86-64, OS ABI: Linux 3.2.0) => /lib64/libresolv.so librepo.so.0 (libc6,x86-64) => /lib64/librepo.so.0 libref_array.so.1 (libc6,x86-64) => /lib64/libref_array.so.1 libreadline.so.7 (libc6,x86-64) => /lib64/libreadline.so.7 libqrencode.so.3 (libc6,x86-64) => /lib64/libqrencode.so.3 libp11-kit.so.0 (libc6,x86-64) => /lib64/libp11-kit.so.0 libpython3.7m.so.1.0 (libc6,x86-64) => /lib64/libpython3.7m.so.1.0 libpython3.so (libc6,x86-64) => /lib64/libpython3.so libpwquality.so.1 (libc6,x86-64) => /lib64/libpwquality.so.1 libpthread.so.0 (libc6,x86-64, OS ABI: Linux 3.2.0) => /lib64/libpthread.so.0 libpthread.so (libc6,x86-64, OS ABI: Linux 3.2.0) => /lib64/libpthread.so libpsl.so.5 (libc6,x86-64) => /lib64/libpsl.so.5 libprocps.so.7 (libc6,x86-64) => /lib64/libprocps.so.7 libpopt.so.0 (libc6,x86-64) => /lib64/libpopt.so.0 libpolkit-gobject-1.so.0 (libc6,x86-64) => /lib64/libpolkit-gobject-1.so.0 libpolkit-agent-1.so.0 (libc6,x86-64) => /lib64/libpolkit-agent-1.so.0 libpng16.so.16 (libc6,x86-64) => /lib64/libpng16.so.16 libply.so.4 (libc6,x86-64) => /lib64/libply.so.4 libply-splash-core.so.4 (libc6,x86-64) => /lib64/libply-splash-core.so.4 libply-boot-client.so.4 (libc6,x86-64) => /lib64/libply-boot-client.so.4 libpkgconf.so.3 (libc6,x86-64) => /lib64/libpkgconf.so.3 libpipeline.so.1 (libc6,x86-64) => /lib64/libpipeline.so.1 libperl.so.5.28 (libc6,x86-64) => /lib64/libperl.so.5.28 libpcre2-8.so.0 (libc6,x86-64) => /lib64/libpcre2-8.so.0 libpcre2-posix.so.2 (libc6,x86-64) => /lib64/libpcre2-posix.so.2 libpcreposix.so.0 (libc6,x86-64) => /lib64/libpcreposix.so.0 libpcre.so.1 (libc6,x86-64) => /lib64/libpcre.so.1 libpcprofile.so (libc6,x86-64, OS ABI: Linux 3.2.0) => /lib64/libpcprofile.so libpciaccess.so.0 (libc6,x86-64) => /lib64/libpciaccess.so.0 libpci.so.3 (libc6,x86-64) => /lib64/libpci.so.3 libpcap.so.1 (libc6,x86-64) => /lib64/libpcap.so.1 libpath_utils.so.1 (libc6,x86-64) => /lib64/libpath_utils.so.1 libparted.so.2 (libc6,x86-64) => /lib64/libparted.so.2 libparted-fs-resize.so.0 (libc6,x86-64) => /lib64/libparted-fs-resize.so.0 libpanelw.so.6 (libc6,x86-64) => /lib64/libpanelw.so.6 libpanel.so.6 (libc6,x86-64) => /lib64/libpanel.so.6 libpamc.so.0 (libc6,x86-64) => /lib64/libpamc.so.0 libpam_misc.so.0 (libc6,x86-64) => /lib64/libpam_misc.so.0 libpam.so.0 (libc6,x86-64) => /lib64/libpam.so.0 libopcodes-2.31.1-15.fc29.so (libc6,x86-64) => /lib64/libopcodes-2.31.1-15.fc29.so libomapi.so.0 (libc6,x86-64) => /lib64/libomapi.so.0 libnvoptix.so.1 (libc6,x86-64) => /lib64/libnvoptix.so.1 libnvidia-tls.so.415.22 (libc6,x86-64, OS ABI: Linux 2.3.99) => /lib64/libnvidia-tls.so.415.22 libnvidia-tls.so.415.22 (libc6, OS ABI: Linux 2.3.99) => /lib/libnvidia-tls.so.415.22 libnvidia-rtcore.so.415.22 (libc6,x86-64) => /lib64/libnvidia-rtcore.so.415.22 libnvidia-ptxjitcompiler.so.1 (libc6,x86-64) => /lib64/libnvidia-ptxjitcompiler.so.1 libnvidia-ptxjitcompiler.so.1 (libc6) => /lib/libnvidia-ptxjitcompiler.so.1 libnvidia-ptxjitcompiler.so (libc6,x86-64) => /lib64/libnvidia-ptxjitcompiler.so libnvidia-ptxjitcompiler.so (libc6) => /lib/libnvidia-ptxjitcompiler.so libnvidia-opencl.so.1 (libc6,x86-64) => /lib64/libnvidia-opencl.so.1 libnvidia-opencl.so.1 (libc6) => /lib/libnvidia-opencl.so.1 libnvidia-ml.so.1 (libc6,x86-64) => /lib64/libnvidia-ml.so.1 libnvidia-ml.so.1 (libc6) => /lib/libnvidia-ml.so.1 libnvidia-ml.so (libc6,x86-64) => /lib64/libnvidia-ml.so libnvidia-ml.so (libc6) => /lib/libnvidia-ml.so libnvidia-ifr.so.1 (libc6,x86-64) => /lib64/libnvidia-ifr.so.1 libnvidia-ifr.so.1 (libc6) => /lib/libnvidia-ifr.so.1 libnvidia-ifr.so (libc6,x86-64) => /lib64/libnvidia-ifr.so libnvidia-ifr.so (libc6) => /lib/libnvidia-ifr.so libnvidia-gtk3.so.415.22 (libc6,x86-64) => /lib64/libnvidia-gtk3.so.415.22 libnvidia-gtk2.so.415.22 (libc6,x86-64) => /lib64/libnvidia-gtk2.so.415.22 libnvidia-glvkspirv.so.415.22 (libc6,x86-64) => /lib64/libnvidia-glvkspirv.so.415.22 libnvidia-glvkspirv.so.415.22 (libc6) => /lib/libnvidia-glvkspirv.so.415.22 libnvidia-glsi.so.415.22 (libc6,x86-64) => /lib64/libnvidia-glsi.so.415.22 libnvidia-glsi.so.415.22 (libc6) => /lib/libnvidia-glsi.so.415.22 libnvidia-glcore.so.415.22 (libc6,x86-64) => /lib64/libnvidia-glcore.so.415.22 libnvidia-glcore.so.415.22 (libc6) => /lib/libnvidia-glcore.so.415.22 libnvidia-fbc.so.1 (libc6,x86-64) => /lib64/libnvidia-fbc.so.1 libnvidia-fbc.so.1 (libc6) => /lib/libnvidia-fbc.so.1 libnvidia-fbc.so (libc6,x86-64) => /lib64/libnvidia-fbc.so libnvidia-fbc.so (libc6) => /lib/libnvidia-fbc.so libnvidia-fatbinaryloader.so.415.22 (libc6,x86-64) => /lib64/libnvidia-fatbinaryloader.so.415.22 libnvidia-fatbinaryloader.so.415.22 (libc6) => /lib/libnvidia-fatbinaryloader.so.415.22 libnvidia-encode.so.1 (libc6,x86-64) => /lib64/libnvidia-encode.so.1 libnvidia-encode.so.1 (libc6) => /lib/libnvidia-encode.so.1 libnvidia-encode.so (libc6,x86-64) => /lib64/libnvidia-encode.so libnvidia-encode.so (libc6) => /lib/libnvidia-encode.so libnvidia-eglcore.so.415.22 (libc6,x86-64) => /lib64/libnvidia-eglcore.so.415.22 libnvidia-eglcore.so.415.22 (libc6) => /lib/libnvidia-eglcore.so.415.22 libnvidia-egl-wayland.so.1 (libc6,x86-64) => /lib64/libnvidia-egl-wayland.so.1 libnvidia-container.so.1 (libc6,x86-64) => /lib64/libnvidia-container.so.1 libnvidia-compiler.so.415.22 (libc6,x86-64) => /lib64/libnvidia-compiler.so.415.22 libnvidia-compiler.so.415.22 (libc6) => /lib/libnvidia-compiler.so.415.22 libnvidia-cfg.so.1 (libc6,x86-64) => /lib64/libnvidia-cfg.so.1 libnvidia-cfg.so (libc6,x86-64) => /lib64/libnvidia-cfg.so libnvidia-cbl.so.415.22 (libc6,x86-64) => /lib64/libnvidia-cbl.so.415.22 libnvcuvid.so.1 (libc6,x86-64) => /lib64/libnvcuvid.so.1 libnvcuvid.so.1 (libc6) => /lib/libnvcuvid.so.1 libnvcuvid.so (libc6,x86-64) => /lib64/libnvcuvid.so libnvcuvid.so (libc6) => /lib/libnvcuvid.so libnss_systemd.so.2 (libc6,x86-64) => /lib64/libnss_systemd.so.2 libnss_sss.so.2 (libc6,x86-64) => /lib64/libnss_sss.so.2 libnss_resolve.so.2 (libc6,x86-64) => /lib64/libnss_resolve.so.2 libnss_myhostname.so.2 (libc6,x86-64) => /lib64/libnss_myhostname.so.2 libnss_files.so.2 (libc6,x86-64, OS ABI: Linux 3.2.0) => /lib64/libnss_files.so.2 libnss_dns.so.2 (libc6,x86-64, OS ABI: Linux 3.2.0) => /lib64/libnss_dns.so.2 libnss_compat.so.2 (libc6,x86-64, OS ABI: Linux 3.2.0) => /lib64/libnss_compat.so.2 libnsl.so.2 (libc6,x86-64) => /lib64/libnsl.so.2 libnpth.so.0 (libc6,x86-64) => /lib64/libnpth.so.0 libnm.so.0 (libc6,x86-64) => /lib64/libnm.so.0 libnl-3.so.200 (libc6,x86-64) => /lib64/libnl-3.so.200 libnl-xfrm-3.so.200 (libc6,x86-64) => /lib64/libnl-xfrm-3.so.200 libnl-route-3.so.200 (libc6,x86-64) => /lib64/libnl-route-3.so.200 libnl-nf-3.so.200 (libc6,x86-64) => /lib64/libnl-nf-3.so.200 libnl-idiag-3.so.200 (libc6,x86-64) => /lib64/libnl-idiag-3.so.200 libnl-genl-3.so.200 (libc6,x86-64) => /lib64/libnl-genl-3.so.200 libnghttp2.so.14 (libc6,x86-64) => /lib64/libnghttp2.so.14 libnftnl.so.7 (libc6,x86-64) => /lib64/libnftnl.so.7 libnftables.so.0 (libc6,x86-64) => /lib64/libnftables.so.0 libnfsidmap.so.1 (libc6,x86-64) => /lib64/libnfsidmap.so.1 libnfnetlink.so.0 (libc6,x86-64) => /lib64/libnfnetlink.so.0 libnettle.so.6 (libc6,x86-64) => /lib64/libnettle.so.6 libnetfilter_conntrack.so.3 (libc6,x86-64) => /lib64/libnetfilter_conntrack.so.3 libnetapi.so.0 (libc6,x86-64) => /lib64/libnetapi.so.0 libndr.so.0 (libc6,x86-64) => /lib64/libndr.so.0 libndr-standard.so.0 (libc6,x86-64) => /lib64/libndr-standard.so.0 libndr-nbt.so.0 (libc6,x86-64) => /lib64/libndr-nbt.so.0 libndr-krb5pac.so.0 (libc6,x86-64) => /lib64/libndr-krb5pac.so.0 libndp.so.0 (libc6,x86-64) => /lib64/libndp.so.0 libncursesw.so.6 (libc6,x86-64) => /lib64/libncursesw.so.6 libncurses.so.6 (libc6,x86-64) => /lib64/libncurses.so.6 libmvec.so.1 (libc6,x86-64, OS ABI: Linux 3.2.0) => /lib64/libmvec.so.1 libmvec.so (libc6,x86-64, OS ABI: Linux 3.2.0) => /lib64/libmvec.so libmpfr.so.4 (libc6,x86-64) => /lib64/libmpfr.so.4 libmpc.so.3 (libc6,x86-64) => /lib64/libmpc.so.3 libmozjs-52.so.0 (libc6,x86-64) => /lib64/libmozjs-52.so.0 libmount.so.1 (libc6,x86-64) => /lib64/libmount.so.1 libmodulemd.so.1 (libc6,x86-64) => /lib64/libmodulemd.so.1 libmnl.so.0 (libc6,x86-64) => /lib64/libmnl.so.0 libmetalink.so.3 (libc6,x86-64) => /lib64/libmetalink.so.3 libmenuw.so.6 (libc6,x86-64) => /lib64/libmenuw.so.6 libmenu.so.6 (libc6,x86-64) => /lib64/libmenu.so.6 libmemusage.so (libc6,x86-64, OS ABI: Linux 3.2.0) => /lib64/libmemusage.so libmagic.so.1 (libc6,x86-64) => /lib64/libmagic.so.1 libm.so.6 (libc6,x86-64, OS ABI: Linux 3.2.0) => /lib64/libm.so.6 liblz4.so.1 (libc6,x86-64) => /lib64/liblz4.so.1 liblzma.so.5 (libc6,x86-64) => /lib64/liblzma.so.5 liblwres.so.160 (libc6,x86-64) => /lib64/liblwres.so.160 liblvm2cmd.so.2.02 (libc6,x86-64) => /lib64/liblvm2cmd.so.2.02 liblvm2app.so.2.2 (libc6,x86-64) => /lib64/liblvm2app.so.2.2 liblua-5.3.so (libc6,x86-64) => /lib64/liblua-5.3.so libltdl.so.7 (libc6,x86-64) => /lib64/libltdl.so.7 liblmdb.so.0.0.0 (libc6,x86-64) => /lib64/liblmdb.so.0.0.0 libldb.so.1 (libc6,x86-64) => /lib64/libldb.so.1 libldap_r-2.4.so.2 (libc6,x86-64) => /lib64/libldap_r-2.4.so.2 libldap-2.4.so.2 (libc6,x86-64) => /lib64/libldap-2.4.so.2 liblber-2.4.so.2 (libc6,x86-64) => /lib64/liblber-2.4.so.2 libk5crypto.so.3 (libc6,x86-64) => /lib64/libk5crypto.so.3 libksba.so.8 (libc6,x86-64) => /lib64/libksba.so.8 libkrb5support.so.0 (libc6,x86-64) => /lib64/libkrb5support.so.0 libkrb5.so.3 (libc6,x86-64) => /lib64/libkrb5.so.3 libkrad.so.0 (libc6,x86-64) => /lib64/libkrad.so.0 libkms.so.1 (libc6,x86-64) => /lib64/libkms.so.1 libkms.so (libc6,x86-64) => /lib64/libkms.so libkmod.so.2 (libc6,x86-64) => /lib64/libkmod.so.2 libkeyutils.so.1 (libc6,x86-64) => /lib64/libkeyutils.so.1 libkdb5.so.9 (libc6,x86-64) => /lib64/libkdb5.so.9 libkcapi.so.1 (libc6,x86-64) => /lib64/libkcapi.so.1 libkadm5srv_mit.so.11 (libc6,x86-64) => /lib64/libkadm5srv_mit.so.11 libkadm5srv_mit.so (libc6,x86-64) => /lib64/libkadm5srv_mit.so libkadm5clnt_mit.so.11 (libc6,x86-64) => /lib64/libkadm5clnt_mit.so.11 libkadm5clnt_mit.so (libc6,x86-64) => /lib64/libkadm5clnt_mit.so libjson-c.so.4 (libc6,x86-64) => /lib64/libjson-c.so.4 libjansson.so.4 (libc6,x86-64) => /lib64/libjansson.so.4 libisl.so.15 (libc6,x86-64) => /lib64/libisl.so.15 libisl.so.13 (libc6,x86-64) => /lib64/libisl.so.13 libisccfg.so.160 (libc6,x86-64) => /lib64/libisccfg.so.160 libisccfg-export.so.160 (libc6,x86-64) => /usr/lib64//bind9-export/libisccfg-export.so.160 libisccc.so.160 (libc6,x86-64) => /lib64/libisccc.so.160 libisc.so.169 (libc6,x86-64) => /lib64/libisc.so.169 libisc-export.so.169 (libc6,x86-64) => /usr/lib64//bind9-export/libisc-export.so.169 libirs.so.160 (libc6,x86-64) => /lib64/libirs.so.160 libirs-export.so.160 (libc6,x86-64) => /usr/lib64//bind9-export/libirs-export.so.160 libip6tc.so.0 (libc6,x86-64) => /lib64/libip6tc.so.0 libip4tc.so.0 (libc6,x86-64) => /lib64/libip4tc.so.0 libiptc.so.0 (libc6,x86-64) => /lib64/libiptc.so.0 libipset.so.11 (libc6,x86-64) => /lib64/libipset.so.11 libini_config.so.5 (libc6,x86-64) => /lib64/libini_config.so.5 libimaevm.so.0 (libc6,x86-64) => /lib64/libimaevm.so.0 libidn2.so.0 (libc6,x86-64) => /lib64/libidn2.so.0 libicuuc.so.62 (libc6,x86-64) => /lib64/libicuuc.so.62 libicutu.so.62 (libc6,x86-64) => /lib64/libicutu.so.62 libicutest.so.62 (libc6,x86-64) => /lib64/libicutest.so.62 libicui18n.so.62 (libc6,x86-64) => /lib64/libicui18n.so.62 libicuio.so.62 (libc6,x86-64) => /lib64/libicuio.so.62 libicudata.so.62 (libc6,x86-64) => /lib64/libicudata.so.62 libhogweed.so.4 (libc6,x86-64) => /lib64/libhogweed.so.4 libhistory.so.7 (libc6,x86-64) => /lib64/libhistory.so.7 libhandle.so.1 (libc6,x86-64) => /lib64/libhandle.so.1 libguilereadline-v-18.so.18 (libc6,x86-64) => /lib64/libguilereadline-v-18.so.18 libguilereadline-v-18.so (libc6,x86-64) => /lib64/libguilereadline-v-18.so libguile-2.0.so.22 (libc6,x86-64) => /lib64/libguile-2.0.so.22 libgthread-2.0.so.0 (libc6,x86-64) => /lib64/libgthread-2.0.so.0 libgssrpc.so.4 (libc6,x86-64) => /lib64/libgssrpc.so.4 libgssapi_krb5.so.2 (libc6,x86-64) => /lib64/libgssapi_krb5.so.2 libgpm.so.2 (libc6,x86-64) => /lib64/libgpm.so.2 libgpgme.so.11 (libc6,x86-64) => /lib64/libgpgme.so.11 libgpg-error.so.0 (libc6,x86-64) => /lib64/libgpg-error.so.0 libgomp.so.1 (libc6,x86-64) => /lib64/libgomp.so.1 libgobject-2.0.so.0 (libc6,x86-64) => /lib64/libgobject-2.0.so.0 libgnutls.so.30 (libc6,x86-64) => /lib64/libgnutls.so.30 libgmp.so.10 (libc6,x86-64) => /lib64/libgmp.so.10 libgmodule-2.0.so.0 (libc6,x86-64) => /lib64/libgmodule-2.0.so.0 libglib-2.0.so.0 (libc6,x86-64) => /lib64/libglib-2.0.so.0 libglapi.so.0 (libc6,x86-64) => /lib64/libglapi.so.0 libglapi.so (libc6,x86-64) => /lib64/libglapi.so libgirepository-1.0.so.1 (libc6,x86-64) => /lib64/libgirepository-1.0.so.1 libgio-2.0.so.0 (libc6,x86-64) => /lib64/libgio-2.0.so.0 libgettextsrc-0.19.8.1.so (libc6,x86-64) => /lib64/libgettextsrc-0.19.8.1.so libgettextpo.so.0 (libc6,x86-64) => /lib64/libgettextpo.so.0 libgettextlib-0.19.8.1.so (libc6,x86-64) => /lib64/libgettextlib-0.19.8.1.so libgdbm_compat.so.4 (libc6,x86-64) => /lib64/libgdbm_compat.so.4 libgdbm.so.6 (libc6,x86-64) => /lib64/libgdbm.so.6 libgcrypt.so.20 (libc6,x86-64) => /lib64/libgcrypt.so.20 libgccpp.so.1 (libc6,x86-64) => /lib64/libgccpp.so.1 libgcc_s.so.1 (libc6,x86-64) => /lib64/libgcc_s.so.1 libgc.so.1 (libc6,x86-64) => /lib64/libgc.so.1 libgbm.so.1 (libc6,x86-64) => /lib64/libgbm.so.1 libfuse.so.2 (libc6,x86-64) => /lib64/libfuse.so.2 libfreetype.so.6 (libc6,x86-64) => /lib64/libfreetype.so.6 libformw.so.6 (libc6,x86-64) => /lib64/libformw.so.6 libform.so.6 (libc6,x86-64) => /lib64/libform.so.6 libfipscheck.so.1 (libc6,x86-64) => /lib64/libfipscheck.so.1 libffi.so.6 (libc6,x86-64) => /lib64/libffi.so.6 libfdisk.so.1 (libc6,x86-64) => /lib64/libfdisk.so.1 libe2p.so.2 (libc6,x86-64) => /lib64/libe2p.so.2 libext2fs.so.2 (libc6,x86-64) => /lib64/libext2fs.so.2 libexpat.so.1 (libc6,x86-64) => /lib64/libexpat.so.1 libevent_pthreads-2.1.so.6 (libc6,x86-64) => /lib64/libevent_pthreads-2.1.so.6 libevent_openssl-2.1.so.6 (libc6,x86-64) => /lib64/libevent_openssl-2.1.so.6 libevent_extra-2.1.so.6 (libc6,x86-64) => /lib64/libevent_extra-2.1.so.6 libevent_core-2.1.so.6 (libc6,x86-64) => /lib64/libevent_core-2.1.so.6 libevent-2.1.so.6 (libc6,x86-64) => /lib64/libevent-2.1.so.6 libev.so.4 (libc6,x86-64) => /lib64/libev.so.4 libelf.so.1 (libc6,x86-64) => /lib64/libelf.so.1 libelf.so (libc6,x86-64) => /lib64/libelf.so libedit.so.0 (libc6,x86-64) => /lib64/libedit.so.0 libebtc.so (libc6,x86-64) => /lib64/libebtc.so libdw.so.1 (libc6,x86-64) => /lib64/libdw.so.1 libdrm_radeon.so.1 (libc6,x86-64) => /lib64/libdrm_radeon.so.1 libdrm_radeon.so (libc6,x86-64) => /lib64/libdrm_radeon.so libdrm_nouveau.so.2 (libc6,x86-64) => /lib64/libdrm_nouveau.so.2 libdrm_nouveau.so (libc6,x86-64) => /lib64/libdrm_nouveau.so libdrm_intel.so.1 (libc6,x86-64) => /lib64/libdrm_intel.so.1 libdrm_intel.so (libc6,x86-64) => /lib64/libdrm_intel.so libdrm_amdgpu.so.1 (libc6,x86-64) => /lib64/libdrm_amdgpu.so.1 libdrm_amdgpu.so (libc6,x86-64) => /lib64/libdrm_amdgpu.so libdrm.so.2 (libc6,x86-64) => /lib64/libdrm.so.2 libdrm.so (libc6,x86-64) => /lib64/libdrm.so libdns.so.1102 (libc6,x86-64) => /lib64/libdns.so.1102 libdns-export.so.1102 (libc6,x86-64) => /usr/lib64//bind9-export/libdns-export.so.1102 libdnf.so.2 (libc6,x86-64) => /lib64/libdnf.so.2 libdl.so.2 (libc6,x86-64, OS ABI: Linux 3.2.0) => /lib64/libdl.so.2 libdl.so (libc6,x86-64, OS ABI: Linux 3.2.0) => /lib64/libdl.so libdhcpctl.so.0 (libc6,x86-64) => /lib64/libdhcpctl.so.0 libdhash.so.1 (libc6,x86-64) => /lib64/libdhash.so.1 libdevmapper.so.1.02 (libc6,x86-64) => /lib64/libdevmapper.so.1.02 libdevmapper-event.so.1.02 (libc6,x86-64) => /lib64/libdevmapper-event.so.1.02 libdevmapper-event-lvm2vdo.so (libc6,x86-64) => /lib64/libdevmapper-event-lvm2vdo.so libdevmapper-event-lvm2thin.so (libc6,x86-64) => /lib64/libdevmapper-event-lvm2thin.so libdevmapper-event-lvm2snapshot.so (libc6,x86-64) => /lib64/libdevmapper-event-lvm2snapshot.so libdevmapper-event-lvm2raid.so (libc6,x86-64) => /lib64/libdevmapper-event-lvm2raid.so libdevmapper-event-lvm2mirror.so (libc6,x86-64) => /lib64/libdevmapper-event-lvm2mirror.so libdevmapper-event-lvm2.so.2.02 (libc6,x86-64) => /lib64/libdevmapper-event-lvm2.so.2.02 libdcerpc.so.0 (libc6,x86-64) => /lib64/libdcerpc.so.0 libdcerpc-samr.so.0 (libc6,x86-64) => /lib64/libdcerpc-samr.so.0 libdcerpc-binding.so.0 (libc6,x86-64) => /lib64/libdcerpc-binding.so.0 libdbus-1.so.3 (libc6,x86-64) => /lib64/libdbus-1.so.3 libdb-5.3.so (libc6,x86-64) => /lib64/libdb-5.3.so libcurl.so.4 (libc6,x86-64) => /lib64/libcurl.so.4 libcupsppdc.so.1 (libc6,x86-64) => /lib64/libcupsppdc.so.1 libcupsmime.so.1 (libc6,x86-64) => /lib64/libcupsmime.so.1 libcupsimage.so.2 (libc6,x86-64) => /lib64/libcupsimage.so.2 libcupscgi.so.1 (libc6,x86-64) => /lib64/libcupscgi.so.1 libcups.so.2 (libc6,x86-64) => /lib64/libcups.so.2 libcuda.so.1 (libc6,x86-64) => /lib64/libcuda.so.1 libcuda.so.1 (libc6) => /lib/libcuda.so.1 libcuda.so (libc6,x86-64) => /lib64/libcuda.so libcuda.so (libc6) => /lib/libcuda.so libcryptsetup.so.12 (libc6,x86-64) => /lib64/libcryptsetup.so.12 libcrypto.so.1.1 (libc6,x86-64) => /lib64/libcrypto.so.1.1 libcrypt.so.1 (libc6,x86-64) => /lib64/libcrypt.so.1 libcrypt.so (libc6,x86-64) => /lib64/libcrypt.so libcroco-0.6.so.3 (libc6,x86-64) => /lib64/libcroco-0.6.so.3 libcrack.so.2 (libc6,x86-64) => /lib64/libcrack.so.2 libcord.so.1 (libc6,x86-64) => /lib64/libcord.so.1 libcomps.so.0.1.6 (libc6,x86-64) => /lib64/libcomps.so.0.1.6 libcom_err.so.2 (libc6,x86-64) => /lib64/libcom_err.so.2 libcollection.so.4 (libc6,x86-64) => /lib64/libcollection.so.4 libcares.so.2 (libc6,x86-64) => /lib64/libcares.so.2 libcap.so.2 (libc6,x86-64) => /lib64/libcap.so.2 libcap-ng.so.0 (libc6,x86-64) => /lib64/libcap-ng.so.0 libc.so.6 (libc6,x86-64, OS ABI: Linux 3.2.0) => /lib64/libc.so.6 libbz2.so.1 (libc6,x86-64) => /lib64/libbz2.so.1 libbrotlienc.so.1 (libc6,x86-64) => /lib64/libbrotlienc.so.1 libbrotlidec.so.1 (libc6,x86-64) => /lib64/libbrotlidec.so.1 libbrotlicommon.so.1 (libc6,x86-64) => /lib64/libbrotlicommon.so.1 libblkid.so.1 (libc6,x86-64) => /lib64/libblkid.so.1 libbind9.so.160 (libc6,x86-64) => /lib64/libbind9.so.160 libbfd-2.31.1-15.fc29.so (libc6,x86-64) => /lib64/libbfd-2.31.1-15.fc29.so libbasicobjects.so.0 (libc6,x86-64) => /lib64/libbasicobjects.so.0 libavahi-common.so.3 (libc6,x86-64) => /lib64/libavahi-common.so.3 libavahi-client.so.3 (libc6,x86-64) => /lib64/libavahi-client.so.3 libauthselect.so.1 (libc6,x86-64) => /lib64/libauthselect.so.1 libauparse.so.0 (libc6,x86-64) => /lib64/libauparse.so.0 libaudit.so.1 (libc6,x86-64) => /lib64/libaudit.so.1 libattr.so.1 (libc6,x86-64) => /lib64/libattr.so.1 libatomic_ops_gpl.so.1 (libc6,x86-64) => /lib64/libatomic_ops_gpl.so.1 libatomic_ops.so.1 (libc6,x86-64) => /lib64/libatomic_ops.so.1 libatm.so.1 (libc6,x86-64) => /lib64/libatm.so.1 libassuan.so.0 (libc6,x86-64) => /lib64/libassuan.so.0 libasprintf.so.0 (libc6,x86-64) => /lib64/libasprintf.so.0 libasm.so.1 (libc6,x86-64) => /lib64/libasm.so.1 libargon2.so.0 (libc6,x86-64) => /lib64/libargon2.so.0 libarchive.so.13 (libc6,x86-64) => /lib64/libarchive.so.13 libanl.so.1 (libc6,x86-64, OS ABI: Linux 3.2.0) => /lib64/libanl.so.1 libanl.so (libc6,x86-64, OS ABI: Linux 3.2.0) => /lib64/libanl.so libaio.so.1.0.0 (libc6,x86-64) => /lib64/libaio.so.1.0.0 libaio.so.1 (libc6,x86-64) => /lib64/libaio.so.1 libacl.so.1 (libc6,x86-64) => /lib64/libacl.so.1 libX11.so.6 (libc6,x86-64) => /lib64/libX11.so.6 libX11.so (libc6,x86-64) => /lib64/libX11.so libX11-xcb.so.1 (libc6,x86-64) => /lib64/libX11-xcb.so.1 libX11-xcb.so (libc6,x86-64) => /lib64/libX11-xcb.so libXxf86vm.so.1 (libc6,x86-64) => /lib64/libXxf86vm.so.1 libXxf86vm.so (libc6,x86-64) => /lib64/libXxf86vm.so libXt.so.6 (libc6,x86-64) => /lib64/libXt.so.6 libXt.so (libc6,x86-64) => /lib64/libXt.so libXmuu.so.1 (libc6,x86-64) => /lib64/libXmuu.so.1 libXmuu.so (libc6,x86-64) => /lib64/libXmuu.so libXmu.so.6 (libc6,x86-64) => /lib64/libXmu.so.6 libXmu.so (libc6,x86-64) => /lib64/libXmu.so libXi.so.6 (libc6,x86-64) => /lib64/libXi.so.6 libXi.so (libc6,x86-64) => /lib64/libXi.so libXfixes.so.3 (libc6,x86-64) => /lib64/libXfixes.so.3 libXfixes.so (libc6,x86-64) => /lib64/libXfixes.so libXext.so.6 (libc6,x86-64) => /lib64/libXext.so.6 libXext.so (libc6,x86-64) => /lib64/libXext.so libXdamage.so.1 (libc6,x86-64) => /lib64/libXdamage.so.1 libXdamage.so (libc6,x86-64) => /lib64/libXdamage.so libXau.so.6 (libc6,x86-64) => /lib64/libXau.so.6 libXau.so (libc6,x86-64) => /lib64/libXau.so libSegFault.so (libc6,x86-64, OS ABI: Linux 3.2.0) => /lib64/libSegFault.so libSM.so.6 (libc6,x86-64) => /lib64/libSM.so.6 libSM.so (libc6,x86-64) => /lib64/libSM.so libOpenGL.so.0 (libc6,x86-64) => /lib64/libOpenGL.so.0 libOpenGL.so (libc6,x86-64) => /lib64/libOpenGL.so libOpenCL.so.1 (libc6,x86-64) => /lib64/libOpenCL.so.1 libOpenCL.so.1 (libc6) => /lib/libOpenCL.so.1 libOpenCL.so (libc6,x86-64) => /lib64/libOpenCL.so libOpenCL.so (libc6) => /lib/libOpenCL.so libICE.so.6 (libc6,x86-64) => /lib64/libICE.so.6 libICE.so (libc6,x86-64) => /lib64/libICE.so libGeoIP.so.1 (libc6,x86-64) => /lib64/libGeoIP.so.1 libGLdispatch.so.0 (libc6,x86-64) => /lib64/libGLdispatch.so.0 libGLdispatch.so (libc6,x86-64) => /lib64/libGLdispatch.so libGLX_nvidia.so.0 (libc6,x86-64) => /lib64/libGLX_nvidia.so.0 libGLX_nvidia.so.0 (libc6) => /lib/libGLX_nvidia.so.0 libGLX_mesa.so.0 (libc6,x86-64) => /lib64/libGLX_mesa.so.0 libGLX.so.0 (libc6,x86-64) => /lib64/libGLX.so.0 libGLX.so (libc6,x86-64) => /lib64/libGLX.so libGLU.so.1 (libc6,x86-64) => /lib64/libGLU.so.1 libGLU.so (libc6,x86-64) => /lib64/libGLU.so libGLESv2_nvidia.so.2 (libc6,x86-64) => /lib64/libGLESv2_nvidia.so.2 libGLESv2_nvidia.so.2 (libc6) => /lib/libGLESv2_nvidia.so.2 libGLESv2.so.2 (libc6,x86-64) => /lib64/libGLESv2.so.2 libGLESv2.so (libc6,x86-64) => /lib64/libGLESv2.so libGLESv1_CM_nvidia.so.1 (libc6,x86-64) => /lib64/libGLESv1_CM_nvidia.so.1 libGLESv1_CM_nvidia.so.1 (libc6) => /lib/libGLESv1_CM_nvidia.so.1 libGLESv1_CM.so.1 (libc6,x86-64) => /lib64/libGLESv1_CM.so.1 libGLESv1_CM.so (libc6,x86-64) => /lib64/libGLESv1_CM.so libGL.so.1 (libc6,x86-64) => /lib64/libGL.so.1 libGL.so (libc6,x86-64) => /lib64/libGL.so libEGL_nvidia.so.0 (libc6,x86-64) => /lib64/libEGL_nvidia.so.0 libEGL_nvidia.so.0 (libc6) => /lib/libEGL_nvidia.so.0 libEGL_mesa.so.0 (libc6,x86-64) => /lib64/libEGL_mesa.so.0 libEGL.so.1 (libc6,x86-64) => /lib64/libEGL.so.1 libEGL.so (libc6,x86-64) => /lib64/libEGL.so libBrokenLocale.so.1 (libc6,x86-64, OS ABI: Linux 3.2.0) => /lib64/libBrokenLocale.so.1 libBrokenLocale.so (libc6,x86-64, OS ABI: Linux 3.2.0) => /lib64/libBrokenLocale.so ld-linux-x86-64.so.2 (libc6,x86-64) => /lib64/ld-linux-x86-64.so.2

MateoObregon commented 5 years ago

I have the same problem! ldconfig -p from within the nividia-docker produces:

ldconfig -p 0 libs found in cache `/etc/ld.so.cache'

env D_LIBRARY_PATH=/usr/local/cuda/extras/CUPTI/lib64:/usr/local/nvidia/lib:/usr/local/nvidia/lib64 NVIDIA_DRIVER_CAPABILITIES=compute,utility PATH=/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin

nvidia-smi NVIDIA-SMI couldn't find libnvidia-ml.so library in your system.

find / -name "libnvidia-ml." -ls 1180954 1284 -rw-r--r-- 1 root root 1314560 Aug 22 00:34 /usr/lib/x86_64-linux-gnu/libnvidia-ml.so.390.87

However, no "libnvidia-ml.so" file is found!

cd /usr/lib/x86_64-linux-gnu ln -s libnvidia-ml.so.390.87 libnvidia-ml.so.1 ln -s libnvidia-ml.so.1 libnvidia-ml.so

nvidia-smi Tue Dec 18 23:49:01 2018 +-----------------------------------------------------------------------------+ | NVIDIA-SMI 390.87 Driver Version: 390.87 | |-------------------------------+----------------------+----------------------+ | GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC | | Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. | |===============================+======================+======================| | 0 GeForce GTX 107... Off | 00000000:01:00.0 On | N/A | | N/A 47C P0 33W / N/A | 542MiB / 8116MiB | 0% Default | +-------------------------------+----------------------+----------------------+

+-----------------------------------------------------------------------------+ | Processes: GPU Memory | | GPU PID Type Process name Usage | |=============================================================================| +-----------------------------------------------------------------------------+

Some is very wrong with the CUDA setup (both lib names and environment paths) within nvidia-docker.

How can this be fixed?

mxmathieu commented 5 years ago

In my scenario, the problem appears to be the same than in this issue : https://github.com/NVIDIA/nvidia-docker/issues/854

RenaudWasTaken commented 5 years ago

Hello all!

Sorry for the delay, I have a bit more time available to look into these issues. Can you run sudo nvidia-container-cli -k -d /dev/tty info and paste the logs?

RenaudWasTaken commented 5 years ago

@MateoObregon your problem really seems to be a driver installation issue. You should try to remove all driver installed and either install the driver from our website or you can try the driver container

mxmathieu commented 5 years ago

@RenaudWasTaken Thanks for your time, here is the command's output from your command on the host :

I1219 15:29:56.279065 14790 nvc.c:281] initializing library context (version=1.0.0, build=881c88e2e5bb682c9bb14e68bd165cfb64563bb1) I1219 15:29:56.279298 14790 nvc.c:255] using root / I1219 15:29:56.279313 14790 nvc.c:256] using ldcache /etc/ld.so.cache I1219 15:29:56.279331 14790 nvc.c:257] using unprivileged user 65534:65534 I1219 15:29:56.283493 14791 nvc.c:191] loading kernel module nvidia I1219 15:29:56.283985 14791 nvc.c:203] loading kernel module nvidia_uvm I1219 15:29:56.284269 14791 nvc.c:211] loading kernel module nvidia_modeset I1219 15:29:56.285230 14792 driver.c:133] starting driver service I1219 15:29:56.299973 14790 nvc_info.c:433] requesting driver information with '' I1219 15:29:56.300623 14790 nvc_info.c:147] selecting /usr/lib64/vdpau/libvdpau_nvidia.so.415.22 I1219 15:29:56.300852 14790 nvc_info.c:147] selecting /usr/lib64/libnvidia-tls.so.415.22 I1219 15:29:56.300971 14790 nvc_info.c:147] selecting /usr/lib64/libnvidia-ptxjitcompiler.so.415.22 I1219 15:29:56.301129 14790 nvc_info.c:147] selecting /usr/lib64/libnvidia-opencl.so.415.22 I1219 15:29:56.301206 14790 nvc_info.c:147] selecting /usr/lib64/libnvidia-ml.so.415.22 I1219 15:29:56.301368 14790 nvc_info.c:147] selecting /usr/lib64/libnvidia-ifr.so.415.22 I1219 15:29:56.301516 14790 nvc_info.c:147] selecting /usr/lib64/libnvidia-glsi.so.415.22 I1219 15:29:56.301607 14790 nvc_info.c:147] selecting /usr/lib64/libnvidia-glcore.so.415.22 I1219 15:29:56.301727 14790 nvc_info.c:147] selecting /usr/lib64/libnvidia-fbc.so.415.22 I1219 15:29:56.301871 14790 nvc_info.c:147] selecting /usr/lib64/libnvidia-fatbinaryloader.so.415.22 I1219 15:29:56.301979 14790 nvc_info.c:147] selecting /usr/lib64/libnvidia-encode.so.415.22 I1219 15:29:56.302116 14790 nvc_info.c:147] selecting /usr/lib64/libnvidia-eglcore.so.415.22 I1219 15:29:56.302191 14790 nvc_info.c:147] selecting /usr/lib64/libnvidia-compiler.so.415.22 I1219 15:29:56.302293 14790 nvc_info.c:147] selecting /usr/lib64/libnvidia-cfg.so.415.22 I1219 15:29:56.302447 14790 nvc_info.c:147] selecting /usr/lib64/libnvcuvid.so.415.22 I1219 15:29:56.302739 14790 nvc_info.c:147] selecting /usr/lib64/libcuda.so.415.22 I1219 15:29:56.302976 14790 nvc_info.c:147] selecting /usr/lib64/libGLX_nvidia.so.415.22 I1219 15:29:56.303101 14790 nvc_info.c:147] selecting /usr/lib64/libGLESv2_nvidia.so.415.22 I1219 15:29:56.303214 14790 nvc_info.c:147] selecting /usr/lib64/libGLESv1_CM_nvidia.so.415.22 I1219 15:29:56.303326 14790 nvc_info.c:147] selecting /usr/lib64/libEGL_nvidia.so.415.22 I1219 15:29:56.303549 14790 nvc_info.c:147] selecting /usr/lib/vdpau/libvdpau_nvidia.so.415.22 I1219 15:29:56.303658 14790 nvc_info.c:147] selecting /usr/lib/libnvidia-tls.so.415.22 I1219 15:29:56.303767 14790 nvc_info.c:147] selecting /usr/lib/libnvidia-ptxjitcompiler.so.415.22 I1219 15:29:56.303939 14790 nvc_info.c:147] selecting /usr/lib/libnvidia-opencl.so.415.22 I1219 15:29:56.304052 14790 nvc_info.c:147] selecting /usr/lib/libnvidia-ml.so.415.22 I1219 15:29:56.304201 14790 nvc_info.c:147] selecting /usr/lib/libnvidia-ifr.so.415.22 I1219 15:29:56.304337 14790 nvc_info.c:147] selecting /usr/lib/libnvidia-glsi.so.415.22 I1219 15:29:56.304424 14790 nvc_info.c:147] selecting /usr/lib/libnvidia-glcore.so.415.22 I1219 15:29:56.304554 14790 nvc_info.c:147] selecting /usr/lib/libnvidia-fbc.so.415.22 I1219 15:29:56.304682 14790 nvc_info.c:147] selecting /usr/lib/libnvidia-fatbinaryloader.so.415.22 I1219 15:29:56.304800 14790 nvc_info.c:147] selecting /usr/lib/libnvidia-encode.so.415.22 I1219 15:29:56.304938 14790 nvc_info.c:147] selecting /usr/lib/libnvidia-eglcore.so.415.22 I1219 15:29:56.305028 14790 nvc_info.c:147] selecting /usr/lib/libnvidia-compiler.so.415.22 I1219 15:29:56.305136 14790 nvc_info.c:147] selecting /usr/lib/libnvcuvid.so.415.22 I1219 15:29:56.305287 14790 nvc_info.c:147] selecting /usr/lib/libcuda.so.415.22 I1219 15:29:56.305453 14790 nvc_info.c:147] selecting /usr/lib/libGLX_nvidia.so.415.22 I1219 15:29:56.305553 14790 nvc_info.c:147] selecting /usr/lib/libGLESv2_nvidia.so.415.22 I1219 15:29:56.305647 14790 nvc_info.c:147] selecting /usr/lib/libGLESv1_CM_nvidia.so.415.22 I1219 15:29:56.305745 14790 nvc_info.c:147] selecting /usr/lib/libEGL_nvidia.so.415.22 W1219 15:29:56.305795 14790 nvc_info.c:302] missing compat32 library libnvidia-cfg.so I1219 15:29:56.306196 14790 nvc_info.c:228] selecting /usr/bin/nvidia-smi I1219 15:29:56.306237 14790 nvc_info.c:228] selecting /usr/bin/nvidia-debugdump I1219 15:29:56.306270 14790 nvc_info.c:228] selecting /usr/bin/nvidia-persistenced I1219 15:29:56.306305 14790 nvc_info.c:228] selecting /usr/bin/nvidia-cuda-mps-control I1219 15:29:56.306338 14790 nvc_info.c:228] selecting /usr/bin/nvidia-cuda-mps-server I1219 15:29:56.306380 14790 nvc_info.c:365] listing device /dev/nvidiactl I1219 15:29:56.306391 14790 nvc_info.c:365] listing device /dev/nvidia-uvm I1219 15:29:56.306399 14790 nvc_info.c:365] listing device /dev/nvidia-uvm-tools I1219 15:29:56.306406 14790 nvc_info.c:365] listing device /dev/nvidia-modeset W1219 15:29:56.306639 14790 nvc_info.c:273] missing ipc /var/run/nvidia-persistenced/socket W1219 15:29:56.306774 14790 nvc_info.c:273] missing ipc /tmp/nvidia-mps I1219 15:29:56.306798 14790 nvc_info.c:489] requesting device information with '' I1219 15:29:56.313697 14790 nvc_info.c:519] listing device /dev/nvidia0 (GPU-ba9aaa0f-63d8-ec40-3ce5-42c372ab4d38 at 00000000:06:00.0) NVRM version: 415.22 CUDA version: 10.0

Device Index: 0 Device Minor: 0 Model: GeForce GT 1030 Brand: GeForce GPU UUID: GPU-ba9aaa0f-63d8-ec40-3ce5-42c372ab4d38 Bus Location: 00000000:06:00.0 Architecture: 6.1 I1219 15:29:56.313761 14790 nvc.c:318] shutting down library context I1219 15:29:56.314261 14792 driver.c:192] terminating driver service I1219 15:29:56.315722 14790 driver.c:233] driver service terminated successfully

RenaudWasTaken commented 5 years ago

@mxmathieu I suspect you are right and that you are in the same issue as #854 since you are on ubuntu18.10

We will be releasing a new version over the course of January (second week?). In the meantime the only solution you have is to manually recompile the library and install it on your system...

I'll close this issue when we have a new release.

mxmathieu commented 5 years ago

@RenaudWasTaken I'm running Fedora 29 but as Ubuntu 18.10 it's a fresh update. Your answer has an ETA and I like this one. Thanks again for your time.

MateoObregon commented 5 years ago

@MateoObregon your problem really seems to be a driver installation issue. You should try to remove all driver installed and either install the driver from our website or you can try the driver container

Thanks for your reply @RenaudWasTaken. I'm running Debian Buster/Sid and the Nvidia 1070 card gets used amply by other programs (as evidenced by nvidia-smi). I'll try download the nvidia-container source and proceeding from there.

RenaudWasTaken commented 5 years ago

Thanks for your reply @RenaudWasTaken. I'm running Debian Buster/Sid and the Nvidia 1070 card gets used amply by other programs (as evidenced by nvidia-smi).

nvidia-smi doesn't do any CUDA calls and your ldconfig -p output is completely empty this points rather heavily to a driver install.

I'll try download the nvidia-container source and proceeding from there.

This won't change anything, as if your lib is not available in ldconfig, we won't be able to find it whether you install from source or from the package.

MateoObregon commented 5 years ago

This won't change anything, as if your lib is not available in ldconfig, we won't be able to find it whether you install from source or from the package.

"ldconfig -p | grep -i nviida" on my machine produces:

libnvidia-tls.so.390.87 (libc6,x86-64, OS ABI: Linux 2.3.99) => /usr/lib/x86_64-linux-gnu/libnvidia-tls.so.390.87 libnvidia-ptxjitcompiler.so.1 (libc6,x86-64) => /usr/lib/x86_64-linux-gnu/libnvidia-ptxjitcompiler.so.1 libnvidia-opencl.so.1 (libc6,x86-64) => /usr/lib/x86_64-linux-gnu/libnvidia-opencl.so.1 libnvidia-ml.so.1 (libc6,x86-64) => /usr/lib/x86_64-linux-gnu/libnvidia-ml.so.1 libnvidia-gtk3.so.390.67 (libc6,x86-64) => /usr/lib/libnvidia-gtk3.so.390.67 libnvidia-gtk2.so.390.67 (libc6,x86-64) => /usr/lib/libnvidia-gtk2.so.390.67 libnvidia-glsi.so.390.87 (libc6,x86-64) => /usr/lib/x86_64-linux-gnu/libnvidia-glsi.so.390.87 libnvidia-glcore.so.390.87 (libc6,x86-64) => /usr/lib/x86_64-linux-gnu/libnvidia-glcore.so.390.87 libnvidia-fatbinaryloader.so.390.87 (libc6,x86-64) => /usr/lib/x86_64-linux-gnu/libnvidia-fatbinaryloader.so.390.87 libnvidia-eglcore.so.390.87 (libc6,x86-64) => /usr/lib/x86_64-linux-gnu/libnvidia-eglcore.so.390.87 libnvidia-container.so.1 (libc6,x86-64) => /usr/lib/x86_64-linux-gnu/libnvidia-container.so.1 libnvidia-compiler.so.390.87 (libc6,x86-64) => /usr/lib/x86_64-linux-gnu/libnvidia-compiler.so.390.87 libnvidia-cfg.so.1 (libc6,x86-64) => /usr/lib/x86_64-linux-gnu/libnvidia-cfg.so.1 libGLX_nvidia.so.0 (libc6,x86-64) => /usr/lib/x86_64-linux-gnu/libGLX_nvidia.so.0 libGLESv2_nvidia.so.2 (libc6,x86-64) => /usr/lib/x86_64-linux-gnu/libGLESv2_nvidia.so.2 libGLESv1_CM_nvidia.so.1 (libc6,x86-64) => /usr/lib/x86_64-linux-gnu/libGLESv1_CM_nvidia.so.1 libEGL_nvidia.so.0 (libc6,x86-64) => /usr/lib/x86_64-linux-gnu/libEGL_nvidia.so.0

UPDATE: I cloned libnvidia-docker and "make docker-debian:9" and installed the .deb packages. Now, when I run nvidia-docker, nvidia-smi worked!

RenaudWasTaken commented 5 years ago

Ah sorry I didn't see that your first call to ldconfig -p was in the container... In which case you are probably facing the same issue and need to rebuild libnvidia-docker not nvidia-container

RenaudWasTaken commented 5 years ago

This should be fixed with the latest version of the libnvidia-container packages. Closing, feel free to reopen if the bug persists.

mxmathieu commented 5 years ago

This is fixed on my side. Thanks.

imranparuk commented 5 years ago

I am having this issue, what system info do you require to see if its valid.