[amdgpu] vulkan is not available but llvmpipe

[nxjosephofficial]

Describe the bug My system uses llvmpipe for rendering instead of vulkan. Tested with glxgears and vkcube.

FreeBSD version FreeBSD desktop.home.lan 14.0-STABLE FreeBSD 14.0-STABLE #1 stable/14-n266940-275aee513b58: Fri Mar 8 07:11:22 +03 2024 root@desktop.home.lan:/usr/obj/usr/src/amd64.amd64/sys/CUSTOM amd64 1400509 1400509

PCI Info

pciconf -lv

``` hostb0@pci0:0:0:0: class=0x060000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x1630 subvendor=0x1043 subdevice=0x87e1 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'Renoir/Cezanne Root Complex' class = bridge subclass = HOST-PCI amdiommu0@pci0:0:0:2: class=0x080600 rev=0x00 hdr=0x00 vendor=0x1022 device=0x1631 subvendor=0x1043 subdevice=0x87e1 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'Renoir/Cezanne IOMMU' class = base peripheral subclass = IOMMU hostb1@pci0:0:1:0: class=0x060000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x1632 subvendor=0x0000 subdevice=0x0000 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'Renoir PCIe Dummy Host Bridge' class = bridge subclass = HOST-PCI hostb2@pci0:0:2:0: class=0x060000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x1632 subvendor=0x0000 subdevice=0x0000 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'Renoir PCIe Dummy Host Bridge' class = bridge subclass = HOST-PCI pcib1@pci0:0:2:1: class=0x060400 rev=0x00 hdr=0x01 vendor=0x1022 device=0x1634 subvendor=0x1043 subdevice=0x87e1 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'Renoir/Cezanne PCIe GPP Bridge' class = bridge subclass = PCI-PCI pcib7@pci0:0:2:2: class=0x060400 rev=0x00 hdr=0x01 vendor=0x1022 device=0x1634 subvendor=0x1043 subdevice=0x87e1 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'Renoir/Cezanne PCIe GPP Bridge' class = bridge subclass = PCI-PCI hostb3@pci0:0:8:0: class=0x060000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x1632 subvendor=0x0000 subdevice=0x0000 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'Renoir PCIe Dummy Host Bridge' class = bridge subclass = HOST-PCI pcib8@pci0:0:8:1: class=0x060400 rev=0x00 hdr=0x01 vendor=0x1022 device=0x1635 subvendor=0x1043 subdevice=0x87e1 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'Renoir Internal PCIe GPP Bridge to Bus' class = bridge subclass = PCI-PCI intsmb0@pci0:0:20:0: class=0x0c0500 rev=0x51 hdr=0x00 vendor=0x1022 device=0x790b subvendor=0x1043 subdevice=0x87e1 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'FCH SMBus Controller' class = serial bus subclass = SMBus isab0@pci0:0:20:3: class=0x060100 rev=0x51 hdr=0x00 vendor=0x1022 device=0x790e subvendor=0x1043 subdevice=0x87e1 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'FCH LPC Bridge' class = bridge subclass = PCI-ISA hostb4@pci0:0:24:0: class=0x060000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x1448 subvendor=0x0000 subdevice=0x0000 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'Renoir Device 24: Function 0' class = bridge subclass = HOST-PCI hostb5@pci0:0:24:1: class=0x060000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x1449 subvendor=0x0000 subdevice=0x0000 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'Renoir Device 24: Function 1' class = bridge subclass = HOST-PCI hostb6@pci0:0:24:2: class=0x060000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x144a subvendor=0x0000 subdevice=0x0000 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'Renoir Device 24: Function 2' class = bridge subclass = HOST-PCI hostb7@pci0:0:24:3: class=0x060000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x144b subvendor=0x0000 subdevice=0x0000 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'Renoir Device 24: Function 3' class = bridge subclass = HOST-PCI hostb8@pci0:0:24:4: class=0x060000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x144c subvendor=0x0000 subdevice=0x0000 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'Renoir Device 24: Function 4' class = bridge subclass = HOST-PCI hostb9@pci0:0:24:5: class=0x060000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x144d subvendor=0x0000 subdevice=0x0000 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'Renoir Device 24: Function 5' class = bridge subclass = HOST-PCI hostb10@pci0:0:24:6: class=0x060000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x144e subvendor=0x0000 subdevice=0x0000 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'Renoir Device 24: Function 6' class = bridge subclass = HOST-PCI hostb11@pci0:0:24:7: class=0x060000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x144f subvendor=0x0000 subdevice=0x0000 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'Renoir Device 24: Function 7' class = bridge subclass = HOST-PCI ppt0@pci0:1:0:0: class=0x0c0330 rev=0x00 hdr=0x00 vendor=0x1022 device=0x43ec subvendor=0x1b21 subdevice=0x1142 vendor = 'Advanced Micro Devices, Inc. [AMD]' class = serial bus subclass = USB ahci0@pci0:1:0:1: class=0x010601 rev=0x00 hdr=0x00 vendor=0x1022 device=0x43eb subvendor=0x1b21 subdevice=0x1062 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = '500 Series Chipset SATA Controller' class = mass storage subclass = SATA pcib2@pci0:1:0:2: class=0x060400 rev=0x00 hdr=0x01 vendor=0x1022 device=0x43e9 subvendor=0x1b21 subdevice=0x0201 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = '500 Series Chipset Switch Upstream Port' class = bridge subclass = PCI-PCI pcib3@pci0:2:0:0: class=0x060400 rev=0x00 hdr=0x01 vendor=0x1022 device=0x43ea subvendor=0x1b21 subdevice=0x3308 vendor = 'Advanced Micro Devices, Inc. [AMD]' class = bridge subclass = PCI-PCI pcib4@pci0:2:1:0: class=0x060400 rev=0x00 hdr=0x01 vendor=0x1022 device=0x43ea subvendor=0x1b21 subdevice=0x3308 vendor = 'Advanced Micro Devices, Inc. [AMD]' class = bridge subclass = PCI-PCI pcib5@pci0:2:2:0: class=0x060400 rev=0x00 hdr=0x01 vendor=0x1022 device=0x43ea subvendor=0x1b21 subdevice=0x3308 vendor = 'Advanced Micro Devices, Inc. [AMD]' class = bridge subclass = PCI-PCI pcib6@pci0:2:3:0: class=0x060400 rev=0x00 hdr=0x01 vendor=0x1022 device=0x43ea subvendor=0x1b21 subdevice=0x3308 vendor = 'Advanced Micro Devices, Inc. [AMD]' class = bridge subclass = PCI-PCI re0@pci0:3:0:0: class=0x020000 rev=0x15 hdr=0x00 vendor=0x10ec device=0x8168 subvendor=0x1043 subdevice=0x8677 vendor = 'Realtek Semiconductor Co., Ltd.' device = 'RTL8111/8168/8211/8411 PCI Express Gigabit Ethernet Controller' class = network subclass = ethernet nvme0@pci0:7:0:0: class=0x010802 rev=0x03 hdr=0x00 vendor=0x126f device=0x2263 subvendor=0x126f subdevice=0x2263 vendor = 'Silicon Motion, Inc.' device = 'SM2263EN/SM2263XT (DRAM-less) NVMe SSD Controllers' class = mass storage subclass = NVM vgapci0@pci0:8:0:0: class=0x030000 rev=0xcd hdr=0x00 vendor=0x1002 device=0x1636 subvendor=0x1043 subdevice=0x87e1 vendor = 'Advanced Micro Devices, Inc. [AMD/ATI]' device = 'Renoir [Radeon RX Vega 6 (Ryzen 4000/5000 Mobile Series)]' class = display subclass = VGA hdac0@pci0:8:0:1: class=0x040300 rev=0x00 hdr=0x00 vendor=0x1002 device=0x1637 subvendor=0x1043 subdevice=0x87e1 vendor = 'Advanced Micro Devices, Inc. [AMD/ATI]' device = 'Renoir Radeon High Definition Audio Controller' class = multimedia subclass = HDA none0@pci0:8:0:2: class=0x108000 rev=0x00 hdr=0x00 vendor=0x1022 device=0x15df subvendor=0x1043 subdevice=0x87e1 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'Family 17h (Models 10h-1fh) Platform Security Processor' class = encrypt/decrypt xhci0@pci0:8:0:3: class=0x0c0330 rev=0x00 hdr=0x00 vendor=0x1022 device=0x1639 subvendor=0x1043 subdevice=0x87e1 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'Renoir/Cezanne USB 3.1' class = serial bus subclass = USB xhci1@pci0:8:0:4: class=0x0c0330 rev=0x00 hdr=0x00 vendor=0x1022 device=0x1639 subvendor=0x1043 subdevice=0x87e1 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'Renoir/Cezanne USB 3.1' class = serial bus subclass = USB hdac1@pci0:8:0:6: class=0x040300 rev=0x00 hdr=0x00 vendor=0x1022 device=0x15e3 subvendor=0x1043 subdevice=0x86c7 vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'Family 17h/19h HD Audio Controller' class = multimedia subclass = HDA ```

DRM KMOD version drm-61-kmod 6.1.69_1

To Reproduce

% sudo kldload linux64
% sudo kldload nullfs
% sudo sysctl security.bsd.unprivileged_chroot=1
% sudo sysctl vfs.usermount=1
% fetch https://gist.githubusercontent.com/shkhln/99ed7076d981a8eee39801bb6634caed/raw/c6f6d38688e02f8131930d475fb5f4f4a51e4893/linux-chroot
% chmod +x linux-chroot
% ./linux-chroot /usr/bin/glxgears -info | grep RENDER
% ./linux-chroot /usr/bin/vkcube

Screenshots

[evadot]

What about native vkcube ? You seems to be using a linux version.

[nxjosephofficial]

Native vkcube:

Selected GPU 0: AMD Radeon Graphics (RADV RENOIR), type: IntegratedGpu

[nxjosephofficial]

native glxgears shows llvmpipe

% glxgears -info | grep RENDER
failed to authenticate magic 1
failed to load driver: radeonsi
GL_RENDERER   = llvmpipe (LLVM 15.0.7, 256 bits)

[evadot]

failed to authenticate magic 1 Are you a member of the 'video' group ? failed to load driver: radeonsi Do you have mesa-dri correctly installed ?

[nxjosephofficial]

Yes, my users are member of the video group. I installed mesa-dri and mesa-libs from ports, they were 24.0.1 before i installed their new version from ports.

$ pkg info -a | grep mesa
mesa-dri-24.0.2                OpenGL hardware acceleration drivers for DRI2+
mesa-libs-24.0.2               OpenGL libraries that support GLX and EGL clients

$ glxgears -info | grep RENDER
GL_RENDERER   = AMD Radeon Graphics (radeonsi, renoir, LLVM 15.0.7, DRM 3.49, 14.0-STABLE)

$ ./linux-chroot /usr/bin/glxgears -info | grep RENDER
mount -o nocover -t tmpfs tmpfs /home/steam/umnt
mount: tmpfs: Device busy
Assuming /home/steam/umnt is already set up.
amdgpu: os_same_file_description couldn't determine if two DRM fds reference the same file description.
If they do, bad things may happen!
GL_RENDERER   = RENOIR (renoir, LLVM 15.0.7, DRM 3.49, 5.15.0)

But vkcube in linux emulation shows llvmpipe.

[evadot]

I'm lost, please clarify the problem, are you seeing problem with native applications ? https://github.com/freebsd/drm-kmod/issues/290#issuecomment-1986865390 seems to indicate that you have issue but your last comment seems to say that everything is fine.

Is the only problem that you are seeing is vulkan using llvmpipe under linux compat ?

[nxjosephofficial]

I saw minecraft that i run natively was using llvmpipe but now after upgrading mesa-dri, mesa-libs to latest version, it seems fine. I can't test minecraft again but i am going to test vulkan in steam thats running under linux compat soon.

My problem was "not being able to use vulkan under linux compatibility".

vkcube under linux compatibility still shows llvmpipe while native is ok..

I still get the vulkan error under linux compat.

[shkhln]

I think I identified the issue (with linsysfs). Try the updated gist at https://gist.githubusercontent.com/shkhln/99ed7076d981a8eee39801bb6634caed/raw/33f0c8be3e8d65cb03641f47947504c65216e33d/linux-chroot.

[nxjosephofficial]

This time vkcube shows my gpu, it seems to work. The cube doesn't turn like crazy. I don't have Dota 2 installed now but i can try soon.

% ./linux-chroot /usr/bin/vkcube
mount -o nocover -t tmpfs tmpfs /home/yusuf/umnt
mount: tmpfs: Device busy
Assuming /home/yusuf/umnt is already set up.
Selected GPU 0: AMD Unknown (RADV RENOIR), type: 1

[nxjosephofficial]

https://github.com/shkhln/linuxulator-steam-utils/issues/129#issuecomment-2048526002

[evadot]

So everything wrt drm-kmod is good ?

[shkhln]

I submitted a bug report regarding linsysfs: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=278363. Let's close this issue.

[evadot]

Thanks.