search

geerlingguy / raspberry-pi-pcie-devices

Raspberry Pi PCI Express device compatibility database
http://pipci.jeffgeerling.com
GNU General Public License v3.0
1.63k stars 145 forks source link

Test EVGA Nvidia RTX 3080 Ti on Raspberry Pi 5 #549

Open geerlingguy opened 1 year ago

geerlingguy commented 1 year ago

I have tested the 3080 Ti on my Raspberry Pi 5 using Raspberry Pi's prototype PCIe adapter. It required an external power supply to feed that adapter and the card itself, and I had to install Nvidia's latest arm64 driver for the 3080 Ti, but after all that, I got the dreaded RmInitAdapter failed! message.

14-487-549-V07

geerlingguy commented 1 year ago

Testing with nouveau now...

pi@pi5:~ $ dmesg | grep nouveau
[    2.938104] nouveau 0000:01:00.0: enabling device (0000 -> 0002)
[    2.938329] nouveau 0000:01:00.0: NVIDIA GA102 (b72000a1)
[    3.404851] nouveau 0000:01:00.0: bios: version 94.02.71.80.74
[    3.426761] nouveau 0000:01:00.0: bios: M0203E type 0a
[    3.426780] nouveau 0000:01:00.0: fb: 12288 MiB of unknown memory type
[    3.461589] nouveau 0000:01:00.0: DRM: VRAM: 12288 MiB
[    3.461602] nouveau 0000:01:00.0: DRM: GART: 536870912 MiB
[    3.461609] nouveau 0000:01:00.0: DRM: BIT table 'A' not found
[    3.461613] nouveau 0000:01:00.0: DRM: BIT table 'L' not found
[    3.461617] nouveau 0000:01:00.0: DRM: TMDS table version 2.0
[    3.461621] nouveau 0000:01:00.0: DRM: DCB version 4.1
[    3.461625] nouveau 0000:01:00.0: DRM: DCB outp 00: 04800f86 04600020
[    3.461630] nouveau 0000:01:00.0: DRM: DCB outp 01: 04000f82 00020020
[    3.461634] nouveau 0000:01:00.0: DRM: DCB outp 02: 04811f76 04600010
[    3.461637] nouveau 0000:01:00.0: DRM: DCB outp 03: 04011f72 00020010
[    3.461641] nouveau 0000:01:00.0: DRM: DCB outp 04: 02822f66 04600020
[    3.461645] nouveau 0000:01:00.0: DRM: DCB outp 05: 02022f62 00020020
[    3.461650] nouveau 0000:01:00.0: DRM: DCB outp 07: 02033f52 00020010
[    3.461655] nouveau 0000:01:00.0: DRM: DCB conn 00: 02000046
[    3.461658] nouveau 0000:01:00.0: DRM: DCB conn 01: 01000146
[    3.461661] nouveau 0000:01:00.0: DRM: DCB conn 02: 00020246
[    3.461665] nouveau 0000:01:00.0: DRM: DCB conn 03: 00010361
[    3.461748] nouveau 0000:01:00.0: DRM: failed to initialise sync subsystem, -22
[    3.495783] nouveau: probe of 0000:01:00.0 failed with error -22
geerlingguy commented 1 year ago

Trying proprietary driver again. First disabling nouveau by creating a file /etc/modprobe.d/blacklist-nouveau.conf with the content:

blacklist nouveau
options nouveau modeset=0

Then after a reboot, it was not loading the nouveau module.

May I interject debugging is SO much more fun when the whole system doesn't freeze every time requiring me to reset power?

geerlingguy commented 1 year ago

Downloading the Nvidia driver from https://www.nvidia.com/en-us/geforce/drivers/results/214101/

wget https://us.download.nvidia.com/XFree86/aarch64/545.29.02/NVIDIA-Linux-aarch64-545.29.02.run
chmod +x NVIDIA-Linux-aarch64-545.29.02.run
sudo ./NVIDIA-Linux-aarch64-545.29.02.run

After installation was complete, I rebooted, and dmesg shows:

[    3.756735] nvidia: loading out-of-tree module taints kernel.
[    3.756757] nvidia: module license 'NVIDIA' taints kernel.
[    3.756760] Disabling lock debugging due to kernel taint
[    3.840532] nvidia-nvlink: Nvlink Core is being initialized, major device number 509

[    3.845903] nvidia 0000:01:00.0: enabling device (0000 -> 0002)
[    3.845947] nvidia 0000:01:00.0: vgaarb: changed VGA decodes: olddecodes=io+mem,decodes=none:owns=none
[    3.890053] NVRM: loading NVIDIA UNIX aarch64 Kernel Module  545.29.02  Thu Oct 26 21:50:44 UTC 2023
[    3.918561] nvidia-modeset: Loading NVIDIA Kernel Mode Setting Driver for UNIX platforms  545.29.02  Thu Oct 26 20:50:54 UTC 2023
[    3.925431] [drm] [nvidia-drm] [GPU ID 0x00000100] Loading driver
[    3.925439] [drm] Initialized nvidia-drm 0.0.0 20160202 for 0000:01:00.0 on minor 2
[    6.148023] NVRM: Chipset not recognized (vendor ID 0x14e4, device ID 0x2712)
[    6.148030] The NVIDIA GPU driver for AArch64 has not been qualified on this platform
               and therefore it is not recommended or intended for use in any production
               environment.
[   10.688237] NVRM: GPU 0000:01:00.0: RmInitAdapter failed! (0x25:0x65:1470)
[   10.688306] NVRM: GPU 0000:01:00.0: rm_init_adapter failed, device minor number 0
[   14.949123] NVRM: GPU 0000:01:00.0: RmInitAdapter failed! (0x25:0x65:1470)
[   14.949180] NVRM: GPU 0000:01:00.0: rm_init_adapter failed, device minor number 0

That fun, and dreaded RmInitAdapter failed!.

geerlingguy commented 1 year ago

See possibly related issues: https://github.com/NVIDIA/open-gpu-kernel-modules/issues/514 and https://github.com/NVIDIA/open-gpu-kernel-modules/discussions/475

I need to test with the open-gpu-kernel-modules bits.

(The quickest way to uninstall Nvidia's proprietary driver is sudo nvidia-uninstall.)

(Also, the 3080 Ti gets HOT.)

Radiicall commented 8 months ago

Have you tested with the new nouveau vulkan driver? It might have more luck initializing than the normal nouveau gl driver (I dont really know but its just an idea)

SpudGunMan commented 1 month ago

Did this ever become reality or only amd driver?

geerlingguy commented 1 month ago

@SpudGunMan - Only AMD for now. Going to hopefully do another round of testing with Nvidia cards soon.

geerlingguy commented 1 month ago

Trying again today with the 550.127.05 version of Nvidia's aarch64 driver...

wget https://us.download.nvidia.com/XFree86/aarch64/550.127.05/NVIDIA-Linux-aarch64-550.127.05.run
chmod +x NVIDIA-Linux-aarch64-550.127.05.run
sudo ./NVIDIA-Linux-aarch64-550.127.05.run

Same as always...

[    6.409188] NVRM: Chipset not recognized (vendor ID 0x14e4, device ID 0x2712)
[    6.409194] The NVIDIA GPU driver for AArch64 has not been qualified on this platform
               and therefore it is not recommended or intended for use in any production
               environment.
[   10.826813] NVRM: GPU 0000:01:00.0: RmInitAdapter failed! (0x25:0x65:1601)
[   10.826858] NVRM: GPU 0000:01:00.0: rm_init_adapter failed, device minor number 0
[   14.978850] NVRM: GPU 0000:01:00.0: RmInitAdapter failed! (0x25:0x65:1601)
[   14.978891] NVRM: GPU 0000:01:00.0: rm_init_adapter failed, device minor number 0
[   19.130882] NVRM: GPU 0000:01:00.0: RmInitAdapter failed! (0x25:0x65:1601)
[   19.130925] NVRM: GPU 0000:01:00.0: rm_init_adapter failed, device minor number 0

However, adding:

dtoverlay=pcie-32bit-dma-pi5

Results in:

[    6.782312] nvidia 0000:01:00.0: swiotlb buffer is full (sz: 425984 bytes), total 32768 (slots), used 72 (slots)
[    6.782322] NVRM: 0000:01:00.0: Failed to create a DMA mapping!
[    6.782345] NVRM: GPU 0000:01:00.0: Failed to copy vbios to system memory.
[    6.782631] NVRM: GPU 0000:01:00.0: RmInitAdapter failed! (0x30:0xffff:1098)
[    6.782672] NVRM: GPU 0000:01:00.0: rm_init_adapter failed, device minor number 0
[    6.974523] nvidia 0000:01:00.0: swiotlb buffer is full (sz: 442368 bytes), total 32768 (slots), used 368 (slots)
[    6.974535] NVRM: 0000:01:00.0: Failed to create a DMA mapping!
[    6.975553] NVRM: GPU 0000:01:00.0: RmInitAdapter failed! (0x24:0x59:1568)
[    6.975612] NVRM: GPU 0000:01:00.0: rm_init_adapter failed, device minor number 0
[    7.021339] nvidia 0000:01:00.0: swiotlb buffer is full (sz: 327680 bytes), total 32768 (slots), used 488 (slots)
[    7.021348] NVRM: 0000:01:00.0: Failed to create a DMA mapping!
[    7.022215] NVRM: GPU 0000:01:00.0: RmInitAdapter failed! (0x24:0x59:1568)
[    7.022272] NVRM: GPU 0000:01:00.0: rm_init_adapter failed, device minor number 0
[    7.067861] nvidia 0000:01:00.0: swiotlb buffer is full (sz: 1163264 bytes), total 32768 (slots), used 480 (slots)
[    7.067873] NVRM: 0000:01:00.0: Failed to create a DMA mapping!
[    7.068948] NVRM: GPU 0000:01:00.0: RmInitAdapter failed! (0x24:0x59:1568)
[    7.069012] NVRM: GPU 0000:01:00.0: rm_init_adapter failed, device minor number 0

So I've taken that back out, and set pcie_aspm=off in cmdline.txt, but still getting:

[   10.874741] NVRM: GPU 0000:01:00.0: RmInitAdapter failed! (0x25:0x65:1601)
[   10.874793] NVRM: GPU 0000:01:00.0: rm_init_adapter failed, device minor number 0
geerlingguy commented 1 month ago

Attempting to uninstall and reinstall the 'open' version of the driver after reading this issue — worth a shot:

sudo nvidia-uninstall
sudo ./NVIDIA-Linux-aarch64-550.127.05.run -m=kernel-open

After a reboot, some different output:

[    6.496707] NVRM: clCheckUpstreamLtrSupport_IMPL: PCIE config space is inaccessible!
[    6.595440] NVRM: kgspExecuteFwsec_TU102: failed to execute FWSEC for FRTS: no initialized WPR2 found
[    6.595447] NVRM: kgspExecuteFwsec_TU102: (note: VBIOS version 94.02.71.80.74)
[    6.595451] NVRM: nvAssertOkFailedNoLog: Assertion failed: Failure: Generic Error [NV_ERR_GENERIC] (0x0000FFFF) returned from status @ kernel_gsp_tu102.c:445
[    6.595463] NVRM: RmInitAdapter: Cannot initialize GSP firmware RM
[    6.596427] NVRM: GPU 0000:01:00.0: RmInitAdapter failed! (0x62:0xffff:1792)
[    6.596676] NVRM: GPU 0000:01:00.0: rm_init_adapter failed, device minor number 0

Code where it throws the config space inaccessible warning: https://github.com/NVIDIA/open-gpu-kernel-modules/blob/main/src/nvidia/src/kernel/platform/chipset/chipset_pcie.c#L529-L605

(Also found this related issue from 2021.)

geerlingguy commented 1 month ago

@Coreforge - Just a shot in the dark, but could this also be related to the BAR assignments like maybe the RX 6700 XT? At least with the open kernel driver, I get something more than the dratted "RmInitAdapter" lol

[Edit: I also added a Discussion under the Nvidia open driver repo: NVIDIA/open-gpu-kernel-modules - Raspberry Pi support (arm64)?.

geerlingguy commented 1 month ago

I've uninstalled the driver, and am rebuilding the kernel with nouveau enabled, to see how that fares.

1-2:1.3/0003:046D:C548.0004/input/input10
[    4.264334] ------------[ cut here ]------------
[    4.264342] nouveau 0000:01:00.0: swiotlb addr 0x00000010fcffc000+16384 overflow (mask ffffffff, bus limit 1fffffffff).
[    4.265363] WARNING: CPU: 3 PID: 308 at kernel/dma/swiotlb.c:1511 swiotlb_map+0x2a4/0x2c0
[    4.265381] Modules linked in: sha256_arm64(+) sha1_ce brcmfmac_wcc raspberrypi_hwmon hci_uart hid_apple(+) btbcm bluetooth hid_multitouch(+) brcmfmac joydev ecdh_generic ecc libaes vc4(+) brcmutil binfmt_misc cfg80211 snd_soc_hdmi_codec cec drm_dma_helper snd_soc_core nouveau(+) rfkill i2c_brcmstb v3d snd_compress spi_bcm2835 rpivid_hevc(C) pisp_be v4l2_mem2mem videobuf2_dma_contig gpio_keys snd_pcm_dmaengine snd_pcm videobuf2_memops snd_timer drm_exec gpu_sched snd videobuf2_v4l2 i2c_algo_bit drm_display_helper drm_shmem_helper videodev drm_ttm_helper pwm_fan videobuf2_common mc ttm drm_kms_helper raspberrypi_gpiomem rp1_adc nvmem_rmem uio_pdrv_genirq uio drm i2c_dev fuse dm_mod drm_panel_orientation_quirks backlight ip_tables x_tables ipv6
[    4.265468] CPU: 3 PID: 308 Comm: (udev-worker) Tainted: G         C         6.6.58-v8-16k+ #12
[    4.265473] Hardware name: Raspberry Pi 5 Model B Rev 1.0 (DT)
[    4.265475] pstate: 60400009 (nZCv daif +PAN -UAO -TCO -DIT -SSBS BTYPE=--)
[    4.265479] pc : swiotlb_map+0x2a4/0x2c0
[    4.265483] lr : swiotlb_map+0x2a4/0x2c0
[    4.265487] sp : ffffc0008073b5f0
[    4.265489] x29: ffffc0008073b5f0 x28: 0000000000000001 x27: 0000000000000001
[    4.265494] x26: ffff80010a0d7800 x25: 00000011055f4000 x24: 00000000ffffffff
[    4.265499] x23: ffff8001011398c0 x22: 0000000000000000 x21: 0000000000000000
[    4.265504] x20: 0000000000004000 x19: 00000001055f4000 x18: 0000000000000000
[    4.265508] x17: 0000000000000000 x16: 0000000000000000 x15: 0000000000000000
[    4.265513] x14: 026d8c4a8e7ab198 x13: ffffd00084d62c38 x12: 00000000fa83b2da
[    4.265518] x11: 00000000000002fc x10: 0000000000001a50 x9 : ffffd000840d4268
[    4.265523] x8 : ffff800107c4b470 x7 : 0000000000000001 x6 : 0000000000000001
[    4.265527] x5 : 00000000410fd0b0 x4 : 0000000000f0000f x3 : 0000000000400001
[    4.265532] x2 : 0000000000000000 x1 : 0000000000000000 x0 : ffff800107c499c0
[    4.265536] Call trace:
[    4.265538]  swiotlb_map+0x2a4/0x2c0
[    4.265543]  dma_map_page_attrs+0xb4/0x248
[    4.265547]  nvkm_fb_ctor+0xc4/0x100 [nouveau]
[    4.265756]  gf100_fb_new_+0x68/0x98 [nouveau]
[    4.265933]  ga102_fb_new+0x38/0x50 [nouveau]
[    4.266107]  nvkm_device_ctor+0x1a2c/0x3da0 [nouveau]
[    4.266283]  nvkm_device_pci_new+0xf8/0x298 [nouveau]
[    4.266456]  nouveau_drm_probe+0xd0/0x230 [nouveau]
[    4.266632]  local_pci_probe+0x48/0xb8
[    4.266638]  pci_device_probe+0xac/0x1c8
[    4.266641]  really_probe+0x150/0x2c0
[    4.266645]  __driver_probe_device+0x80/0x140
[    4.266649]  driver_probe_device+0x44/0x170
[    4.266652]  __driver_attach+0x9c/0x1b0
[    4.266655]  bus_for_each_dev+0x80/0xe8
[    4.266661]  driver_attach+0x2c/0x40
[    4.266664]  bus_add_driver+0xec/0x218
[    4.266666]  driver_register+0x68/0x138
[    4.266670]  __pci_register_driver+0x54/0x68
[    4.266673]  nouveau_drm_init+0x214/0x3ff8 [nouveau]
[    4.266849]  do_one_initcall+0x60/0x2c0
[    4.266854]  do_init_module+0x60/0x218
[    4.266859]  load_module+0x1de0/0x2090
[    4.266864]  __do_sys_init_module+0x19c/0x1e0
[    4.266867]  __arm64_sys_init_module+0x24/0x38
[    4.266870]  invoke_syscall+0x50/0x128
[    4.266876]  el0_svc_common.constprop.0+0xc8/0xf0
[    4.266881]  do_el0_svc+0x24/0x38
[    4.266885]  el0_svc+0x40/0xe8
[    4.266889]  el0t_64_sync_handler+0x100/0x130
[    4.266892]  el0t_64_sync+0x190/0x198
[    4.266895] ---[ end trace 0000000000000000 ]---
[    4.319673] nouveau 0000:01:00.0: acr: firmware unavailable
[    4.349183] nouveau 0000:01:00.0: bios: M0203E type 0a
[    4.349194] nouveau 0000:01:00.0: fb: 12288 MiB of unknown memory type
[    4.394434] nouveau 0000:01:00.0: DRM: VRAM: 12288 MiB
[    4.394442] nouveau 0000:01:00.0: DRM: GART: 536870912 MiB
[    4.394448] nouveau 0000:01:00.0: DRM: BIT table 'A' not found
[    4.394451] nouveau 0000:01:00.0: DRM: BIT table 'L' not found
[    4.394453] nouveau 0000:01:00.0: DRM: TMDS table version 2.0
[    4.394456] nouveau 0000:01:00.0: DRM: DCB version 4.1
[    4.394459] nouveau 0000:01:00.0: DRM: DCB outp 00: 04800f86 04600020
[    4.394463] nouveau 0000:01:00.0: DRM: DCB outp 01: 04000f82 00020020
[    4.394466] nouveau 0000:01:00.0: DRM: DCB outp 02: 04811f76 04600010
[    4.394469] nouveau 0000:01:00.0: DRM: DCB outp 03: 04011f72 00020010
[    4.394471] nouveau 0000:01:00.0: DRM: DCB outp 04: 02822f66 04600020
[    4.394474] nouveau 0000:01:00.0: DRM: DCB outp 05: 02022f62 00020020
[    4.394476] nouveau 0000:01:00.0: DRM: DCB outp 07: 02033f52 00020010
[    4.394480] nouveau 0000:01:00.0: DRM: DCB conn 00: 02000046
[    4.394482] nouveau 0000:01:00.0: DRM: DCB conn 01: 01000146
[    4.394484] nouveau 0000:01:00.0: DRM: DCB conn 02: 00020246
[    4.394487] nouveau 0000:01:00.0: DRM: DCB conn 03: 00010361
[    4.395086] nouveau 0000:01:00.0: DRM: failed to create kernel channel, -22
[    4.395139] nouveau 0000:01:00.0: DRM: failed to create ce channel, -22
[    4.395142] nouveau 0000:01:00.0: DRM: MM: using CPU for buffer copies
[    4.432417] Unable to handle kernel NULL pointer dereference at virtual address 0000000000003fc0
[    4.441283] Mem abort info:
[    4.441286]   ESR = 0x0000000096000145
[    4.441287]   EC = 0x25: DABT (current EL), IL = 32 bits
[    4.441289]   SET = 0, FnV = 0
[    4.441291]   EA = 0, S1PTW = 0
[    4.441292]   FSC = 0x05: level 1 translation fault
[    4.441294] Data abort info:
[    4.441294]   ISV = 0, ISS = 0x00000145, ISS2 = 0x00000000
[    4.441296]   CM = 1, WnR = 1, TnD = 0, TagAccess = 0
[    4.441297]   GCS = 0, Overlay = 0, DirtyBit = 0, Xs = 0
[    4.441299] user pgtable: 16k pages, 47-bit VAs, pgdp=0000000107e48000
[    4.441302] [0000000000003fc0] pgd=0000000000000000, p4d=0000000000000000, pud=0000000000000000
[    4.441308] Internal error: Oops: 0000000096000145 [#1] PREEMPT SMP
[    4.441312] Modules linked in: ghash_ce gf128mul sha2_ce sha256_arm64 sha1_ce brcmfmac_wcc raspberrypi_hwmon hci_uart hid_apple(+) btbcm bluetooth hid_multitouch(+) brcmfmac joydev ecdh_generic ecc libaes vc4(+) brcmutil binfmt_misc cfg80211 snd_soc_hdmi_codec cec drm_dma_helper snd_soc_core nouveau(+) rfkill i2c_brcmstb v3d snd_compress spi_bcm2835 rpivid_hevc(C) pisp_be v4l2_mem2mem videobuf2_dma_contig gpio_keys snd_pcm_dmaengine snd_pcm videobuf2_memops snd_timer drm_exec gpu_sched snd videobuf2_v4l2 i2c_algo_bit drm_display_helper drm_shmem_helper videodev drm_ttm_helper pwm_fan videobuf2_common mc ttm drm_kms_helper raspberrypi_gpiomem rp1_adc nvmem_rmem uio_pdrv_genirq uio drm i2c_dev fuse dm_mod drm_panel_orientation_quirks backlight ip_tables x_tables ipv6
[    4.441383] CPU: 2 PID: 308 Comm: (udev-worker) Tainted: G        WC         6.6.58-v8-16k+ #12
[    4.441387] Hardware name: Raspberry Pi 5 Model B Rev 1.0 (DT)
[    4.441389] pstate: 00400009 (nzcv daif +PAN -UAO -TCO -DIT -SSBS BTYPE=--)
[    4.441392] pc : dcache_inval_poc+0x28/0x58
[    4.441407] lr : arch_sync_dma_for_cpu+0x34/0x50
[    4.441411] sp : ffffc0008073b720
[    4.441413] x29: ffffc0008073b720 x28: ffffd0005a3bda78 x27: 0000000000000001
[    4.441417] x26: ffffc0008073bce0 x25: ffffc0008073bc90 x24: ffffffffffffffff
[    4.441421] x23: 0000000000000000 x22: ffff8001011398c0 x21: 0000000000004000
[    4.441424] x20: 0000000000000000 x19: ffffffffffffffff x18: 0000000000000000
[    4.441427] x17: ffffb0017a814000 x16: ffffd0008413de98 x15: 0000000000000000
[    4.441431] x14: 0000000000000000 x13: 0000000000000000 x12: 0000000000000001
[    4.441434] x11: ffffd0005a429148 x10: 0000000000000004 x9 : ffffd0008413e04c
[    4.441438] x8 : 0000000000000000 x7 : ffff8001048a7a60 x6 : ffffffefffffffff
[    4.441441] x5 : ffff8001048a7a60 x4 : 0000000000000000 x3 : 000000000000003f
[    4.441444] x2 : 0000000000000040 x1 : 0000000000003fc0 x0 : ffffffffffffffff
[    4.441448] Call trace:
[    4.441450]  dcache_inval_poc+0x28/0x58
[    4.441455]  dma_unmap_page_attrs+0x1b4/0x1d0
[    4.441460]  nvkm_fb_dtor+0xc0/0x108 [nouveau]
[    4.441692]  nvkm_subdev_del+0x78/0x128 [nouveau]
[    4.441881]  nvkm_device_del+0x80/0x130 [nouveau]
[    4.442066]  nouveau_drm_probe+0x154/0x230 [nouveau]
[    4.442249]  local_pci_probe+0x48/0xb8
[    4.442259]  pci_device_probe+0xac/0x1c8
[    4.442262]  really_probe+0x150/0x2c0
[    4.442268]  __driver_probe_device+0x80/0x140
[    4.442270]  driver_probe_device+0x44/0x170
[    4.442273]  __driver_attach+0x9c/0x1b0
[    4.442275]  bus_for_each_dev+0x80/0xe8
[    4.442280]  driver_attach+0x2c/0x40
[    4.442282]  bus_add_driver+0xec/0x218
[    4.442284]  driver_register+0x68/0x138
[    4.442287]  __pci_register_driver+0x54/0x68
[    4.442290]  nouveau_drm_init+0x214/0x3ff8 [nouveau]
[    4.442477]  do_one_initcall+0x60/0x2c0
[    4.442482]  do_init_module+0x60/0x218
[    4.442488]  load_module+0x1de0/0x2090
[    4.442494]  __do_sys_init_module+0x19c/0x1e0
[    4.442496]  __arm64_sys_init_module+0x24/0x38
[    4.442499]  invoke_syscall+0x50/0x128
[    4.442507]  el0_svc_common.constprop.0+0xc8/0xf0
[    4.442511]  do_el0_svc+0x24/0x38
[    4.442515]  el0_svc+0x40/0xe8
[    4.442519]  el0t_64_sync_handler+0x100/0x130
[    4.442521]  el0t_64_sync+0x190/0x198
[    4.442525] Code: d1000443 ea03003f 8a230021 54000040 (d50b7e21) 
[    4.442528] ---[ end trace 0000000000000000 ]---
geerlingguy commented 1 month ago

If I set dtoverlay=pcie-32bit-dma-pi5 in config.txt and reboot, I get:

[    3.980643] nouveau 0000:01:00.0: enabling device (0000 -> 0002)
[    3.980867] nouveau 0000:01:00.0: NVIDIA GA102 (b72000a1)
[    4.328955] nouveau 0000:01:00.0: bios: version 94.02.71.80.74
[    4.449813] nouveau 0000:01:00.0: bios: M0203E type 0a
[    4.449823] nouveau 0000:01:00.0: fb: 12288 MiB of unknown memory type
[    4.686936] nouveau 0000:01:00.0: sec2(acr): mbox 00000007 00000000
[    4.686946] nouveau 0000:01:00.0: sec2(acr):AHESASC: boot failed: -5
[    4.686951] nouveau 0000:01:00.0: acr: init failed, -5
[    4.687108] nouveau 0000:01:00.0: init failed with -5
[    4.687112] nouveau: DRM-master:00000000:00000080: init failed with -5
[    4.687121] nouveau 0000:01:00.0: DRM-master: Device allocation failed: -5
[    4.933155] nouveau: probe of 0000:01:00.0 failed with error -5

In my searching around, I found https://github.com/raspberrypi/linux/pull/5661, but trying dtoverlay=dwc2-pi5 resulted in the same error as earlier.