gnif / vendor-reset

Linux kernel vendor specific hardware reset module for sequences that are too complex/complicated to land in pci_quirks.c
GNU General Public License v2.0
749 stars 60 forks source link

Proxmox 8.2.2 Vega 56 (eGPU) kernel 6.8 -> 6.5 (not reseting after downgraded to 6.5) #81

Open joysthokkins opened 3 months ago

joysthokkins commented 3 months ago

Hi! After updating the kernel to 6.8, everything started working poorly on Proxmox. I reverted to 6.5, but the reset for Vega 56/64 stopped working. What could have happened? Thank you!

Jun 15 11:58:44 pvedaemon[47483]: start VM 102: UPID::qmstart:102:root@pam: Jun 15 11:58:44 pvedaemon[1276]: root@pam starting task UPID::qmstart:102:root@pam: Jun 15 11:58:44 kernel: vfio-pci 0000:0b:00.0: AMD_VEGA10: version 1.0 Jun 15 11:58:44 kernel: vfio-pci 0000:0b:00.0: AMD_VEGA10: performing pre-reset Jun 15 11:58:44 kernel: vfio-pci 0000:0b:00.0: AMD_VEGA10: performing reset Jun 15 11:58:45 kernel: ATOM BIOS: 113-376XL-UO2 Jun 15 11:58:45 kernel: vendor-reset-drm: atomfirmware: bios_scratch_reg_offset initialized to 4c Jun 15 11:58:45 kernel: vfio-pci 0000:0b:00.0: AMD_VEGA10: bus reset disabled? yes Jun 15 11:58:45 kernel: vfio-pci 0000:0b:00.0: AMD_VEGA10: SMU response reg: 0, sol reg: 2bd0e, mp1 intr enabled? no, bl ready? no, baco? off Jun 15 11:58:45 kernel: iommu ivhd0: AMD-Vi: Event logged [IOTLB_INV_TIMEOUT device=0000:0b:00.0 address=0x100215790] Jun 15 11:58:45 kernel: vfio-pci 0000:0b:00.0: SMU error 0x0 Jun 15 11:58:45 kernel: vfio-pci 0000:0b:00.0: AMD_VEGA10: could not get enabled SMU features, trying BACO reset anyway [ret -110] Jun 15 11:58:45 kernel: vfio-pci 0000:0b:00.0: AMD_VEGA10: entering BACO Jun 15 11:58:46 kernel: iommu ivhd0: AMD-Vi: Event logged [IOTLB_INV_TIMEOUT device=0000:0b:00.0 address=0x1002157d0] Jun 15 11:58:46 kernel: vfio-pci 0000:0b:00.0: SMU error 0x0 Jun 15 11:58:46 kernel: vfio-pci 0000:0b:00.0: AMD_VEGA10: failed to reset device Jun 15 11:58:46 kernel: vfio-pci 0000:0b:00.0: AMD_VEGA10: performing post-reset Jun 15 11:58:46 kernel: vfio-pci 0000:0b:00.0: AMD_VEGA10: reset result = 0 Jun 15 11:58:46 systemd[1]: Started 102.scope. Jun 15 11:58:47 kernel: iommu ivhd0: AMD-Vi: Event logged [IOTLB_INV_TIMEOUT device=0000:0b:00.0 address=0x100215840] Jun 15 11:58:47 kernel: tap102i0: entered promiscuous mode Jun 15 11:58:47 kernel: vmbr0: port 3(tap102i0) entered blocking state Jun 15 11:58:47 kernel: vmbr0: port 3(tap102i0) entered disabled state Jun 15 11:58:47 kernel: tap102i0: entered allmulticast mode Jun 15 11:58:47 kernel: vmbr0: port 3(tap102i0) entered blocking state Jun 15 11:58:47 kernel: vmbr0: port 3(tap102i0) entered forwarding state Jun 15 11:58:48 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:58:48 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:58:48 kernel: iommu ivhd0: AMD-Vi: Event logged [IOTLB_INV_TIMEOUT device=0000:0b:00.0 address=0x1002158b0] Jun 15 11:58:48 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:58:48 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:58:48 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:58:48 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:58:48 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:58:49 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:58:49 kernel: iommu ivhd0: AMD-Vi: Event logged [IOTLB_INV_TIMEOUT device=0000:0b:00.0 address=0x100215910] Jun 15 11:58:49 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:58:49 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:58:49 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:58:49 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:58:49 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:58:50 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:58:50 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:58:50 kernel: iommu ivhd0: AMD-Vi: Event logged [IOTLB_INV_TIMEOUT device=0000:0b:00.0 address=0x100215950] Jun 15 11:58:50 kernel: iommu ivhd0: AMD-Vi: Event logged [IOTLB_INV_TIMEOUT device=0000:0b:00.0 address=0x100215970] Jun 15 11:58:50 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:58:50 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:58:50 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:58:50 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:58:50 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:58:51 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:58:51 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:58:51 kernel: iommu ivhd0: AMD-Vi: Event logged [IOTLB_INV_TIMEOUT device=0000:0b:00.0 address=0x1002159e0] Jun 15 11:58:52 kernel: iommu ivhd0: AMD-Vi: Event logged [IOTLB_INV_TIMEOUT device=0000:0b:00.0 address=0x100215a20] Jun 15 11:58:53 kernel: iommu ivhd0: AMD-Vi: Event logged [IOTLB_INV_TIMEOUT device=0000:0b:00.0 address=0x100215a90] Jun 15 11:58:54 kernel: iommu ivhd0: AMD-Vi: Event logged [IOTLB_INV_TIMEOUT device=0000:0b:00.0 address=0x100215b00] Jun 15 11:58:54 kernel: vfio-pci 0000:0b:00.0: enabling device (0400 -> 0403) Jun 15 11:58:54 kernel: vfio-pci 0000:0b:00.0: AMD_VEGA10: version 1.0 Jun 15 11:58:54 kernel: vfio-pci 0000:0b:00.0: AMD_VEGA10: performing pre-reset Jun 15 11:58:54 kernel: vfio-pci 0000:0b:00.0: AMD_VEGA10: performing reset Jun 15 11:58:54 pvedaemon[1275]: VM 102 qmp command failed - VM 102 qmp command 'query-proxmox-support' failed - got timeout Jun 15 11:58:55 kernel: iommu ivhd0: AMD-Vi: Event logged [IOTLB_INV_TIMEOUT device=0000:0b:00.0 address=0x100215b60] Jun 15 11:58:55 kernel: ATOM BIOS: 113-376XL-UO2 Jun 15 11:58:55 kernel: vendor-reset-drm: atomfirmware: bios_scratch_reg_offset initialized to 4c Jun 15 11:58:55 kernel: vfio-pci 0000:0b:00.0: AMD_VEGA10: bus reset disabled? yes Jun 15 11:58:55 kernel: vfio-pci 0000:0b:00.0: AMD_VEGA10: SMU response reg: 0, sol reg: 2bd73, mp1 intr enabled? no, bl ready? no, baco? off Jun 15 11:58:55 kernel: vfio-pci 0000:0b:00.0: SMU error 0x0 Jun 15 11:58:55 kernel: vfio-pci 0000:0b:00.0: AMD_VEGA10: could not get enabled SMU features, trying BACO reset anyway [ret -110] Jun 15 11:58:55 kernel: vfio-pci 0000:0b:00.0: AMD_VEGA10: entering BACO Jun 15 11:58:56 kernel: iommu ivhd0: AMD-Vi: Event logged [IOTLB_INV_TIMEOUT device=0000:0b:00.0 address=0x100215ba0] Jun 15 11:58:56 kernel: iommu ivhd0: AMD-Vi: Event logged [IOTLB_INV_TIMEOUT device=0000:0b:00.0 address=0x100215bc0] Jun 15 11:58:56 kernel: vfio-pci 0000:0b:00.0: SMU error 0x0 Jun 15 11:58:56 kernel: vfio-pci 0000:0b:00.0: AMD_VEGA10: failed to reset device Jun 15 11:58:56 kernel: vfio-pci 0000:0b:00.0: AMD_VEGA10: performing post-reset Jun 15 11:58:56 kernel: vfio-pci 0000:0b:00.0: AMD_VEGA10: reset result = 0 Jun 15 11:58:56 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:58:56 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:58:56 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:58:57 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:58:57 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:58:57 kernel: iommu ivhd0: AMD-Vi: Event logged [IOTLB_INV_TIMEOUT device=0000:0b:00.0 address=0x100215c30] Jun 15 11:58:57 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:58:57 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:58:57 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:58:57 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:58:57 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:58:58 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:58:58 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:58:58 kernel: iommu ivhd0: AMD-Vi: Event logged [IOTLB_INV_TIMEOUT device=0000:0b:00.0 address=0x100215c70] Jun 15 11:58:58 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:58:58 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:58:58 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:58:58 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:58:58 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:58:59 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:58:59 kernel: iommu ivhd0: AMD-Vi: Event logged [IOTLB_INV_TIMEOUT device=0000:0b:00.0 address=0x100215ce0] Jun 15 11:58:59 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:58:59 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:58:59 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:58:59 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:00 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:00 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:00 kernel: iommu ivhd0: AMD-Vi: Event logged [IOTLB_INV_TIMEOUT device=0000:0b:00.0 address=0x100215d50] Jun 15 11:59:00 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:00 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:00 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:00 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:00 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:01 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:01 kernel: iommu ivhd0: AMD-Vi: Event logged [IOTLB_INV_TIMEOUT device=0000:0b:00.0 address=0x100215db0] Jun 15 11:59:01 CRON[47639]: pam_unix(cron:session): session opened for user root(uid=0) by (uid=0) Jun 15 11:59:01 CRON[47640]: (root) CMD (sh /usr/local/bin/autoshutdown.sh) Jun 15 11:59:01 CRON[47639]: pam_unix(cron:session): session closed for user root Jun 15 11:59:01 postfix/pickup[46013]: 65D8B20ECA: uid=0 from= Jun 15 11:59:01 postfix/cleanup[47644]: 65D8B20ECA: message-id=<20240615095901.65D8B20ECA@ .local> Jun 15 11:59:01 postfix/qmgr[1226]: 65D8B20ECA: from=<root@ .local>, size=642, nrcpt=1 (queue active) Jun 15 11:59:01 postfix/pickup[46013]: 6ED4421AE0: uid=65534 from= Jun 15 11:59:01 postfix/cleanup[47644]: 6ED4421AE0: message-id=<20240615095901.65D8B20ECA@ .local> Jun 15 11:59:01 proxmox-mail-fo[47647]: proxmox-mail-forward[47647]: notified via target mail-to-root Jun 15 11:59:01 postfix/qmgr[1226]: 6ED4421AE0: from=<root@ .local>, size=820, nrcpt=1 (queue active) Jun 15 11:59:01 postfix/local[47646]: 65D8B20ECA: to=<root@ .local>, orig_to=, relay=local, delay=0.05, delays=0.02/0.01/0/0.02, dsn=2.0.0, status=sent (delivered to command: /usr/bin/proxmox-mail-forward) Jun 15 11:59:01 postfix/qmgr[1226]: 65D8B20ECA: removed Jun 15 11:59:01 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:01 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:01 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:01 postfix/smtp[47650]: connect to gmail-smtp-in.l.google.com[2a00:1450:400c:c0c::1a]:25: Network is unreachable Jun 15 11:59:01 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:02 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:02 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:02 kernel: iommu ivhd0: AMD-Vi: Event logged [IOTLB_INV_TIMEOUT device=0000:0b:00.0 address=0x100215df0] Jun 15 11:59:02 kernel: iommu ivhd0: AMD-Vi: Event logged [IOTLB_INV_TIMEOUT device=0000:0b:00.0 address=0x100215e10] Jun 15 11:59:02 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:02 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:02 kernel: vfio-pci 0000:0b:00.0: AMD_VEGA10: version 1.0 Jun 15 11:59:02 kernel: vfio-pci 0000:0b:00.0: AMD_VEGA10: performing pre-reset Jun 15 11:59:02 kernel: vfio-pci 0000:0b:00.0: AMD_VEGA10: performing reset Jun 15 11:59:02 postfix/smtp[47650]: 6ED4421AE0: to=< . @gmail.com>, relay=gmail-smtp-in.l.google.com[66.102.1.26]:25, delay=1.1, delays=0/0.01/0.61/0.5, dsn=5.7.25, status=bounced (host gmail-smtp-in.l.google.com[66.102.1.26] said: 550-5.7.25 [77.222.25.99] The IP address sending this message does not have a 550-5.7.25 PTR record setup, or the corresponding forward DNS entry does not 550-5.7.25 match the sending IP. As a policy, Gmail does not accept messages 550-5.7.25 from IPs with missing PTR records. For more information, go to 550-5.7.25 https://support.google.com/a?p=sender-guidelines-ip 550-5.7.25 To learn more about Gmail requirements for bulk senders, visit 550 5.7.25 https://support.google.com/a?p=sender-guidelines. ffacd0b85a97d-360750b64a9si3240363f8f.56 - gsmtp (in reply to end of DATA command)) Jun 15 11:59:02 postfix/qmgr[1226]: 6ED4421AE0: removed Jun 15 11:59:02 postfix/cleanup[47644]: 8ECEF20ECA: message-id=<20240615095902.8ECEF20ECA@ .local> Jun 15 11:59:02 kernel: ATOM BIOS: 113-376XL-UO2 Jun 15 11:59:02 kernel: vendor-reset-drm: atomfirmware: bios_scratch_reg_offset initialized to 4c Jun 15 11:59:02 kernel: vfio-pci 0000:0b:00.0: AMD_VEGA10: bus reset disabled? yes Jun 15 11:59:02 kernel: vfio-pci 0000:0b:00.0: AMD_VEGA10: SMU response reg: 0, sol reg: 2bdbf, mp1 intr enabled? no, bl ready? no, baco? off Jun 15 11:59:03 kernel: iommu ivhd0: AMD-Vi: Event logged [IOTLB_INV_TIMEOUT device=0000:0b:00.0 address=0x100215e80] Jun 15 11:59:03 kernel: vfio-pci 0000:0b:00.0: SMU error 0x0 Jun 15 11:59:03 kernel: vfio-pci 0000:0b:00.0: AMD_VEGA10: could not get enabled SMU features, trying BACO reset anyway [ret -110] Jun 15 11:59:03 kernel: vfio-pci 0000:0b:00.0: AMD_VEGA10: entering BACO Jun 15 11:59:03 pvestatd[1245]: VM 102 qmp command failed - VM 102 qmp command 'query-proxmox-support' failed - unable to connect to VM 102 qmp socket - timeout after 51 retries Jun 15 11:59:03 pvestatd[1245]: status update time (8.095 seconds) Jun 15 11:59:04 kernel: vfio-pci 0000:0b:00.0: SMU error 0x0 Jun 15 11:59:04 kernel: vfio-pci 0000:0b:00.0: AMD_VEGA10: failed to reset device Jun 15 11:59:04 kernel: vfio-pci 0000:0b:00.0: AMD_VEGA10: performing post-reset Jun 15 11:59:04 kernel: vfio-pci 0000:0b:00.0: AMD_VEGA10: reset result = 0 Jun 15 11:59:04 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:04 kernel: iommu ivhd0: AMD-Vi: Event logged [IOTLB_INV_TIMEOUT device=0000:0b:00.0 address=0x100215eb0] Jun 15 11:59:04 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:04 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:04 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:04 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:04 pvedaemon[47483]: hookscript error for 102 on post-start: command '/var/lib/vz/snippets/egpu.sh 102 post-start' failed: exit code 1 Jun 15 11:59:04 pvedaemon[1276]: root@pam end task UPID::qmstart:102:root@pam: OK Jun 15 11:59:05 kernel: iommu ivhd0: AMD-Vi: Event logged [IOTLB_INV_TIMEOUT device=0000:0b:00.0 address=0x100215ee0] Jun 15 11:59:05 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:05 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:06 kernel: iommu ivhd0: AMD-Vi: Event logged [IOTLB_INV_TIMEOUT device=0000:0b:00.0 address=0x100214250] Jun 15 11:59:06 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:06 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:07 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:07 kernel: iommu ivhd0: AMD-Vi: Event logged [IOTLB_INV_TIMEOUT device=0000:0b:00.0 address=0x1002142c0] Jun 15 11:59:07 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:08 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:08 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:08 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:08 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:08 kernel: iommu ivhd0: AMD-Vi: Event logged [IOTLB_INV_TIMEOUT device=0000:0b:00.0 address=0x100214550] Jun 15 11:59:08 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:08 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:08 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:08 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:09 kernel: iommu ivhd0: AMD-Vi: Event logged [IOTLB_INV_TIMEOUT device=0000:0b:00.0 address=0x100214580] Jun 15 11:59:09 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:09 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:09 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:10 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:10 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:10 kernel: iommu ivhd0: AMD-Vi: Event logged [IOTLB_INV_TIMEOUT device=0000:0b:00.0 address=0x1002145b0] Jun 15 11:59:10 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:10 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:10 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:11 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:11 kernel: iommu ivhd0: AMD-Vi: Event logged [IOTLB_INV_TIMEOUT device=0000:0b:00.0 address=0x1002145e0] Jun 15 11:59:12 kernel: iommu ivhd0: AMD-Vi: Event logged [IOTLB_INV_TIMEOUT device=0000:0b:00.0 address=0x100214610] Jun 15 11:59:13 kernel: iommu ivhd0: AMD-Vi: Event logged [IOTLB_INV_TIMEOUT device=0000:0b:00.0 address=0x100214640] Jun 15 11:59:14 kernel: iommu ivhd0: AMD-Vi: Event logged [IOTLB_INV_TIMEOUT device=0000:0b:00.0 address=0x100214670] Jun 15 11:59:15 kernel: iommu ivhd0: AMD-Vi: Event logged [IOTLB_INV_TIMEOUT device=0000:0b:00.0 address=0x1002146a0] Jun 15 11:59:16 kernel: iommu ivhd0: AMD-Vi: Event logged [IOTLB_INV_TIMEOUT device=0000:0b:00.0 address=0x1002147e0] Jun 15 11:59:17 kernel: iommu ivhd0: AMD-Vi: Event logged [IOTLB_INV_TIMEOUT device=0000:0b:00.0 address=0x100214840] Jun 15 11:59:17 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:17 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:17 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:17 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:18 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:18 kernel: AMD-Vi: Completion-Wait loop timed out Jun 15 11:59:18 kernel: iommu ivhd0: AMD-Vi: Event logged [IOTLB_INV_TIMEOUT device=0000:0b:00.0 address=0x100214870]