solardiz
commented
1 year ago Here's another, also for mainline with slightly newer kernel: https://github.com/solardiz/lkrg/runs/7568173574?check_suite_focus=true
Ubuntu Kinetic Kudu (development branch) localhost ttyS0
localhost login: root (automatic login)
Welcome to Ubuntu Kinetic Kudu (development branch) (GNU/Linux 5.19.0-051900rc8daily20220727-generic x86_64)
* Documentation: https://help.ubuntu.com/
* Management: https://landscape.canonical.com/
* Support: https://ubuntu.com/advantage
Last login: Thu Jul 28 20:45:39 UTC 2022 on tty1
[ 102.621423] input: ImExPS/2 Generic Explorer Mouse as /devices/platform/i8042/serio1/input/input3
root@localhost:~# /lkrg/.github/workflows/run-boot-tests.sh
+ '[' '!' -d /sys/module/lkrg ']'
+ mknod /dev/test c 10 241
+ true
[ 104.614838] NET: Registered PF_VSOCK protocol family
+ dmesg -T
+ grep 'Registered.*protocol family'
+ grep -w -e PF_VSOCK -e 40
[Thu Jul 28 20:45:55 2022] NET: Registered PF_VSOCK protocol family
+ sleep 21
[ 120.010711] [drm] pci: virtio-vga detected at 0000:00:01.0
[ 120.022843] virtio-pci 0000:00:01.0: vgaarb: deactivate vga console
[ 120.040852] Console: switching to colour dummy device 80x25
[ 120.059741] [drm] features: -virgl +edid -resource_blob -host_visible
[ 120.059846] [drm] features: -context_init
[ 120.079201] [drm] number of scanouts: 1
[ 120.079522] [drm] number of cap sets: 0
[ 120.126672] [drm] Initialized virtio_gpu 0.1.0 0 for virtio0 on minor 0
[ 150.873167] watchdog: BUG: soft lockup - CPU#0 stuck for 27s! [systemd-udevd:447]
[ 150.873660] Modules linked in: virtio_gpu(+) virtio_dma_buf drm_shmem_helper drm_kms_helper vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock fb_sys_fops psmouse syscopyarea input_leds i2c_i801 sysfillrect mac_hid lpc_ich i2c_smbus sysimgblt ramoops pstore_blk reed_solomon pstore_zone mtd drm efi_pstore ip_tables x_tables crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel crypto_simd ahci cryptd libahci serio_raw virtio_scsi lkrg(OE) dm_mirror dm_region_hash dm_log qemu_fw_cfg virtio_rng autofs4
[ 150.876390] CPU: 0 PID: 447 Comm: systemd-udevd Tainted: G OE 5.19.0-051900rc8daily20220727-generic #202207262221
[ 150.877046] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.15.0-1 04/01/2014
[ 150.877607] RIP: 0010:__alloc_pages_bulk+0x4f1/0x6d0
[ 150.878231] Code: ff 0f 85 a8 fd ff ff 4c 63 6d b0 44 89 db 4d 89 d4 45 85 ed 0f 84 d3 00 00 00 48 f7 45 88 00 02 00 00 74 06 fb 0f 1f 44 00 00 <4c> 89 e0 49 2b 44 24 60 48 c1 f8 09 69 c0 ab aa aa aa 44 8d 70 04
[ 150.879157] RSP: 0018:ff7e853701897a80 EFLAGS: 00000206
[ 150.879458] RAX: 0000000000000000 RBX: 0000000000000046 RCX: 0000000000000000
[ 150.879812] RDX: fff211ccc0303580 RSI: 0000000000000001 RDI: ff4f652b4c0d7000
[ 150.880144] RBP: ff7e853701897b18 R08: 0000000000000046 R09: 000000000000365b
[ 150.880475] R10: ff4f652b7ffb2600 R11: 0000000000000046 R12: ff4f652b7ffb2600
[ 150.880824] R13: 0000000000000046 R14: ff4f652b7ec37448 R15: 0000000000000047
[ 150.881355] FS: 00007fcb3ea9c8c0(0000) GS:ff4f652b7ec00000(0000) knlGS:0000000000000000
[ 150.881826] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 150.882142] CR2: 00007f990d6bcf20 CR3: 00000000071be000 CR4: 00000000007516f0
[ 150.882644] PKRU: 55555554
[ 150.882887] Call Trace:
[ 150.883549] <TASK>
[ 150.883812] ? psi_task_switch+0xc6/0x220
[ 150.884126] alloc_pages_bulk_array_mempolicy+0xa3/0x290
[ 150.884550] vm_area_alloc_pages+0x90/0x180
[ 150.884791] ? __kmalloc_node+0x1c4/0x3e0
[ 150.885055] __vmalloc_area_node+0xf1/0x380
[ 150.885286] __vmalloc_node_range+0xce/0x230
[ 150.885488] ? 0xffffffffc02bb000
[ 150.885925] ? move_module+0x23/0x170
[ 150.886127] module_alloc+0x82/0xe0
[ 150.886320] ? move_module+0x23/0x170
[ 150.886511] move_module+0x23/0x170
[ 150.886702] layout_and_allocate+0xde/0x120
[ 150.886926] load_module+0x2d6/0xd30
[ 150.887115] ? kernel_read_file+0x230/0x290
[ 150.887373] __do_sys_finit_module+0xc8/0x140
[ 150.887603] ? __do_sys_finit_module+0xc8/0x140
[ 150.887864] __x64_sys_finit_module+0x18/0x20
[ 150.888089] do_syscall_64+0x5c/0x90
[ 150.888289] ? syscall_exit_to_user_mode+0x26/0x50
[ 150.888529] ? __x64_sys_lseek+0x18/0x20
[ 150.888735] ? do_syscall_64+0x69/0x90
[ 150.888936] ? irqentry_exit+0x3b/0x50
[ 150.889156] ? exc_page_fault+0x87/0x180
[ 150.889365] entry_SYSCALL_64_after_hwframe+0x63/0xcd
[ 150.889753] RIP: 0033:0x7fcb3e91ea3d
[ 150.890097] Code: 5b 41 5c c3 66 0f 1f 84 00 00 00 00 00 f3 0f 1e fa 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d c3 a3 0f 00 f7 d8 64 89 01 48
[ 150.890685] RSP: 002b:00007ffd90466c98 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 150.891090] RAX: ffffffffffffffda RBX: 000055a54123b9b0 RCX: 00007fcb3e91ea3d
[ 150.891567] RDX: 0000000000000000 RSI: 00007fcb3eb5f441 RDI: 0000000000000006
[ 150.891877] RBP: 0000000000020000 R08: 0000000000000000 R09: 0000000000000002
ABORT
[ 150.892190] R10: 0000000000000006 R11: 0000000000000246 R12: 00007fcb3eb5f441
[ 150.892459] R13: 000055a54123ad80 R14: 000055a54123a4c0 R15: 000055a54123bc60
[ 150.892856] </TASK>
[ 150.893317] Kernel panic - not syncing: softlockup: hung tasks
[ 150.893773] CPU: 0 PID: 447 Comm: systemd-udevd Tainted: G OEL 5.19.0-051900rc8daily20220727-generic #202207262221
[ 150.894325] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.15.0-1 04/01/2014
[ 150.894811] Call Trace:
[ 150.895089] <IRQ>
[ 150.895222] show_stack+0x52/0x5c
[ 150.895425] dump_stack_lvl+0x49/0x63
[ 150.895666] dump_stack+0x10/0x16
[ 150.895846] panic+0x162/0x2fb
[ 150.896036] watchdog_timer_fn.cold+0xc/0x16
[ 150.896261] ? lockup_detector_update_enable+0x60/0x60
[ 150.896524] __hrtimer_run_queues+0x109/0x260
[ 150.896751] ? clockevents_program_event+0xad/0x130
[ 150.897045] hrtimer_interrupt+0x101/0x220
[ 150.897271] __sysvec_apic_timer_interrupt+0x64/0x110
[ 150.897553] sysvec_apic_timer_interrupt+0x7b/0x90
[ 150.897867] </IRQ>
[ 150.897991] <TASK>
[ 150.898114] asm_sysvec_apic_timer_interrupt+0x1b/0x20
[ 150.898430] RIP: 0010:__alloc_pages_bulk+0x4f1/0x6d0
[ 150.898708] Code: ff 0f 85 a8 fd ff ff 4c 63 6d b0 44 89 db 4d 89 d4 45 85 ed 0f 84 d3 00 00 00 48 f7 45 88 00 02 00 00 74 06 fb 0f 1f 44 00 00 <4c> 89 e0 49 2b 44 24 60 48 c1 f8 09 69 c0 ab aa aa aa 44 8d 70 04
[ 150.899522] RSP: 0018:ff7e853701897a80 EFLAGS: 00000206
[ 150.899780] RAX: 0000000000000000 RBX: 0000000000000046 RCX: 0000000000000000
[ 150.900105] RDX: fff211ccc0303580 RSI: 0000000000000001 RDI: ff4f652b4c0d7000
[ 150.900429] RBP: ff7e853701897b18 R08: 0000000000000046 R09: 000000000000365b
[ 150.900763] R10: ff4f652b7ffb2600 R11: 0000000000000046 R12: ff4f652b7ffb2600
[ 150.901134] R13: 0000000000000046 R14: ff4f652b7ec37448 R15: 0000000000000047
[ 150.901620] ? psi_task_switch+0xc6/0x220
[ 150.901887] alloc_pages_bulk_array_mempolicy+0xa3/0x290
[ 150.902165] vm_area_alloc_pages+0x90/0x180
[ 150.902378] ? __kmalloc_node+0x1c4/0x3e0
[ 150.902620] __vmalloc_area_node+0xf1/0x380
[ 150.902859] __vmalloc_node_range+0xce/0x230
[ 150.903085] ? 0xffffffffc02bb000
[ 150.903278] ? move_module+0x23/0x170
[ 150.903476] module_alloc+0x82/0xe0
[ 150.903670] ? move_module+0x23/0x170
[ 150.903863] move_module+0x23/0x170
[ 150.904054] layout_and_allocate+0xde/0x120
[ 150.904277] load_module+0x2d6/0xd30
[ 150.904469] ? kernel_read_file+0x230/0x290
[ 150.904699] __do_sys_finit_module+0xc8/0x140
[ 150.904926] ? __do_sys_finit_module+0xc8/0x140
[ 150.905194] __x64_sys_finit_module+0x18/0x20
[ 150.905427] do_syscall_64+0x5c/0x90
[ 150.905620] ? syscall_exit_to_user_mode+0x26/0x50
[ 150.905884] ? __x64_sys_lseek+0x18/0x20
[ 150.906090] ? do_syscall_64+0x69/0x90
[ 150.906277] ? irqentry_exit+0x3b/0x50
[ 150.906482] ? exc_page_fault+0x87/0x180
[ 150.906692] entry_SYSCALL_64_after_hwframe+0x63/0xcd
[ 150.906960] RIP: 0033:0x7fcb3e91ea3d
[ 150.907158] Code: 5b 41 5c c3 66 0f 1f 84 00 00 00 00 00 f3 0f 1e fa 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d c3 a3 0f 00 f7 d8 64 89 01 48
[ 150.907930] RSP: 002b:00007ffd90466c98 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[ 150.908169] RAX: ffffffffffffffda RBX: 000055a54123b9b0 RCX: 00007fcb3e91ea3d
[ 150.908477] RDX: 0000000000000000 RSI: 00007fcb3eb5f441 RDI: 0000000000000006
[ 150.908872] RBP: 0000000000020000 R08: 0000000000000000 R09: 0000000000000002
[ 150.909205] R10: 0000000000000006 R11: 0000000000000246 R12: 00007fcb3eb5f441
[ 150.909558] R13: 000055a54123ad80 R14: 000055a54123a4c0 R15: 000055a54123bc60
[ 150.909928] </TASK>
[ 150.910778] Kernel Offset: 0xb400000 from 0xffffffff81000000 (relocation range: 0xffffffff80000000-0xffffffffbfffffff)
Hopefully, this is not LKRG-related, but it is nevertheless an issue seen on our CI today (for
mkosi-mainline), so recording it in here in case it repeats:https://github.com/lkrg-org/lkrg/runs/7427152212?check_suite_focus=true