Open cjdelisle opened 11 years ago
cjdelisle
commented
11 years ago Set a breakpoint on inter.c:625 in kvm/gdb and it was never hit so it appears that DTRACE_CPUFLAG_ISSET(CPU_DTRACE_NOFAULT) is always false. I also put a breakpoint on line 622 but removed this soon after as it was triggering constantly so the function seems to be properly entering.
cjdelisle
commented
11 years ago I thought I had a semi-coherent bug report, now it seems to be degrading into "nothing works" :( It seems that all syscall traces trigger oops and fbt:::{} worked but caused an error when cancelling the trace. Discouragingly, an OpenIndiana kvm node on the same box decided to crap out while I was testing and now it won't boot. Do you think it's a good idea to look at UML for testing? It makes sense that we should have a way to easily share a kernel which fails rather than everyone having their own virtualization solution.
dtrace4linux
commented
11 years ago Thanks for the report Caleb. I have never tested with KVM - looks like the problem is in the area of updating the page tables so we can modify the system call vector table - this is similar to what I saw with Xen. I will have to set up a KVM VM and see whats happening.
Thanks for the report (I need to look at your patch as well); may take me a little while to look at this - if you have instructions/links for setting up the KVM that will be helpful.
On 16 December 2012 02:43, Caleb James DeLisle notifications@github.comwrote:
This is a log from it running in a KVM node. I ran the test on my laptop (also 3.2) and got a panic but did not spend the time to hook up a netconsole. Linux debian 3.2.0-2-amd64 #1https://github.com/dtrace4linux/linux/issues/1SMP Mon Apr 30 05:20:23 UTC 2012 x86_64 GNU/Linux
I modified the source to build on Debian ( #45https://github.com/dtrace4linux/linux/issues/45). Let me know if there is anything else I can provide. I tried building with dtrace_printf() uncomented in dtrace_int_page_fault_handler() and it paniced in a different way, I suspect calling dtrace_printf() might have triggered another page fault.
[ 1431.895203] BUG: unable to handle kernel NULL pointer dereference at 0000000000000091 [ 1431.896036] IP: [
] dtrace_probe+0x5b/0x199 [dtracedrv] [ 1431.896036] PGD 7a79e067 PUD 798be067 PMD 0 [ 1431.896036] Oops: 0000 [#1] SMP [ 1431.896036] CPU 3 [ 1431.896036] Modules linked in: dtracedrv(P) loop snd_pcm snd_page_alloc snd_timer snd soundcore psmouse processor parport_pc thermal_sys evdev pcspkr serio_raw i2c_piix4 i2c_core parport button ext4 crc16 jbd2 mbcache sr_mod sd_mod cdrom crc_t10dif ata_generic floppy 8139too 8139cp ata_piix mii libata scsi_mod [last unloaded: scsi_wait_scan] [ 1431.896036] [ 1431.896036] Pid: 4808, comm: du Tainted: P W O 3.2.0-2-amd64 #1 Bochs Bochs [ 1431.896036] RIP: 0010:[ ] [ ] dtrace_probe+0x5b/0x199 [dtracedrv] [ 1431.896036] RSP: 0018:ffff880067527e80 EFLAGS: 00010282 [ 1431.896036] RAX: 0000000000000000 RBX: 0000000000000003 RCX: 0000000000030900 [ 1431.896036] RDX: 0000000001849eb8 RSI: 0000000000000006 RDI: 000000000003a32d [ 1431.896036] RBP: 0000000000000000 R08: 0000000000000000 R09: 000000000183e650 [ 1431.896036] R10: 0000000000000003 R11: 0000000000000246 R12: 000000000003a32d [ 1431.896036] R13: 0000000000000000 R14: 0000000001849eb8 R15: 0000000000000006 [ 1431.896036] FS: 00002ad3684c8b20(0000) GS:ffff88007fcc0000(0000) knlGS:00000000556e06c0 [ 1431.896036] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1431.896036] CR2: 0000000000000091 CR3: 00000000690f5000 CR4: 00000000000006e0 [ 1431.896036] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1431.896036] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 [ 1431.896036] Process du (pid: 4808, threadinfo ffff880067526000, task ffff88007aa289f0) [ 1431.896036] Stack: [ 1431.896036] 000000000183e650 0000000000000000 0000000000030900 0000000001849eb8 [ 1431.896036] 0000000000000006 000000000003a32d 0000000050ccc01c ffff88007aa45818 [ 1431.896036] 0000000000000000 ffffffffa01e69be 0000000000000003 0000000000000000 [ 1431.896036] Call Trace: [ 1431.896036] [ ] ? dtrace_systrace_syscall2+0xa5/0x231 [dtracedrv] [ 1431.896036] [ ] ? dtrace_systrace_syscall+0xcf/0xd4 [dtracedrv] [ 1431.896036] [ ] ? system_call_fastpath+0x16/0x1b [ 1431.896036] Code: 44 24 08 4c 89 0c 24 e8 99 56 01 00 48 8b 80 c0 00 00 00 48 8b 54 24 18 48 8b 4c 24 10 48 8b 74 24 20 8b 7c 24 28 4c 8b 44 24 08 80 91 00 00 00 02 4c 8b 0c 24 74 1c 83 3d 87 df 05 00 00 74 [ 1431.896036] RIP [ ] dtrace_probe+0x5b/0x199 [dtracedrv] [ 1431.896036] RSP [ 1431.896036] CR2: 0000000000000091 [ 1431.902812] BUG: unable to handle kernel [ 1431.984819] ---[ end trace 3895f73ef2b14e68 ]--- [ 1431.902812] NULL pointer dereference at 0000000000000091 [ 1431.902812] IP: [ ] dtrace_probe+0x5b/0x199 [dtracedrv] [ 1431.902812] PGD 0 [ 1431.902812] Oops: 0000 [#2] SMP [ 1431.902812] CPU 2 [ 1431.902812] Modules linked in: dtracedrv(P) loop snd_pcm snd_page_alloc snd_timer snd soundcore psmouse processor parport_pc thermal_sys evdev pcspkr serio_raw i2c_piix4 i2c_core parport button ext4 crc16 jbd2 mbcache sr_mod sd_mod cdrom crc_t10dif ata_generic floppy 8139too 8139cp ata_piix mii libata scsi_mod [last unloaded: scsi_wait_scan] [ 1431.902812] [ 1431.902812] Pid: 4854, comm: modprobe Tainted: P D W O 3.2.0-2-amd64 #1 Bochs Bochs [ 1431.902812] RIP: 0010:[ ] [ ] dtrace_probe+0x5b/0x199 [dtracedrv] [ 1431.902812] RSP: 0018:ffff88006751de80 EFLAGS: 00010282 [ 1431.902812] RAX: 0000000000000000 RBX: 0000000000000002 RCX: 000000000005ad20 [ 1431.902812] RDX: 0000000000090800 RSI: 00007faf4073571d RDI: 000000000003a12f [ 1431.902812] RBP: 0000000000000000 R08: 0000000000000000 R09: 3436646d612d322d [ 1431.902812] R10: 00007fff8c8c1fa2 R11: 0000000000000246 R12: 000000000003a12f [ 1431.902812] R13: 0000000000000000 R14: 0000000000090800 R15: 00007faf4073571d [ 1431.902812] FS: 00007faf40708700(0000) GS:ffff88007fc80000(0000) knlGS:00000000556e06c0 [ 1431.902812] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1431.902812] CR2: 0000000000000091 CR3: 000000006b8e8000 CR4: 00000000000006e0 [ 1431.902812] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1431.902812] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 [ 1431.902812] Process modprobe (pid: 4854, threadinfo ffff88006751c000, task ffff8800684f0e20) [ 1431.902812] Stack: [ 1431.902812] 3436646d612d322d 0000000000000000 000000000005ad20 0000000000090800 [ 1431.902812] 00007faf4073571d 000000000003a12f 000000004feabb91 ffff88007aa44030 [ 1431.902812] 0000000000000000 ffffffffa01e69be 00007fff8c8c1fa2 0000000000000000 [ 1431.902812] Call Trace: [ 1431.902812] [ ] ? dtrace_systrace_syscall2+0xa5/0x231 [dtracedrv] [ 1431.902812] [ ] ? dtrace_systrace_syscall+0xcf/0xd4 [dtracedrv] [ 1431.902812] [ ] ? page_fault+0x25/0x30 [ 1431.902812] [ ] ? system_call_fastpath+0x16/0x1b [ 1431.902812] Code: 44 24 08 4c 89 0c 24 e8 99 56 01 00 48 8b 80 c0 00 00 00 48 8b 54 24 18 48 8b 4c 24 10 48 8b 74 24 20 8b 7c 24 28 4c 8b 44 24 08 80 91 00 00 00 02 4c 8b 0c 24 74 1c 83 3d 87 df 05 00 00 74 [ 1431.902812] RIP [ ] dtrace_probe+0x5b/0x199 [dtracedrv] [ 1431.902812] RSP [ 1431.902812] CR2: 0000000000000091 [ 1431.900021] BUG: unable to handle kernel [ 1432.082166] ---[ end trace 3895f73ef2b14e69 ]--- [ 1432.083286] NULL pointer dereference at 0000000000000091 [ 1432.083286] IP: [ ] dtrace_probe+0x5b/0x199 [dtracedrv] [ 1432.083286] PGD 7a218067 PUD 6bbaf067 PMD 0 [ 1432.083286] Oops: 0000 [#3] SMP [ 1432.083286] CPU 4 [ 1432.083286] Modules linked in: dtracedrv(P) loop snd_pcm snd_page_alloc snd_timer snd soundcore psmouse processor parport_pc thermal_sys evdev pcspkr serio_raw i2c_piix4 i2c_core parport button ext4 crc16 jbd2 mbcache sr_mod sd_mod cdrom crc_t10dif ata_generic floppy 8139too 8139cp ata_piix mii libata scsi_mod [last unloaded: scsi_wait_scan] [ 1432.083286] [ 1432.083286] Pid: 4573, comm: dtrace Tainted: P D W O 3.2.0-2-amd64 #1 Bochs Bochs [ 1432.083286] RIP: 0010:[ ] [ ] dtrace_probe+0x5b/0x199 [dtracedrv] [ 1432.083286] RSP: 0018:ffff88007fd03e70 EFLAGS: 00010282 [ 1432.083286] RAX: 0000000000000000 RBX: 0000000000000004 RCX: 0000000000000000 [ 1432.083286] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 000000000003a64f [ 1432.083286] RBP: ffff88006626de00 R08: 0000000000000000 R09: 0000000000000000 [ 1432.083286] R10: 0000000000000001 R11: ffff88007fd0e780 R12: 0000000000000000 [ 1432.083286] R13: 0000000000000001 R14: 0000000000000006 R15: ffff880066609fd8 [ 1432.083286] FS: 00002b259d23adc0(0000) GS:ffff88007fd00000(0000) knlGS:00000000556e06c0 [ 1432.083286] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1432.083286] CR2: 0000000000000091 CR3: 000000006c579000 CR4: 00000000000006e0 [ 1432.083286] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1432.083286] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 [ 1432.083286] Process dtrace (pid: 4573, threadinfo ffff880066608000, task ffff88007aa2c240) [ 1432.083286] Stack: [ 1432.083286] 0000000000000000 0000000000000000 0000000000000000 0000000000000000 [ 1432.083286] 0000000000000000 ffffffff0003a64f 0000000000000297 0000000000000001 [ 1432.083286] ffff88006626de00 ffffffffa01baec9 0000000000000020 ffffffffa02020a0 [ 1432.083286] Call Trace: [ 1432.083286] [ 1432.083286] [ ] ? cyclic_tasklet_func+0xc1/0xe6 [dtracedrv] [ 1432.083286] [ ] ? tasklet_action+0x73/0xc2 [ 1432.083286] [ ] ? do_softirq+0xb9/0x177 [ 1432.083286] [ ] ? call_softirq+0x1c/0x30 [ 1432.083286] [ do_fault+0x371/0x3ac [ 1432.262513] [] ? do_softirq+0x3c/0x7b [ 1432.083286] [ ] ? irq_exit+0x3c/0x9a [ 1432.083286] [ ] ? smp_apic_timer_interrupt+0x74/0x82 [ 1432.083286] [ ] ? apic_timer_interrupt+0x6e/0x80 [ 1432.083286] [ 1432.083286] [ ] ? dtrace_bzero+0xc/0xf [dtracedrv] [ 1432.083286] [ ] ? kmem_zalloc+0x26/0x54 [dtracedrv] [ 1432.083286] [ ] ? dtrace_state_buffer+0x3b3/0x640 [dtracedrv] [ 1432.083286] [ ] ? dtrace_state_go+0x576/0xa75 [dtracedrv] [ 1432.083286] [ ] ? dtrace_strcmp+0x1b/0x1b [dtracedrv] [ 1432.083286] [ ] ? dtrace_ioctl+0xc7c/0x217a [dtracedrv] [ 1432.083286] [ ] ? dtrace_ioctl+0x1520/0x217a [dtracedrv] [ 1432.083286] [ ] ? zone_page_state_add+0x14/0x23 [ 1432.083286] [ ] ? find_get_page+0x40/0x63 [ 1432.083286] [ ] ? should_resched+0x5/0x23 [ 1432.083286] [ ] ? _cond_resched+0x7/0x1c [ 1432.083286] [ ] ? lock_page+0x11/0x20 [ 1432.083286] [ ] ? find_lock_page+0x29/0x4a [ 1432.083286] [ ] ? shmem_getpage_gfp+0x8f/0x47d [ 1432.083286] [ ] ? generic_file_buffered_write+0x1e3/0x259 [ 1432.083286] [ ] ? shmem_getxattr+0x6e/0xca [ 1432.083286] [ ] ? find_get_page+0x40/0x63 [ 1432.083286] [ ] ? should_resched+0x5/0x23 [ 1432.083286] [ ] ? _cond_resched+0x7/0x1c [ 1432.083286] [ ] ? filemap_fault+0x1e6/0x33e [ 1432.083286] [ ] ? lookup_page_cgroup+0x2d/0x42 [ 1432.083286] [ ] ? mem_cgroup_update_page_stat+0x17/0xd4 [ 1432.083286] [ ] ? do_fault+0x371/0x3ac [ 1432.083286] [ ] ? handle_pte_fault+0x298/0x79f [ 1432.083286] [ do_softirq+0xb9/0x177 [ 1432.262375] [] ? pte_offset_kernel+0x16/0x35 [ 1432.083286] [ ] ? dtracedrv_ioctl.isra.3+0x3c/0x4d [dtracedrv] [ 1432.083286] [ ] ? dtracedrv_unlocked_ioctl+0x6/0xa [dtracedrv] [ 1432.083286] [ ] ? do_vfs_ioctl+0x459/0x49a [ 1432.083286] [ ] ? sys_ioctl+0x4b/0x72 [ 1432.083286] [ ] ? system_call_fastpath+0x16/0x1b [ 1432.083286] Code: 44 24 08 4c 89 0c 24 e8 99 56 01 00 48 8b 80 c0 00 00 00 48 8b 54 24 18 48 8b 4c 24 10 48 8b 74 24 20 8b 7c 24 28 4c 8b 44 24 08 80 91 00 00 00 02 4c 8b 0c 24 74 1c 83 3d 87 df 05 00 00 74 [ 1432.083286] RIP [ ] dtrace_probe+0x5b/0x199 [dtracedrv] [ 1432.083286] RSP [ 1432.083286] CR2: 0000000000000091 [ 1431.904071] BUG: unable to handle kernel [ 1432.262291] ---[ end trace 3895f73ef2b14e6a ]--- [ 1432.262294] Kernel panic - not syncing: Fatal exception in interrupt [ 1432.262297] Pid: 4573, comm: dtrace Tainted: P D W O 3.2.0-2-amd64 #1 [ 1432.262299] Call Trace: [ 1432.262300] [ ] ? panic+0x95/0x1a5 [ 1432.262310] [ ] ? oops_end+0xa9/0xb6 [ 1432.262313] [ ] ? no_context+0x1ff/0x20e [ 1432.262317] [ ] ? do_page_fault+0x1a8/0x337 [ 1432.262321] [ ] ? load_balance+0x85/0x629 [ 1432.262335] [ ] ? ata_sff_hsm_move+0x5ed/0x616 [libata] [ 1432.262344] [ ] ? scsi_request_fn+0x33f/0x404 [scsi_mod] [ 1432.262348] [ ] ? page_fault+0x25/0x30 [ 1432.262357] [ ] ? dtrace_probe+0x5b/0x199 [dtracedrv] [ 1432.262365] [ ] ? cyclic_tasklet_func+0xc1/0xe6 [dtracedrv] [ 1432.262368] [ ] ? tasklet_action+0x73/0xc2 [ 1432.262371] [ ] ? ] ? call_softirq+0x1c/0x30 [ 1432.262378] [ ] ? do_softirq+0x3c/0x7b [ 1432.262381] [ ] ? irq_exit+0x3c/0x9a [ 1432.262385] [ ] ? smp_apic_timer_interrupt+0x74/0x82 [ 1432.262388] [ ] ? apic_timer_interrupt+0x6e/0x80 [ 1432.262389] [ ] ? dtrace_bzero+0xc/0xf [dtracedrv] [ 1432.262417] [ ] ? kmem_zalloc+0x26/0x54 [dtracedrv] [ 1432.262424] [ ] ? dtrace_state_buffer+0x3b3/0x640 [dtracedrv] [ 1432.262433] [ ] ? dtrace_state_go+0x576/0xa75 [dtracedrv] [ 1432.262442] [ ] ? dtrace_strcmp+0x1b/0x1b [dtracedrv] [ 1432.262451] [ ] ? dtrace_ioctl+0xc7c/0x217a [dtracedrv] [ 1432.262460] [ ] ? dtrace_ioctl+0x1520/0x217a [dtracedrv] [ 1432.262464] [ ] ? zone_page_state_add+0x14/0x23 [ 1432.262468] [ ] ? find_get_page+0x40/0x63 [ 1432.262470] [ ] ? should_resched+0x5/0x23 [ 1432.262473] [ ] ? _cond_resched+0x7/0x1c [ 1432.262476] [ ] ? lock_page+0x11/0x20 [ 1432.262479] [ ] ? find_lock_page+0x29/0x4a [ 1432.262482] [ ] ? shmem_getpage_gfp+0x8f/0x47d [ 1432.262486] [ ] ? generic_file_buffered_write+0x1e3/0x259 [ 1432.262489] [ ] ? shmem_getxattr+0x6e/0xca [ 1432.262492] [ ] ? find_get_page+0x40/0x63 [ 1432.262494] [ ] ? should_resched+0x5/0x23 [ 1432.262497] [ ] ? _cond_resched+0x7/0x1c [ 1432.262500] [ ] ? filemap_fault+0x1e6/0x33e [ 1432.262504] [ ] ? lookup_page_cgroup+0x2d/0x42 [ 1432.262507] [ ] ? mem_cgroup_update_page_stat+0x17/0xd4 [ 1432.262510] [ ] ? ] ? handle_pte_fault+0x298/0x79f [ 1432.262516] [ ] ? pte_offset_kernel+0x16/0x35 [ 1432.262526] [ ] ? dtracedrv_ioctl.isra.3+0x3c/0x4d [dtracedrv] [ 1432.262536] [ ] ? dtracedrv_unlocked_ioctl+0x6/0xa [dtracedrv] [ 1432.262539] [ ] ? do_vfs_ioctl+0x459/0x49a [ 1432.262543] [ ] ? sys_ioctl+0x4b/0x72 [ 1432.262546] [ ] ? system_call_fastpath+0x16/0x1b [ 1431.904071] NULL pointer dereference at 0000000000000091 [ 1431.904071] IP: [ ] dtrace_probe+0x5b/0x199 [dtracedrv] [ 1431.904071] PGD 0 [ 1431.904071] Oops: 0000 [#4] SMP [ 1431.904071] CPU 5 [ 1431.904071] Modules linked in: dtracedrv(P) loop snd_pcm snd_page_alloc snd_timer snd soundcore psmouse processor parport_pc thermal_sys evdev pcspkr serio_raw i2c_piix4 i2c_core parport button ext4 crc16 jbd2 mbcache sr_mod sd_mod cdrom crc_t10dif ata_generic floppy 8139too 8139cp ata_piix mii libata scsi_mod [last unloaded: scsi_wait_scan] [ 1431.904071] [ 1431.904071] Pid: 4858, comm: modprobe Tainted: P D W O 3.2.0-2-amd64 #1 Bochs Bochs [ 1431.904071] RIP: 0010:[ ] [ ] dtrace_probe+0x5b/0x199 [dtracedrv] [ 1431.904071] RSP: 0018:ffff88006b8d9e80 EFLAGS: 00010282 [ 1431.904071] RAX: 0000000000000000 RBX: 0000000000000005 RCX: 0000000000000001 [ 1431.904071] RDX: 0000000000000000 RSI: 00007fabd90f32d0 RDI: 000000000003a12f [ 1431.904071] RBP: 0000000000000000 R08: ffffffffffffffb0 R09: 00007fabd92fa570 [ 1431.904071] R10: 0000000000000000 R11: 0000000000000246 R12: 000000000003a12f [ 1431.904071] R13: 0000000000000000 R14: 0000000000000000 R15: 00007fabd90f32d0 [ 1431.904071] FS: 00002b2c6c40ab20(0000) GS:ffff88007fd40000(0000) knlGS:00000000556e06c0 [ 1431.904071] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1431.904071] CR2: 0000000000000091 CR3: 000000006753f000 CR4: 00000000000006e0 [ 1431.904071] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1431.904071] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 [ 1431.904071] Process modprobe (pid: 4858, threadinfo ffff88006b8d8000, task ffff880067909750) [ 1431.904071] Stack: [ 1431.904071] 00007fabd92fa570 ffffffffffffffb0 0000000000000001 0000000000000000 [ 1431.904071] 00007fabd90f32d0 ffff88000003a12f 0000000200000001 ffff88007aa44030 [ 1431.904071] 0000000000000000 ffffffffa01e69be 0000000000000000 00000000000000d0 [ 1431.904071] Call Trace: [ 1431.904071] [ ] ? dtrace_systrace_syscall2+0xa5/0x231 [dtracedrv] [ 1431.904071] [ ] ? kmem_cache_alloc+0x86/0xea [ 1431.904071] [ ] ? dtrace_systrace_syscall+0xcf/0xd4 [dtracedrv] [ 1431.904071] [ ] ? page_fault+0x25/0x30 [ 1431.904071] [ ] ? system_call_fastpath+0x16/0x1b [ 1431.904071] Code: 44 24 08 4c 89 0c 24 e8 99 56 01 00 48 8b 80 c0 00 00 00 48 8b 54 24 18 48 8b 4c 24 10 48 8b 74 24 20 8b 7c 24 28 4c 8b 44 24 08 80 91 00 00 00 02 4c 8b 0c 24 74 1c 83 3d 87 df 05 00 00 74 [ 1431.904071] RIP [ ] dtrace_probe+0x5b/0x199 [dtracedrv] [ 1431.904071] RSP [ 1431.904071] CR2: 0000000000000091 [ 1431.996070] BUG: unable to handle kernel NULL pointer dereference at 0000000000000091 [ 1431.996070] IP: [ ] dtrace_probe+0x5b/0x199 [dtracedrv] [ 1431.996070] PGD 37121067 PUD 690e6067 PMD 0 [ 1431.996070] Oops: 0000 [#5] SMP [ 1431.996070] CPU 0 [ 1431.996070] Modules linked in: dtracedrv(P) loop snd_pcm snd_page_alloc snd_timer snd soundcore psmouse processor parport_pc thermal_sys evdev pcspkr serio_raw i2c_piix4 i2c_core parport button ext4 crc16 jbd2 mbcache sr_mod sd_mod cdrom crc_t10dif ata_generic floppy 8139too 8139cp ata_piix mii libata scsi_mod [last unloaded: scsi_wait_scan] [ 1431.996070] [ 1431.996070] Pid: 4545, comm: tests.pl Tainted: P D W O 3.2.0-2-amd64 #1 Bochs Bochs [ 1431.996070] RIP: 0010:[ ] [ ] dtrace_probe+0x5b/0x199 [dtracedrv] [ 1431.996070] RSP: 0018:ffff88006bba5e80 EFLAGS: 00010282 [ 1431.996070] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 00000000000001b6 [ 1431.996070] RDX: 0000000000000000 RSI: 0000000001b34890 RDI: 000000000003a12f [ 1431.996070] RBP: 0000000000000000 R08: 00002b2c6b556510 R09: 00000000000001b6 [ 1431.996070] R10: 00000000ffffffff R11: 0000000000000246 R12: 000000000003a12f [ 1431.996070] R13: 0000000000000000 R14: 0000000000000000 R15: 0000000001b34890 [ 1431.996070] FS: 00002b2c6c40ab20(0000) GS:ffff88007fc00000(0000) knlGS:00000000556e06c0 [ 1431.996070] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1431.996070] CR2: 0000000000000091 CR3: 000000007a64b000 CR4: 00000000000006f0 [ 1431.996070] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1431.996070] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 [ 1431.996070] Process tests.pl (pid: 4545, threadinfo ffff88006bba4000, task ffff88007c104040) [ 1431.996070] Stack: [ 1431.996070] 00000000000001b6 00002b2c6b556510 00000000000001b6 0000000000000000 [ 1431.996070] 0000000001b34890 000000000003a12f 0000000050ccc01c ffff88007aa44030 [ 1431.996070] 0000000000000000 ffffffffa01e69be 00000000ffffffff 0000000000000000 [ 1431.996070] Call Trace: [ 1431.996070] [ ] ? dtrace_systrace_syscall2+0xa5/0x231 [dtracedrv] [ 1431.996070] [ ] ? dtrace_systrace_syscall+0xcf/0xd4 [dtracedrv] [ 1431.996070] [ ] ? page_fault+0x25/0x30 [ 1431.996070] [ ] ? system_call_fastpath+0x16/0x1b [ 1431.996070] Code: 44 24 08 4c 89 0c 24 e8 99 56 01 00 48 8b 80 c0 00 00 00 48 8b 54 24 18 48 8b 4c 24 10 48 8b 74 24 20 8b 7c 24 28 4c 8b 44 24 08 80 91 00 00 00 02 4c 8b 0c 24 74 1c 83 3d 87 df 05 00 00 74 [ 1431.996070] RIP [ ] dtrace_probe+0x5b/0x199 [dtracedrv] [ 1431.996070] RSP [ 1431.996070] CR2: 0000000000000091 [ 1432.088036] BUG: unable to handle kernel NULL pointer dereference at 0000000000000091 [ 1432.088036] IP: [ ] dtrace_probe+0x5b/0x199 [dtracedrv] [ 1432.088036] PGD 0 [ 1432.088036] Oops: 0000 [#6] SMP [ 1432.088036] CPU 3 [ 1432.088036] Modules linked in: dtracedrv(P) loop snd_pcm snd_page_alloc snd_timer snd soundcore psmouse processor parport_pc thermal_sys evdev pcspkr serio_raw i2c_piix4 i2c_core parport button ext4 crc16 jbd2 mbcache sr_mod sd_mod cdrom crc_t10dif ata_generic floppy 8139too 8139cp ata_piix mii libata scsi_mod [last unloaded: scsi_wait_scan] [ 1432.088036] [ 1432.088036] Pid: 4864, comm: modprobe Tainted: P D W O 3.2.0-2-amd64 #1 Bochs Bochs [ 1432.088036] RIP: 0010:[ ] [ ] dtrace_probe+0x5b/0x199 [dtracedrv] [ 1432.088036] RSP: 0018:ffff88006b8d1e80 EFLAGS: 00010282 [ 1432.088036] RAX: 0000000000000000 RBX: 0000000000000003 RCX: 0000000000000001 [ 1432.088036] RDX: 0000000000000000 RSI: 00007f8d951892d0 RDI: 000000000003a12f [ 1432.088036] RBP: 0000000000000000 R08: ffffffffffffffb0 R09: 00007f8d95390570 [ 1432.088036] R10: 0000000000000000 R11: 0000000000000246 R12: 000000000003a12f [ 1432.088036] R13: 0000000000000000 R14: 0000000000000000 R15: 00007f8d951892d0 [ 1432.088036] FS: 00002b5b722b4b20(0000) GS:ffff88007fcc0000(0000) knlGS:00000000556e06c0 [ 1432.088036] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 1432.088036] CR2: 0000000000000091 CR3: 0000000066d00000 CR4: 00000000000006e0 [ 1432.088036] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 1432.088036] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 [ 1432.088036] Process modprobe (pid: 4864, threadinfo ffff88006b8d0000, task ffff88007aaa9750) [ 1432.088036] Stack: [ 1432.088036] 00007f8d95390570 ffffffffffffffb0 0000000000000001 0000000000000000 [ 1432.088036] 00007f8d951892d0 ffff88000003a12f 0000000200000001 ffff88007aa44030 [ 1432.088036] 0000000000000000 ffffffffa01e69be 0000000000000000 00000000000000d0 [ 1432.088036] Call Trace: [ 1432.088036] [ ] ? dtrace_systrace_syscall2+0xa5/0x231 [dtracedrv] [ 1432.088036] [ ] ? kmem_cache_alloc+0x86/0xea [ 1432.088036] [ ] ? dtrace_systrace_syscall+0xcf/0xd4 [dtracedrv] [ 1432.088036] [ ] ? page_fault+0x25/0x30 [ 1432.088036] [ ] ? system_call_fastpath+0x16/0x1b [ 1432.088036] Code: 44 24 08 4c 89 0c 24 e8 99 56 01 00 48 8b 80 c0 00 00 00 48 8b 54 24 18 48 8b 4c 24 10 48 8b 74 24 20 8b 7c 24 28 4c 8b 44 24 08 80 91 00 00 00 02 4c 8b 0c 24 74 1c 83 3d 87 df 05 00 00 74 [ 1432.088036] RIP [ ] dtrace_probe+0x5b/0x199 [dtracedrv] [ 1432.088036] RSP [ 1432.088036] CR2: 0000000000000091 [ 1432.088016] BUG: unable to handle kernel NULL pointer dereference at 0000000000000091 [ 1432.088016] IP: [ ] dtrace_probe+0x5b/0x199 [dtracedrv] [ 1432.088016] PGD 6b8c4067 PUD 66677067 PMD 0 [ 1432.088016] Oops: 0000 [#7] SMP [ 1432.088016] CPU 2 [ 1432.088016] Modules linked in: dtracedrv(P) loop snd_pcm snd_page_alloc snd_timer snd soundcore psmouse processor parport_pc thermal_sys evdev pcsp Processor on the host is an AMD 6128. The guest is running with -smp 6 In the guest /proc/cpuinfo appears as:
processor : 5 vendor_id : AuthenticAMD cpu family : 15 model : 6 model name : AMD Opteron 23xx (Gen 3 Class Opteron) stepping : 1 microcode : 0x1000065 cpu MHz : 1999.999 cache size : 512 KB fpu : yes fpu_exception : yes cpuid level : 5 wp : yes flags : fpu de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx lm rep_good nopl extd_apicid pni cx16 popcnt hypervisor svm abm sse4a misalignsse bogomips : 3999.99 TLB size : 1024 4K pages clflush size : 64 cache_alignment : 64 address sizes : 40 bits physical, 48 bits virtual power management:
Reply to this email directly or view it on GitHubhttps://github.com/dtrace4linux/linux/issues/46.
cjdelisle
commented
11 years ago I have not tested this all the way through but it should work ok. https://ezcrypt.it/NG5n#hdukyvLNtJZwd7cae6Tdzu3Q
dtrace4linux
commented
11 years ago Brilliant - thank you Caleb - very useful, especially as you included the wget link.
On 16 December 2012 10:37, Caleb James DeLisle notifications@github.comwrote:
I have not tested this all the way through but it should work ok. https://ezcrypt.it/NG5n#hdukyvLNtJZwd7cae6Tdzu3Q
— Reply to this email directly or view it on GitHubhttps://github.com/dtrace4linux/linux/issues/46#issuecomment-11416348.
This is a log from it running in a KVM node. I ran the test on my laptop (also 3.2) and got a panic but did not spend the time to hook up a netconsole. Linux debian 3.2.0-2-amd64 #1 SMP Mon Apr 30 05:20:23 UTC 2012 x86_64 GNU/Linux
I modified the source to build on Debian ( https://github.com/dtrace4linux/linux/pull/45 ). Let me know if there is anything else I can provide. I tried building with dtrace_printf() uncomented in dtrace_int_page_fault_handler() and it paniced in a different way, I suspect calling dtrace_printf() might have triggered another page fault.
Processor on the host is an AMD 6128. The guest is running with -smp 6 In the guest /proc/cpuinfo appears as: