dtrace4linux
commented
11 years ago Interesting .. it took an INT3 breakpoint trap and looked to see if this was a user space probe. Obviously it hit a null ptr. Either the calling regs are incorrect or some other issue. Do you have any non-3.10 kernels to try? I need to validate if this is occurring outside 3.10.
thanks
On 22 July 2013 17:25, Azat Khuzhin notifications@github.com wrote:
Trying to run dtrace on PID, using dtrace script, and when function that I've trace entered/leaved get next error in kern.log, and after this PID is killed by: "Trace/breakpoint trap"
Don't pay attention to 2-6-39 it is just host name.
And also this one is after applying #60https://github.com/dtrace4linux/linux/issues/60 But I don't event try to read /proc/dtrace/*, so that patchset mustn't affect this bug. And BTW I have the same issue as in #58https://github.com/dtrace4linux/linux/issues/58when compiling (maybe this can affect)
Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.067716] CPU: 0 PID: 3110 Comm: boostcached Tainted: P W O 3.11.0-rc1+ #21 Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.069988] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.071585] 0000000000000000 ffff8800370d9460 ffffffff813689a2 ffff8800370d9460 Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.071585] ffffffffa0353dc4 ffff8800370d9460 ffff8800370d9460 ffff88007fc09f58 Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.071585] 0000000000000000 ffffffffa039be20 ffffffffa039be78 ffffffffa034a5ca Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.071585] ffffffffa0353dc4 ffff8800370d9460 ffff8800370d9460 ffff88007fc09f58 [0/160] Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.071585] 0000000000000000 ffffffffa039be20 ffffffffa039be78 ffffffffa034a5ca Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.071585] Call Trace: Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.071585] <#DB> [
] ? dump_stack+0x41/0x51 Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.071585] [ ] ? mutex_enter_common+0x29/0xd7 [dtracedrv] Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.071585] [ ] ? rw_enter+0x10/0x4b [dtracedrv] Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.071585] [ ] ? dtrace_user_probe+0x198/0x2a6 [dtracedrv] Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.071585] [ ] ? dtrace_int3_handler+0x111/0x201 [dtracedrv] Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.071585] [ ] ? dtrace_int3+0x3a/0x8f [dtracedrv] Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.071585] < > Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.092483] traps: boostcached[3110] trap int3 ip:4fc157 sp:7f9b14081758 error:0 Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.094567] BUG: unable to handle kernel NULL pointer dereference at (null) Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.098015] IP: < (null)> Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.098512] PGD 36d59067 PUD 7cadf067 PMD 0 Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.098512] Oops: 0010 [#1] SMP Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.098512] Modules linked in: dtracedrv(PO) nfsd auth_rpcgss oid_registry nfs_acl nfs lockd fscache sunrpc loop fuse joydev hid_generic usbhid hid snd_pcm mperf snd_page_alloc snd_timer snd soundc ore button processor psmouse thermal_sys pcspkr serio_raw ohci_pci ohci_hcd ehci_hcd usbcore microcode usb_common parport_pc i2c_piix4 parport i2c_core ac evdev ext4 crc16 jbd2 mbcache sg sr_mod cdrom sd_mod crc_t10dif ata_generic ata_piix ahci l ibahci libata scsi_mod e1000 Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.098512] CPU: 1 PID: 3108 Comm: boostcached Tainted: P W O 3.11.0-rc1+ #21 Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.098512] Hardware name: innotek GmbH VirtualBox/VirtualBox, BIOS VirtualBox 12/01/2006 Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.098512] task: ffff880037200180 ti: ffff880036c32000 task.ti: ffff880036c32000 Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.098512] RIP: 0010:[<0000000000000000>] < (null)> Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.098512] RSP: 0018:ffff880036c33ad8 EFLAGS: 00010246 Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.098512] RAX: ffffffff8104beca RBX: ffff88007b557780 RCX: 0000000000000000 Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.098512] RDX: 0000000000000001 RSI: ffff88007b557780 RDI: ffff8800370e0400 Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.098512] RBP: ffff8800370e0400 R08: 00000000000000c0 R09: 0000000000000030 Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.098512] R10: 0000000000000020 R11: 0000000000000020 R12: 0000000000000001 Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.098512] R13: 0000000000000000 R14: ffffffffa034c971 R15: ffff880037200180 Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.098512] FS: 00007f9b169f9740(0000) GS:ffff88007fd00000(0000) knlGS:0000000000000000 Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.098512] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.098512] CR2: 0000000000000000 CR3: 000000007abe0000 CR4: 00000000000006e0 Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.098512] Stack: Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.098512] ffffffffa0358a0e ffffffffa034c971 0000000000000000 ffff880037200180 Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.098512] 0000000000000000 0000000000000009 ffffffffa0358a9a 0000000000000001 Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.098512] ffff880036c33bc8 ffff880036c33b50 ffffffffa034c95e ffffffffa034cd78 Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.098512] Call Trace: Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.098512] [ ] ? taskq_dispatch2+0xb4/0xc0 [dtracedrv] Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.098512] [ ] ? fasttrap_pid_cleanup+0x78/0x78 [dtracedrv] Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.098512] [ ] ? timeout+0x41/0x86 [dtracedrv] Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.098512] [ ] ? fasttrap_pid_cleanup+0x65/0x78 [dtracedrv] Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.098512] [ ] ? fasttrap_exec_exit+0x22/0x2c [dtracedrv] Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.098512] [ ] ? proc_exit_notifier+0x57/0x6e [dtracedrv] Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.098512] [ ] ? notifier_call_chain+0x2e/0x59 Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.098512] [ ] ? should_resched+0x5/0x23 Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.098512] [ ] ? __blocking_notifier_call_chain+0x43/0x5d Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.098512] [ ] ? do_exit+0x22/0x8ff Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.098512] [ ] ? do_group_exit+0x67/0x99 Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.098512] [ ] ? get_signal_to_deliver+0x479/0x4ad Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.098512] [ ] ? sync_mm_rss+0x35/0x5f Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.098512] [ ] ? do_signal+0x3c/0x434 Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.098512] [ ] ? task_rq_unlock+0xf/0x23 Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.098512] [ ] ? wake_up_new_task+0xb7/0xd0 Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.098512] [ ] ? SyS_futex+0x12e/0x161 Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.098512] [ ] ? do_notify_resume+0x25/0x68 Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.098512] [ ] ? int_signal+0x12/0x17 Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.098512] Code: Bad RIP value. Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.098512] RIP < (null)> Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.098512] RSP Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.098512] CR2: 0000000000000000 Jul 21 12:56:02 debian-virtual-2-6-39 kernel: [ 103.155460] ---[ end trace 0282fba058bae4eb ]--- Reply to this email directly or view it on GitHubhttps://github.com/dtrace4linux/linux/issues/61 .
azat
Trying to run dtrace on PID, using dtrace script, and when function that I've trace entered/leaved get next error in kern.log, and after this PID is killed by: "Trace/breakpoint trap"
Don't pay attention to 2-6-39 it is just host name.
And also this one is after applying #60 But I don't event try to read /proc/dtrace/*, so that patchset mustn't affect this bug. And BTW I have the same issue as in #58 when compiling (maybe this can affect)