search

dtrace4linux / linux

dtrace for linux - kernel driver and userland tools
http://crtags.blogspot.com
1.17k stars 226 forks source link

failed to resolve curpsinfo #62

Closed michaelmior closed 9 years ago

michaelmior commented 11 years ago

I'm new to DTrace and found this really easy to install, but just a basic test probe isn't working

$ sudo dtrace -n BEGIN
dtrace: invalid probe specifier BEGIN: "/usr/lib/dtrace/node.d", line 56: failed to resolve curpsinfo: Unknown variable name

Running Ubuntu 13.04 with kernel version 3.8.0-27. Any help appreciated :)

dtrace4linux commented 11 years ago

remove the installed dir /usr/lib/dtrace - the installed *.d files will tickle an issue with unresolved struct definitions, as you have found.

On 3 August 2013 12:38, Michael Mior notifications@github.com wrote:

I'm new to DTrace and found this really easy to install, but just a basic test probe isn't working

$ sudo dtrace -n BEGIN dtrace: invalid probe specifier BEGIN: "/usr/lib/dtrace/node.d", line 56: failed to resolve curpsinfo: Unknown variable name

Running Ubuntu 13.04 with kernel version 3.8.0-27. Any help appreciated :)

— Reply to this email directly or view it on GitHubhttps://github.com/dtrace4linux/linux/issues/62 .

michaelmior commented 11 years ago

I now get the following. I don't know enough about DTrace to know if the final line is an issue, but removing /usr/lib/dtrace/ seems to have fixed my initial problem. 

dtrace: description 'BEGIN' matched 1 probe
CPU     ID                    FUNCTION:NAME
  1      1                           :BEGIN 
dtrace: processing aborted: No such device
dtrace4linux commented 11 years ago

what os is this? What does /proc/dtrace/trace show?

if you get no device, it may have panicced itself.

On 4 August 2013 05:37, Michael Mior notifications@github.com wrote:

I now get the following. I don't know enough about DTrace to know if the final line is an issue, but removing /usr/lib/dtrace/ seems to have fixed my initial problem.

dtrace: description 'BEGIN' matched 1 probe CPU ID FUNCTION:NAME 1 1 :BEGIN dtrace: processing aborted: No such device

— Reply to this email directly or view it on GitHubhttps://github.com/dtrace4linux/linux/issues/62#issuecomment-22066714 .

michaelmior commented 11 years ago

Ubuntu 13.04 with kernel version 3.8.0-27. Here's the entirety of /proc/dtrace/trace after the failure.

#1 12968:4dtracedrv loaded: /dev/dtrace available, dtrace_here=0 nr_cpus=2
#1 12968:vmem_create(dtrace) ffff88004cde8900
#1 12968:vmem_create(dtrace_minor) ffff88004cde8960
#1 12968:__alloc_workqueue_key_ptr=ffffffff810783a0
#1 12968:dtrace_linux.c:get_proc_addr: Failed to find 'lockdep_init_map' (warn=1)
#1 12968:queue_delayed_work_ptr=ffffffff81077900
#1 12968:destroy_workqueue_ptr=ffffffff81076320
#1 12968:flush_workqueue_ptr=ffffffff81075da0
#1 12968:delayed_work_timer_fn_ptr=ffffffff810774e0
#1 12968:ctf loaded: /dev/ctf now available
#1 12958:dtrace_linux.c:get_proc_addr: Failed to find 'sysrq_showregs_othercpus' (warn=2)
#1 12958:dtrace_linux.c:get_proc_addr: Failed to find 'xtime_cache' (warn=3)
0.000000000 #1 12958:xen: [0] bind_virq ret==0 port=0
0.000002858 #1 12958:xen: [0] bind_ipi=0
0.000004188 #1 12958:xen: [1] bind_virq ret==0 port=0
0.000005574 #1 12958:xen: [1] bind_ipi=0
0.001314014 #1 12958:profile loaded: /dev/dtrace_profile available
0.136283220 #1 12958:dtrace_linux.c:get_proc_addr: Failed to find 'tcp_event_data_sent' (warn=4)
0.136287813 #1 12958:prcom_add_function: cannot locate 'tcp_event_data_sent'
1.088842807 #0 12958:dcpc.c:dcpc_attach:1333: TODO:please fill me in
1.088847093 #0 12958:dcpc initialised.
1.089278222 #0 12958:sdt loaded: /dev/sdt now available
1.091914689 #0 12958:ctl loaded: /dev/dtrace_ctl now available
1.097804834 #0 12958:dtrace_function_size: do_sync_read ffffffff81193fd0 size=224
1.097812108 #0 12958:io_prov_entry called io:start
1.098215362 #0 12958:io_prov_return called io:start ffffffff8119409f  sz=1
1.101245041 #0 12958:dtrace_function_size: do_sync_write ffffffff81193ef0 size=224
1.101248014 #0 12958:io_prov_entry called io:start
1.101276422 #0 12958:io_prov_return called io:start ffffffff81193fbf  sz=1
1.360980642 #1 12980:fbt:dup patch: ffffffff8100a499 xen_irq_enable_direct_end
1.361006305 #1 12980:fbt:dup patch: ffffffff8100a4a9 xen_irq_disable_direct_end
1.361031957 #1 12980:fbt:dup patch: ffffffff8100a4be xen_save_fl_direct_end
1.361069309 #1 12980:fbt:dup patch: ffffffff8100a4df xen_restore_fl_direct_end
2.455165276 #1 12980:fbt:dup patch: ffffffff816cd411 error_sti
2.460374783 #1 12980:fbt:dup patch: ffffffff816d4dc0 __fentry__
2.460425626 #1 12980:fbt:dup patch: ffffffff816d4e6f ftrace_stub
6.267022726 #1 12980:initting a mutex
6.434220237 #1 12980:instr:dup patch: ffffffffa0c52d4d cleanup_module-callr
6.670963234 #1 12980:instr:dup patch: ffffffffa0bb063b cleanup_module-callr
6.678871966 #1 12980:instr:dup patch: ffffffffa0b35d73 cleanup_module-callr
6.688002243 #1 12980:instr:dup patch: ffffffffa0b970ef cleanup_module-callr
6.704034714 #1 12980:instr:dup patch: ffffffffa0b85817 cleanup_module-callr
6.717515991 #1 12980:instr:dup patch: ffffffffa0b3f0f4 cleanup_module-callr
6.730365385 #1 12980:instr:dup patch: ffffffffa0b2acb6 cleanup_module-callr
6.742566948 #1 12980:instr:dup patch: ffffffffa0a0552f cleanup_module-callr
6.885511551 #0 12980:instr:dup patch: ffffffffa0b7211b cleanup_module-callr
7.030017143 #0 12980:instr:dup patch: ffffffffa0abfef2 cleanup_module-callr
7.102769964 #0 12980:instr:dup patch: ffffffffa09e407b cleanup_module-callr
7.141124926 #0 12980:instr:dup patch: ffffffffa0a34eaa cleanup_module-callr
7.085577036 #1 12980:instr:dup patch: ffffffffa09fca47 cleanup_module-callr
7.092614582 #1 12980:instr:dup patch: ffffffffa09df02f cleanup_module-callr
7.095375114 #1 12980:instr:dup patch: ffffffffa09d631c cleanup_module-callr
7.098323037 #1 12980:instr:dup patch: ffffffffa09cc87c cleanup_module-callr
7.102509227 #1 12980:instr:dup patch: ffffffffa09ece73 cleanup_module-callr
7.125069960 #1 12980:instr:dup patch: ffffffffa098f6e7 cleanup_module-callr
7.163923712 #1 12980:instr:dup patch: ffffffffa092fb74 cleanup_module-callr
7.173088399 #1 12980:instr:dup patch: ffffffffa09c5d6f cleanup_module-callr
7.225475712 #1 12980:instr:dup patch: ffffffffa095dca4 cleanup_module-callr
7.475371598 #0 12980:instr:dup patch: ffffffffa0928404 cleanup_module-je
7.477407747 #0 12980:instr:dup patch: ffffffffa092103f cleanup_module-callr
7.477643914 #0 12980:instr:dup patch: ffffffffa091b237 cleanup_module-callr
7.478290200 #0 12980:instr:dup patch: ffffffffa0916588 cleanup_module-callr
7.479999754 #0 12980:instr:dup patch: ffffffffa03e3e50 cleanup_module-callr
7.480178341 #0 12980:instr:dup patch: ffffffffa03de14c cleanup_module-callr
7.480826625 #0 12980:instr:dup patch: ffffffffa03d981f cleanup_module-callr
7.482291646 #0 12980:instr:dup patch: ffffffffa03d31aa cleanup_module-callr
7.397843619 #1 12980:instr:dup patch: ffffffffa0908aa9 cleanup_module-callr
7.515301585 #0 12980:instr:dup patch: ffffffffa03c2444 cleanup_module-callr
7.521250046 #0 12980:instr:dup patch: ffffffffa03ca70f cleanup_module-callr
7.447831467 #1 12980:instr:dup patch: ffffffffa03b3783 cleanup_module-callr
7.457407685 #1 12980:instr:dup patch: ffffffffa02b875f cleanup_module-callr
7.458480079 #1 12980:instr:dup patch: ffffffffa02ae258 cleanup_module-callr
7.460200768 #1 12980:instr:dup patch: ffffffffa0278241 cleanup_module-callr
7.473371185 #1 12980:instr:dup patch: ffffffffa039b7fa cleanup_module-callr
7.500699021 #1 12980:instr:dup patch: ffffffffa037e107 cleanup_module-callr
7.507416400 #1 12980:instr:dup patch: ffffffffa00f11ec cleanup_module-callr
8.160198833 #1 12980:instr:dup patch: ffffffffa0583a23 cleanup_module-callr
8.283659225 #1 12980:instr:dup patch: ffffffffa00a69d3 cleanup_module-callr
8.292324332 #1 12980:instr:dup patch: ffffffffa036343f cleanup_module-callr
8.304797930 #1 12980:instr:dup patch: ffffffffa0351ea7 cleanup_module-callr
8.324171746 #1 12980:instr:dup patch: ffffffffa0148a77 cleanup_module-callr
8.334871615 #1 12980:instr:dup patch: ffffffffa0332b94 cleanup_module-callr
8.342857360 #1 12980:instr:dup patch: ffffffffa026bfe7 cleanup_module-callr
8.357780451 #1 12980:instr:dup patch: ffffffffa03fdd04 cleanup_module-callr
8.441065855 #1 12980:instr:dup patch: ffffffffa02f738c cleanup_module-callr
8.607226292 #1 12980:instr:dup patch: ffffffffa0229b3c cleanup_module-callr
8.878946655 #0 12980:instr:dup patch: ffffffffa01990cb cleanup_module-callr
8.934006308 #0 12980:instr:dup patch: ffffffffa013711d cleanup_module-je
8.936023649 #0 12980:instr:dup patch: ffffffffa00e2ef3 cleanup_module-callr
8.956808890 #0 12980:instr:dup patch: ffffffffa0124bcb cleanup_module-callr
8.965560739 #0 12980:instr:dup patch: ffffffffa00caa85 cleanup_module-callr
8.966575930 #0 12980:instr:dup patch: ffffffffa00dd175 cleanup_module-callr
8.969600160 #0 12980:instr:dup patch: ffffffffa00f6d37 cleanup_module-callr
8.973947114 #0 12980:instr:dup patch: ffffffffa00eb719 cleanup_module-callr
8.980539964 #0 12980:instr:dup patch: ffffffffa00933cb cleanup_module-callr
9.006245018 #0 12980:instr:dup patch: ffffffffa010c72b cleanup_module-callr
9.023352314 #0 12980:instr:dup patch: ffffffffa00bc9b8 cleanup_module-callr
9.032066865 #0 12980:instr:dup patch: ffffffffa00a0a5b cleanup_module-callr
9.033427278 #0 12980:instr:dup patch: ffffffffa0062aa8 cleanup_module-callr
9.034609842 #0 12980:instr:dup patch: ffffffffa00ac43b cleanup_module-callr
9.040308232 #0 12980:instr:dup patch: ffffffffa00d68ae cleanup_module-callr
9.081115639 #0 12980:instr:dup patch: ffffffffa007d578 cleanup_module-callr
9.089234327 #0 12980:instr:dup patch: ffffffffa008b16f cleanup_module-callr
9.093935617 #0 12980:instr:dup patch: ffffffffa0070af4 cleanup_module-callr
9.095509242 #0 12980:instr:dup patch: ffffffffa0050e67 cleanup_module-callr
9.095616695 #0 12980:instr:dup patch: ffffffffa006a04f cleanup_module-callr
9.096148184 #0 12980:instr:dup patch: ffffffffa004b34f cleanup_module-callr
9.099020475 #0 12980:instr:dup patch: ffffffffa001640c cleanup_module-callr
9.102504438 #0 12980:instr:dup patch: ffffffffa005a07a cleanup_module-je
9.111741087 #0 12980:instr:dup patch: ffffffffa003ffef cleanup_module-callr
9.118575414 #0 12980:instr:dup patch: ffffffffa002e5bf cleanup_module-callr
9.141326219 #0 12980:instr:dup patch: ffffffffa0024409 cleanup_module-callr
9.143006787 #0 12980:instr:dup patch: ffffffffa000de2b cleanup_module-callr
9.106097313 #1 12980:fbt:dup patch: ffffffffa0c52d8c cleanup_module
9.135466781 #1 12980:fbt:dup patch: ffffffffa0bb0652 cleanup_module
9.137998903 #1 12980:fbt:dup patch: ffffffffa0b35d8a cleanup_module
9.140477517 #1 12980:fbt:dup patch: ffffffffa0b97106 cleanup_module
9.144919585 #1 12980:fbt:dup patch: ffffffffa0b8582e cleanup_module
9.148677043 #1 12980:fbt:dup patch: ffffffffa0b3f10b cleanup_module
9.152261158 #1 12980:fbt:dup patch: ffffffffa0b2acfd cleanup_module
9.156506112 #1 12980:fbt:dup patch: ffffffffa0a05535 cleanup_module
9.164914426 #1 12980:fbt:dup patch: ffffffffa0b7217b cleanup_module
9.210732704 #1 12980:fbt:dup patch: ffffffffa0abff27 cleanup_module
9.230181524 #1 12980:fbt:dup patch: ffffffffa09e4081 cleanup_module
9.242143160 #1 12980:fbt:dup patch: ffffffffa0a34ec1 cleanup_module
9.252854382 #1 12980:fbt:dup patch: ffffffffa09fca63 cleanup_module
9.254712399 #1 12980:fbt:dup patch: ffffffffa09df035 cleanup_module
9.255461351 #1 12980:fbt:dup patch: ffffffffa09d6378 cleanup_module
9.256213503 #1 12980:fbt:dup patch: ffffffffa09cc8a7 cleanup_module
9.257392838 #1 12980:fbt:dup patch: ffffffffa09ece91 cleanup_module
9.264122957 #1 12980:fbt:dup patch: ffffffffa098f716 cleanup_module
9.277374908 #1 12980:fbt:dup patch: ffffffffa092fb7a cleanup_module
9.279910928 #1 12980:fbt:dup patch: ffffffffa09c5d97 cleanup_module
9.294604213 #1 12980:fbt:dup patch: ffffffffa095dcc3 cleanup_module
9.301811108 #1 12980:fbt:dup patch: ffffffffa0928471 cleanup_module
9.302479986 #1 12980:fbt:dup patch: ffffffffa0921069 cleanup_module
9.302600529 #1 12980:fbt:dup patch: ffffffffa091b255 cleanup_module
9.302790709 #1 12980:fbt:dup patch: ffffffffa091659a cleanup_module
9.303554485 #1 12980:fbt:dup patch: ffffffffa03e3e7f cleanup_module
9.303621006 #1 12980:fbt:dup patch: ffffffffa03de152 cleanup_module
9.303916079 #1 12980:fbt:dup patch: ffffffffa03d9836 cleanup_module
9.304498495 #1 12980:fbt:dup patch: ffffffffa03d321b cleanup_module
9.307814640 #1 12980:fbt:dup patch: ffffffffa0908ab4 cleanup_module
9.311298668 #1 12980:fbt:dup patch: ffffffffa03c2478 cleanup_module
9.311922877 #1 12980:fbt:dup patch: ffffffffa03ca721 cleanup_module
9.317962254 #1 12980:fbt:dup patch: ffffffffa03b37c7 cleanup_module
9.320822230 #1 12980:fbt:dup patch: ffffffffa02b8771 cleanup_module
9.321119238 #1 12980:fbt:dup patch: ffffffffa02ae26a cleanup_module
9.321683851 #1 12980:fbt:dup patch: ffffffffa0278253 cleanup_module
9.325593929 #1 12980:fbt:dup patch: ffffffffa039b805 cleanup_module
9.334079576 #1 12980:fbt:dup patch: ffffffffa037e11c cleanup_module
9.336647163 #1 12980:fbt:dup patch: ffffffffa00f11f2 cleanup_module
9.343316618 #1 12980:fbt:dup patch: ffffffffa043fa90 __disable_HDP_cache_r6xx
9.343324356 #1 12980:fbt:dup patch: ffffffffa043faa0 __restore_HDP_cache_r6xx
9.382904134 #1 12980:fbt:dup patch: ffffffffa04e8090 _ZN8GartPcie12flushGartTLBEv
9.383171086 #1 12980:fbt:dup patch: ffffffffa048c330 PostCharOutput
9.383584129 #1 12980:fbt:dup patch: ffffffffa047e770 DummyCailCheckDsmuSupport
9.386062968 #1 12980:fbt:dup patch: ffffffffa0447f70 firegl_cmmqs_powerdown
9.386158732 #1 12980:fbt:dup patch: ffffffffa04b8e00 _ZN18asic_configurationD1Ev
9.386619002 #1 12980:fbt:dup patch: ffffffffa047e320 DummyCailCheckMemoryConfiguration
9.389599347 #1 12980:fbt:dup patch: ffffffffa04952a0 _ZN11PasIDHelperD1Ev
9.390453591 #1 12980:fbt:dup patch: ffffffffa04e5d30 _ZN7GartAgp23InitializeGartRegistersEv
9.390787994 #1 12980:fbt:dup patch: ffffffffa04e6920 _ZN7GartPci11DisableGartEv
9.392021162 #1 12980:fbt:dup patch: ffffffffa047e750 DummyCailWriteMmPciConfigRegister
9.392496907 #1 12980:fbt:dup patch: ffffffffa04a46c0 _ZN23CMMHeap_SHARED_PAGEABLE16dropPoolFromHeapEP7CMMPool
9.393039018 #1 12980:fbt:dup patch: ffffffffa04e83d0 _ZN12GartPcieR30019ProgramPcieGartBaseEv
9.393928929 #1 12980:fbt:dup patch: ffffffffa04e0020 _ZdlPv
9.399515048 #1 12980:fbt:dup patch: ffffffffa047e3d0 DummyCailAsicState
9.400571101 #1 12980:fbt:dup patch: ffffffffa04efd30 R6XX_SetAllClockGating
9.403609345 #1 12980:fbt:dup patch: ffffffffa0580f60 _ZN10APLBinFileD2Ev
9.404744081 #1 12980:fbt:dup patch: ffffffffa048f0a0 CMMQS_PowerUp
9.405209255 #1 12980:fbt:dup patch: ffffffffa04e75b0 _ZN8GartPcie19ProgramPcieGartBaseEv
9.506582365 #0 12980:fbt:dup patch: ffffffffa048c340 CallerDebugFunc
9.509334109 #0 12980:fbt:dup patch: ffffffffa04d7b50 UVDFWLib_GetFW
9.509909555 #0 12980:fbt:dup patch: ffffffffa0450f80 vGetRegulation
9.511660531 #0 12980:fbt:dup patch: ffffffffa04dbc00 _ZN9AsicRV77018submit_PAINT_MULTIERN4Asic19_PAINT_MULTI_PARAMSE
9.512916719 #0 12980:fbt:dup patch: ffffffffa04c2f40 _ZN6AsicCI20registerRingLocationEv
9.513072389 #0 12980:fbt:dup patch: ffffffffa0495290 _ZN11PasIDHelperD2Ev
9.516381286 #0 12980:fbt:dup patch: ffffffffa04bbe20 _ZN7PM4Ring26freeScratchWritebackMemoryEv
9.516432686 #0 12980:fbt:dup patch: ffffffffa04acb00 _ZN4Asic18startVPURProcedureEv
9.516857676 #0 12980:fbt:dup patch: ffffffffa04e6930 _ZN7GartPci12flushGartTLBEv
9.519096201 #0 12980:fbt:dup patch: ffffffffa047e5c0 DummyCailWriteSamSabIndirectRegister
9.520894467 #0 12980:fbt:dup patch: ffffffffa04acc60 _ZN4Asic9WaitUntil22passDumpDataToMiniportEv
9.520902461 #0 12980:fbt:dup patch: ffffffffa04f8aa0 IRQMGR_WriteRegister_Dummy
9.521601320 #0 12980:fbt:dup patch: ffffffffa0450cd0 CAIL_AsicShutDown
9.530353211 #0 12980:fbt:dup patch: ffffffffa04b6580 _ZN18CMMApertureManager27reserveAperturesIfNecessaryEv
9.531119745 #0 12980:fbt:dup patch: ffffffffa048c680 usleep
9.536573202 #0 12980:fbt:dup patch: ffffffffa04b8df0 _ZN18asic_configurationD2Ev
9.537246796 #0 12980:fbt:dup patch: ffffffffa049bdb0 _ZN2OS11shareMemoryEPvP6CMMMapP38_VIDEO_ATI_SHARE_MEMORY_INFORMATION_WA
9.538023720 #0 12980:fbt:dup patch: ffffffffa04e3750 _ZN7GpsBase13ULPS_WriteRegEjj
9.540924757 #0 12980:fbt:dup patch: ffffffffa047e6a0 DummyCailGetPowerControlRegisterTable
9.549279261 #0 12980:fbt:dup patch: ffffffffa04d7b40 UVDFWLib_GetFW_Ex
9.552684333 #0 12980:fbt:dup patch: ffffffffa047e730 DummyCailSelectSeSh
9.554667258 #0 12980:fbt:dup patch: ffffffffa041cda0 __cxa_pure_virtual
9.565315970 #0 12980:fbt:dup patch: ffffffffa047e2c0 DummyCailSetIndRegSmc
9.565723327 #0 12980:fbt:dup patch: ffffffffa04e75d0 _ZN8GartPcie10EnableGartEv
9.565973366 #0 12980:fbt:dup patch: ffffffffa04e75e0 _ZN8GartPcie11DisableGartEv
9.566837639 #0 12980:fbt:dup patch: ffffffffa04d8b70 _ZN8AsicR60013loadMicrocodeEPjPKcS0_S2_
9.567066289 #0 12980:fbt:dup patch: ffffffffa04e6900 _ZN7GartPci23InitializeGartRegistersEv
9.567227966 #0 12980:fbt:dup patch: ffffffffa048f090 CMMQS_PowerDown
9.568104697 #0 12980:fbt:dup patch: ffffffffa048c470 WriteSysIOReg8
9.569073621 #0 12980:fbt:dup patch: ffffffffa04e9840 _ZN10GartCayman22InitExternalSemaphoresEv
9.571498165 #0 12980:fbt:dup patch: ffffffffa047e350 DummyCailMemoryConfigAndSize
9.574120182 #0 12980:fbt:dup patch: ffffffffa0452310 CailWriteMC
9.575423788 #0 12980:fbt:dup patch: ffffffffa05423a0 PhwTrinity_ReleaseMutex
9.575764905 #0 12980:fbt:dup patch: ffffffffa04ad580 _ZN4Asic15ElapsedTS_Sleep5delayEv
9.576490289 #0 12980:fbt:dup patch: ffffffffa04b4e80 _ZN8mmEngine14insertSubmitIBERPjP12QS_MMIBUFFERj
9.580616637 #0 12980:fbt:dup patch: ffffffffa04eab00 _ZN13GartVmptRv77023UpdateInvalidationRangeE9_GPS_HEAPmm
9.582115265 #0 12980:fbt:dup patch: ffffffffa047e5e0 DummyCailWriteSamIndirectRegister
9.585679284 #0 12980:fbt:dup patch: ffffffffa049bdc0 _ZN2OS13unshareMemoryEP6CMMMap
9.585805406 #0 12980:fbt:dup patch: ffffffffa04dba20 _ZN9AsicRV77013loadMicrocodeEv
9.590684033 #0 12980:fbt:dup patch: ffffffffa04c3620 _ZN6AsicCI17initRingsPriorityEv
9.591773979 #0 12980:fbt:dup patch: ffffffffa0489290 cmdNOP_
9.500375224 #1 12980:fbt:dup patch: ffffffffa048c520 WriteRegIO
9.501290105 #1 12980:fbt:dup patch: ffffffffa047e310 DummyCailUpdateSwConstantForHwConfig
9.502194529 #1 12980:fbt:dup patch: ffffffffa0421de0 firegl_pm_save_onchip_ram
9.503177429 #1 12980:fbt:dup patch: ffffffffa047e5a0 DummyCailExecuteDmaCopy
9.505224966 #1 12980:fbt:dup patch: ffffffffa04fcb40 SPECTRE_Enable_CP_ECC_Err_Int
9.505532931 #1 12980:fbt:dup patch: ffffffffa04efd20 R6XX_SetClockGating
9.506351539 #1 12980:fbt:dup patch: ffffffffa047e430 DummyCailTdrEnd
9.507260291 #1 12980:fbt:dup patch: ffffffffa04e75c0 _ZN8GartPcie23InitializeGartRegistersEv
9.509960992 #1 12980:fbt:dup patch: ffffffffa04deb50 _ZN9AsicRV63013loadMicrocodeEv
9.512341082 #1 12980:fbt:dup patch: ffffffffa04d8b60 _ZN8AsicR60013loadMicrocodeEv
9.512561980 #1 12980:fbt:dup patch: ffffffffa048c490 WriteSysIOReg32
9.515594470 #1 12980:fbt:dup patch: ffffffffa04522f0 CailWritePLL
9.516311447 #1 12980:fbt:dup patch: ffffffffa0487d20 IndirectIOCommand
9.520498507 #1 12980:fbt:dup patch: ffffffffa04e6910 _ZN7GartPci10EnableGartEv
9.521754770 #1 12980:fbt:dup patch: ffffffffa04f0190 R6XX_EnableVMCInterrupt
9.522448183 #1 12980:fbt:dup patch: ffffffffa0583b47 cleanup_module
9.524926464 #1 12980:fbt:dup patch: ffffffffa0580f70 _ZN10APLBinFileD1Ev
9.532883473 #1 12980:fbt:dup patch: ffffffffa04fb940 BONAIRE_Enable_CP_ECC_Err_Int
9.533043472 #1 12980:fbt:dup patch: ffffffffa047e710 DummyCailSetIndRegPcie
9.540605021 #1 12980:fbt:dup patch: ffffffffa049be90 _ZN2OS15program_Gart_PTEP4AsicP23_CMM_PROGRAM_GART_PT_WA
9.543031362 #1 12980:fbt:dup patch: ffffffffa0447f80 firegl_cmmqs_powerup
9.546016343 #1 12980:fbt:dup patch: ffffffffa04c0800 _ZN11AsicCypress18submit_PAINT_MULTIERN4Asic19_PAINT_MULTI_PARAMSE
9.550340845 #1 12980:fbt:dup patch: ffffffffa04a2500 _ZN14CMMHeapManager14programGart_PTEv
9.551540996 #1 12980:fbt:dup patch: ffffffffa048c480 WriteSysIOReg16
9.556120163 #1 12980:fbt:dup patch: ffffffffa0421df0 firegl_pm_restore_onchip_ram
9.557409312 #1 12980:fbt:dup patch: ffffffffa04acb40 _ZN4Asic9WaitUntil5delayEv
9.559379060 #1 12980:fbt:dup patch: ffffffffa00a69d9 cleanup_module
9.562233847 #1 12980:fbt:dup patch: ffffffffa0363445 cleanup_module
9.566158008 #1 12980:fbt:dup patch: ffffffffa0351ead cleanup_module
9.572419168 #1 12980:fbt:dup patch: ffffffffa0148a7d cleanup_module
9.576153503 #1 12980:fbt:dup patch: ffffffffa0332b9a cleanup_module
9.578568852 #1 12980:fbt:dup patch: ffffffffa026bfed cleanup_module
9.583551297 #1 12980:fbt:dup patch: ffffffffa03fdd0f cleanup_module
9.608064967 #1 12980:fbt:dup patch: ffffffffa02f7392 cleanup_module
9.655918887 #1 12980:fbt:dup patch: ffffffffa0229b64 cleanup_module
9.694543292 #1 12980:fbt:dup patch: ffffffffa0199104 cleanup_module
9.706866791 #1 12980:fbt:dup patch: ffffffffa0137236 cleanup_module
9.707426463 #1 12980:fbt:dup patch: ffffffffa00e2f11 cleanup_module
9.712312310 #1 12980:fbt:dup patch: ffffffffa0124be9 cleanup_module
9.714980636 #1 12980:fbt:dup patch: ffffffffa00caa97 cleanup_module
9.715291454 #1 12980:fbt:dup patch: ffffffffa00dd19a cleanup_module
9.716099512 #1 12980:fbt:dup patch: ffffffffa00f6d3d cleanup_module
9.716407344 #1 12980:fbt:dup patch: ffffffffa00c5b5d cleanup_module
9.717581696 #1 12980:fbt:dup patch: ffffffffa00eb7ad cleanup_module
9.719017816 #1 12980:fbt:dup patch: ffffffffa00933dd cleanup_module
9.725642770 #1 12980:fbt:dup patch: ffffffffa010c73d cleanup_module
9.729792140 #1 12980:fbt:dup patch: ffffffffa00bc9d2 cleanup_module
9.732127609 #1 12980:fbt:dup patch: ffffffffa00a0a61 cleanup_module
9.732480115 #1 12980:fbt:dup patch: ffffffffa0062ad2 cleanup_module
9.732784152 #1 12980:fbt:dup patch: ffffffffa00ac441 cleanup_module
9.734139147 #1 12980:fbt:dup patch: ffffffffa00d68e8 cleanup_module
9.737675089 #1 12980:fbt:dup patch: ffffffffa007d597 cleanup_module
9.740041463 #1 12980:fbt:dup patch: ffffffffa008b21f cleanup_module
9.741157494 #1 12980:fbt:dup patch: ffffffffa0070afa cleanup_module
9.741641453 #1 12980:fbt:dup patch: ffffffffa0050e6d cleanup_module
9.741697681 #1 12980:fbt:dup patch: ffffffffa006a055 cleanup_module
9.741852764 #1 12980:fbt:dup patch: ffffffffa004b363 cleanup_module
9.742582832 #1 12980:fbt:dup patch: ffffffffa0016471 cleanup_module
9.743655276 #1 12980:fbt:dup patch: ffffffffa005a091 cleanup_module
9.746075696 #1 12980:fbt:dup patch: ffffffffa003fff5 cleanup_module
9.748119540 #1 12980:fbt:dup patch: ffffffffa002e5c5 cleanup_module
9.749709221 #1 12980:fbt:dup patch: ffffffffa0037961 cleanup_module
9.755098538 #1 12980:fbt:dup patch: ffffffffa002440f cleanup_module
9.755522279 #1 12980:fbt:dup patch: ffffffffa000de31 cleanup_module
9.786567716 #1 12980:dtrace_linux.c:get_proc_addr: Failed to find 'sys32_clone' (warn=5)
9.817649455 #1 12980:dtrace_linux.c:get_proc_addr: Failed to find 'sys32_execve' (warn=6)
9.886132706 #1 12980:vmem_create(dtrace_aggid_0) ffff880069c828a0
14.663829733 #1 12980:teardown start xcalls=19 probes=0
14.663836333 #1 12980:teardown done 0.000007096 xcalls=20 probes=0
14.831221752 #0 12986:vmem_create(dtrace_aggid_0) ffff8801142b0ae0
14.776702330 #1 12986:teardown start xcalls=21 probes=0
14.776709431 #1 12986:teardown done 0.000007286 xcalls=22 probes=0
19.990378173 #1 13025:vmem_create(dtrace_aggid_0) ffff880069c82960
61.781674923 #1 13025:[cpu1] dtrace_linux_panic called. Dumping cpu stacks
61.782270332 #1 13025:dtrace_linux_panic: finished
61.879145484 #0 3673-This is CPU#0
62.855334789 #0 13025:teardown start xcalls=149 probes=1
62.855344553 #0 13025:kmem_free t=0.000000777 (1)
62.855355065 #0 13025:teardown done 0.000020447 xcalls=149 probes=0
dtrace4linux commented 11 years ago

is this a VM? Is there anything in /var/log/kern.log or dmesg output? Does VM have enough memory?

tx

On 4 August 2013 13:10, Michael Mior notifications@github.com wrote:

Ubuntu 13.04 with kernel version 3.8.0-27. Here's the entirety of /proc/dtrace/trace after the failure.

1 12968:4dtracedrv loaded: /dev/dtrace available, dtrace_here=0 nr_cpus=2

1 12968:vmem_create(dtrace) ffff88004cde8900

1 12968:vmem_create(dtrace_minor) ffff88004cde8960

1 12968:**alloc_workqueue_key_ptr=ffffffff810783a0

1 12968:dtrace_linux.c:get_proc_addr: Failed to find 'lockdep_init_map' (warn=1)

1 12968:queue_delayed_work_ptr=ffffffff81077900

1 12968:destroy_workqueue_ptr=ffffffff81076320

1 12968:flush_workqueue_ptr=ffffffff81075da0

1 12968:delayed_work_timer_fn_ptr=ffffffff810774e0

1 12968:ctf loaded: /dev/ctf now available

1 12958:dtrace_linux.c:get_proc_addr: Failed to find 'sysrq_showregs_othercpus' (warn=2)

1 12958:dtrace_linux.c:get_proc_addr: Failed to find 'xtime_cache' (warn=3)

0.000000000 #1 12958:xen: [0] bind_virq ret==0 port=0 0.000002858 #1 12958:xen: [0] bind_ipi=0 0.000004188 #1 12958:xen: [1] bind_virq ret==0 port=0 0.000005574 #1 12958:xen: [1] bind_ipi=0 0.001314014 #1 12958:profile loaded: /dev/dtrace_profile available 0.136283220 #1 12958:dtrace_linux.c:get_proc_addr: Failed to find 'tcp_event_data_sent' (warn=4) 0.136287813 #1 12958:prcom_add_function: cannot locate 'tcp_event_data_sent' 1.088842807 #0 12958:dcpc.c:dcpc_attach:1333: TODO:please fill me in 1.088847093 #0 12958:dcpc initialised. 1.089278222 #0 12958:sdt loaded: /dev/sdt now available 1.091914689 #0 12958:ctl loaded: /dev/dtrace_ctl now available 1.097804834 #0 12958:dtrace_function_size: do_sync_read ffffffff81193fd0 size=224 1.097812108 #0 12958:io_prov_entry called io:start 1.098215362 #0 12958:io_prov_return called io:start ffffffff8119409f sz=1 1.101245041 #0 12958:dtrace_function_size: do_sync_write ffffffff81193ef0 size=224 1.101248014 #0 12958:io_prov_entry called io:start 1.101276422 #0 12958:io_prov_return called io:start ffffffff81193fbf sz=1 1.360980642 #1 12980:fbt:dup patch: ffffffff8100a499 xen_irq_enable_direct_end 1.361006305 #1 12980:fbt:dup patch: ffffffff8100a4a9 xen_irq_disable_direct_end 1.361031957 #1 12980:fbt:dup patch: ffffffff8100a4be xen_save_fl_direct_end 1.361069309 #1 12980:fbt:dup patch: ffffffff8100a4df xen_restore_fl_direct_end 2.455165276 #1 12980:fbt:dup patch: ffffffff816cd411 error_sti 2.460374783 #1 12980:fbt:dup patch: ffffffff816d4dc0 fentry** 2.460425626 #1 12980:fbt:dup patch: ffffffff816d4e6f ftrace_stub 6.267022726 #1 12980:initting a mutex 6.434220237 #1 12980:instr:dup patch: ffffffffa0c52d4d cleanup_module-callr 6.670963234 #1 12980:instr:dup patch: ffffffffa0bb063b cleanup_module-callr 6.678871966 #1 12980:instr:dup patch: ffffffffa0b35d73 cleanup_module-callr 6.688002243 #1 12980:instr:dup patch: ffffffffa0b970ef cleanup_module-callr 6.704034714 #1 12980:instr:dup patch: ffffffffa0b85817 cleanup_module-callr 6.717515991 #1 12980:instr:dup patch: ffffffffa0b3f0f4 cleanup_module-callr 6.730365385 #1 12980:instr:dup patch: ffffffffa0b2acb6 cleanup_module-callr 6.742566948 #1 12980:instr:dup patch: ffffffffa0a0552f cleanup_module-callr 6.885511551 #0 12980:instr:dup patch: ffffffffa0b7211b cleanup_module-callr 7.030017143 #0 12980:instr:dup patch: ffffffffa0abfef2 cleanup_module-callr 7.102769964 #0 12980:instr:dup patch: ffffffffa09e407b cleanup_module-callr 7.141124926 #0 12980:instr:dup patch: ffffffffa0a34eaa cleanup_module-callr 7.085577036 #1 12980:instr:dup patch: ffffffffa09fca47 cleanup_module-callr 7.092614582 #1 12980:instr:dup patch: ffffffffa09df02f cleanup_module-callr 7.095375114 #1 12980:instr:dup patch: ffffffffa09d631c cleanup_module-callr 7.098323037 #1 12980:instr:dup patch: ffffffffa09cc87c cleanup_module-callr 7.102509227 #1 12980:instr:dup patch: ffffffffa09ece73 cleanup_module-callr 7.125069960 #1 12980:instr:dup patch: ffffffffa098f6e7 cleanup_module-callr 7.163923712 #1 12980:instr:dup patch: ffffffffa092fb74 cleanup_module-callr 7.173088399 #1 12980:instr:dup patch: ffffffffa09c5d6f cleanup_module-callr 7.225475712 #1 12980:instr:dup patch: ffffffffa095dca4 cleanup_module-callr 7.475371598 #0 12980:instr:dup patch: ffffffffa0928404 cleanup_module-je 7.477407747 #0 12980:instr:dup patch: ffffffffa092103f cleanup_module-callr 7.477643914 #0 12980:instr:dup patch: ffffffffa091b237 cleanup_module-callr 7.478290200 #0 12980:instr:dup patch: ffffffffa0916588 cleanup_module-callr 7.479999754 #0 12980:instr:dup patch: ffffffffa03e3e50 cleanup_module-callr 7.480178341 #0 12980:instr:dup patch: ffffffffa03de14c cleanup_module-callr 7.480826625 #0 12980:instr:dup patch: ffffffffa03d981f cleanup_module-callr 7.482291646 #0 12980:instr:dup patch: ffffffffa03d31aa cleanup_module-callr 7.397843619 #1 12980:instr:dup patch: ffffffffa0908aa9 cleanup_module-callr 7.515301585 #0 12980:instr:dup patch: ffffffffa03c2444 cleanup_module-callr 7.521250046 #0 12980:instr:dup patch: ffffffffa03ca70f cleanup_module-callr 7.447831467 #1 12980:instr:dup patch: ffffffffa03b3783 cleanup_module-callr 7.457407685 #1 12980:instr:dup patch: ffffffffa02b875f cleanup_module-callr 7.458480079 #1 12980:instr:dup patch: ffffffffa02ae258 cleanup_module-callr 7.460200768 #1 12980:instr:dup patch: ffffffffa0278241 cleanup_module-callr 7.473371185 #1 12980:instr:dup patch: ffffffffa039b7fa cleanup_module-callr 7.500699021 #1 12980:instr:dup patch: ffffffffa037e107 cleanup_module-callr 7.507416400 #1 12980:instr:dup patch: ffffffffa00f11ec cleanup_module-callr 8.160198833 #1 12980:instr:dup patch: ffffffffa0583a23 cleanup_module-callr 8.283659225 #1 12980:instr:dup patch: ffffffffa00a69d3 cleanup_module-callr 8.292324332 #1 12980:instr:dup patch: ffffffffa036343f cleanup_module-callr 8.304797930 #1 12980:instr:dup patch: ffffffffa0351ea7 cleanup_module-callr 8.324171746 #1 12980:instr:dup patch: ffffffffa0148a77 cleanup_module-callr 8.334871615 #1 12980:instr:dup patch: ffffffffa0332b94 cleanup_module-callr 8.342857360 #1 12980:instr:dup patch: ffffffffa026bfe7 cleanup_module-callr 8.357780451 #1 12980:instr:dup patch: ffffffffa03fdd04 cleanup_module-callr 8.441065855 #1 12980:instr:dup patch: ffffffffa02f738c cleanup_module-callr 8.607226292 #1 12980:instr:dup patch: ffffffffa0229b3c cleanup_module-callr 8.878946655 #0 12980:instr:dup patch: ffffffffa01990cb cleanup_module-callr 8.934006308 #0 12980:instr:dup patch: ffffffffa013711d cleanup_module-je 8.936023649 #0 12980:instr:dup patch: ffffffffa00e2ef3 cleanup_module-callr 8.956808890 #0 12980:instr:dup patch: ffffffffa0124bcb cleanup_module-callr 8.965560739 #0 12980:instr:dup patch: ffffffffa00caa85 cleanup_module-callr 8.966575930 #0 12980:instr:dup patch: ffffffffa00dd175 cleanup_module-callr 8.969600160 #0 12980:instr:dup patch: ffffffffa00f6d37 cleanup_module-callr 8.973947114 #0 12980:instr:dup patch: ffffffffa00eb719 cleanup_module-callr 8.980539964 #0 12980:instr:dup patch: ffffffffa00933cb cleanup_module-callr 9.006245018 #0 12980:instr:dup patch: ffffffffa010c72b cleanup_module-callr 9.023352314 #0 12980:instr:dup patch: ffffffffa00bc9b8 cleanup_module-callr 9.032066865 #0 12980:instr:dup patch: ffffffffa00a0a5b cleanup_module-callr 9.033427278 #0 12980:instr:dup patch: ffffffffa0062aa8 cleanup_module-callr 9.034609842 #0 12980:instr:dup patch: ffffffffa00ac43b cleanup_module-callr 9.040308232 #0 12980:instr:dup patch: ffffffffa00d68ae cleanup_module-callr 9.081115639 #0 12980:instr:dup patch: ffffffffa007d578 cleanup_module-callr 9.089234327 #0 12980:instr:dup patch: ffffffffa008b16f cleanup_module-callr 9.093935617 #0 12980:instr:dup patch: ffffffffa0070af4 cleanup_module-callr 9.095509242 #0 12980:instr:dup patch: ffffffffa0050e67 cleanup_module-callr 9.095616695 #0 12980:instr:dup patch: ffffffffa006a04f cleanup_module-callr 9.096148184 #0 12980:instr:dup patch: ffffffffa004b34f cleanup_module-callr 9.099020475 #0 12980:instr:dup patch: ffffffffa001640c cleanup_module-callr 9.102504438 #0 12980:instr:dup patch: ffffffffa005a07a cleanup_module-je 9.111741087 #0 12980:instr:dup patch: ffffffffa003ffef cleanup_module-callr 9.118575414 #0 12980:instr:dup patch: ffffffffa002e5bf cleanup_module-callr 9.141326219 #0 12980:instr:dup patch: ffffffffa0024409 cleanup_module-callr 9.143006787 #0 12980:instr:dup patch: ffffffffa000de2b cleanup_module-callr 9.106097313 #1 12980:fbt:dup patch: ffffffffa0c52d8c cleanup_module 9.135466781 #1 12980:fbt:dup patch: ffffffffa0bb0652 cleanup_module 9.137998903 #1 12980:fbt:dup patch: ffffffffa0b35d8a cleanup_module 9.140477517 #1 12980:fbt:dup patch: ffffffffa0b97106 cleanup_module 9.144919585 #1 12980:fbt:dup patch: ffffffffa0b8582e cleanup_module 9.148677043 #1 12980:fbt:dup patch: ffffffffa0b3f10b cleanup_module 9.152261158 #1 12980:fbt:dup patch: ffffffffa0b2acfd cleanup_module 9.156506112 #1 12980:fbt:dup patch: ffffffffa0a05535 cleanup_module 9.164914426 #1 12980:fbt:dup patch: ffffffffa0b7217b cleanup_module 9.210732704 #1 12980:fbt:dup patch: ffffffffa0abff27 cleanup_module 9.230181524 #1 12980:fbt:dup patch: ffffffffa09e4081 cleanup_module 9.242143160 #1 12980:fbt:dup patch: ffffffffa0a34ec1 cleanup_module 9.252854382 #1 12980:fbt:dup patch: ffffffffa09fca63 cleanup_module 9.254712399 #1 12980:fbt:dup patch: ffffffffa09df035 cleanup_module 9.255461351 #1 12980:fbt:dup patch: ffffffffa09d6378 cleanup_module 9.256213503 #1 12980:fbt:dup patch: ffffffffa09cc8a7 cleanup_module 9.257392838 #1 12980:fbt:dup patch: ffffffffa09ece91 cleanup_module 9.264122957 #1 12980:fbt:dup patch: ffffffffa098f716 cleanup_module 9.277374908 #1 12980:fbt:dup patch: ffffffffa092fb7a cleanup_module 9.279910928 #1 12980:fbt:dup patch: ffffffffa09c5d97 cleanup_module 9.294604213 #1 12980:fbt:dup patch: ffffffffa095dcc3 cleanup_module 9.301811108 #1 12980:fbt:dup patch: ffffffffa0928471 cleanup_module 9.302479986 #1 12980:fbt:dup patch: ffffffffa0921069 cleanup_module 9.302600529 #1 12980:fbt:dup patch: ffffffffa091b255 cleanup_module 9.302790709 #1 12980:fbt:dup patch: ffffffffa091659a cleanup_module 9.303554485 #1 12980:fbt:dup patch: ffffffffa03e3e7f cleanup_module 9.303621006 #1 12980:fbt:dup patch: ffffffffa03de152 cleanup_module 9.303916079 #1 12980:fbt:dup patch: ffffffffa03d9836 cleanup_module 9.304498495 #1 12980:fbt:dup patch: ffffffffa03d321b cleanup_module 9.307814640 #1 12980:fbt:dup patch: ffffffffa0908ab4 cleanup_module 9.311298668 #1 12980:fbt:dup patch: ffffffffa03c2478 cleanup_module 9.311922877 #1 12980:fbt:dup patch: ffffffffa03ca721 cleanup_module 9.317962254 #1 12980:fbt:dup patch: ffffffffa03b37c7 cleanup_module 9.320822230 #1 12980:fbt:dup patch: ffffffffa02b8771 cleanup_module 9.321119238 #1 12980:fbt:dup patch: ffffffffa02ae26a cleanup_module 9.321683851 #1 12980:fbt:dup patch: ffffffffa0278253 cleanup_module 9.325593929 #1 12980:fbt:dup patch: ffffffffa039b805 cleanup_module 9.334079576 #1 12980:fbt:dup patch: ffffffffa037e11c cleanup_module 9.336647163 #1 12980:fbt:dup patch: ffffffffa00f11f2 cleanup_module 9.343316618 #1 12980:fbt:dup patch: ffffffffa043fa90 disable_HDP_cache_r6xx 9.343324356 #1 12980:fbt:dup patch: ffffffffa043faa0 restore_HDP_cache_r6xx 9.382904134 #1 12980:fbt:dup patch: ffffffffa04e8090 _ZN8GartPcie12flushGartTLBEv 9.383171086 #1 12980:fbt:dup patch: ffffffffa048c330 PostCharOutput 9.383584129 #1 12980:fbt:dup patch: ffffffffa047e770 DummyCailCheckDsmuSupport 9.386062968 #1 12980:fbt:dup patch: ffffffffa0447f70 firegl_cmmqs_powerdown 9.386158732 #1 12980:fbt:dup patch: ffffffffa04b8e00 _ZN18asic_configurationD1Ev 9.386619002 #1 12980:fbt:dup patch: ffffffffa047e320 DummyCailCheckMemoryConfiguration 9.389599347 #1 12980:fbt:dup patch: ffffffffa04952a0 _ZN11PasIDHelperD1Ev 9.390453591 #1 12980:fbt:dup patch: ffffffffa04e5d30 _ZN7GartAgp23InitializeGartRegistersEv 9.390787994 #1 12980:fbt:dup patch: ffffffffa04e6920 _ZN7GartPci11DisableGartEv 9.392021162 #1 12980:fbt:dup patch: ffffffffa047e750 DummyCailWriteMmPciConfigRegister 9.392496907 #1 12980:fbt:dup patch: ffffffffa04a46c0 _ZN23CMMHeap_SHARED_PAGEABLE16dropPoolFromHeapEP7CMMPool 9.393039018 #1 12980:fbt:dup patch: ffffffffa04e83d0 _ZN12GartPcieR30019ProgramPcieGartBaseEv 9.393928929 #1 12980:fbt:dup patch: ffffffffa04e0020 _ZdlPv 9.399515048 #1 12980:fbt:dup patch: ffffffffa047e3d0 DummyCailAsicState 9.400571101 #1 12980:fbt:dup patch: ffffffffa04efd30 R6XX_SetAllClockGating 9.403609345 #1 12980:fbt:dup patch: ffffffffa0580f60 _ZN10APLBinFileD2Ev 9.404744081 #1 12980:fbt:dup patch: ffffffffa048f0a0 CMMQS_PowerUp 9.405209255 #1 12980:fbt:dup patch: ffffffffa04e75b0 _ZN8GartPcie19ProgramPcieGartBaseEv 9.506582365 #0 12980:fbt:dup patch: ffffffffa048c340 CallerDebugFunc 9.509334109 #0 12980:fbt:dup patch: ffffffffa04d7b50 UVDFWLib_GetFW 9.509909555 #0 12980:fbt:dup patch: ffffffffa0450f80 vGetRegulation 9.511660531 #0 12980:fbt:dup patch: ffffffffa04dbc00 _ZN9AsicRV77018submit_PAINT_MULTIERN4Asic19_PAINT_MULTI_PARAMSE 9.512916719 #0 12980:fbt:dup patch: ffffffffa04c2f40 _ZN6AsicCI20registerRingLocationEv 9.513072389 #0 12980:fbt:dup patch: ffffffffa0495290 _ZN11PasIDHelperD2Ev 9.516381286 #0 12980:fbt:dup patch: ffffffffa04bbe20 _ZN7PM4Ring26freeScratchWritebackMemoryEv 9.516432686 #0 12980:fbt:dup patch: ffffffffa04acb00 _ZN4Asic18startVPURProcedureEv 9.516857676 #0 12980:fbt:dup patch: ffffffffa04e6930 _ZN7GartPci12flushGartTLBEv 9.519096201 #0 12980:fbt:dup patch: ffffffffa047e5c0 DummyCailWriteSamSabIndirectRegister 9.520894467 #0 12980:fbt:dup patch: ffffffffa04acc60 _ZN4Asic9WaitUntil22passDumpDataToMiniportEv 9.520902461 #0 12980:fbt:dup patch: ffffffffa04f8aa0 IRQMGR_WriteRegister_Dummy 9.521601320 #0 12980:fbt:dup patch: ffffffffa0450cd0 CAIL_AsicShutDown 9.530353211 #0 12980:fbt:dup patch: ffffffffa04b6580 _ZN18CMMApertureManager27reserveAperturesIfNecessaryEv 9.531119745 #0 12980:fbt:dup patch: ffffffffa048c680 usleep 9.536573202 #0 12980:fbt:dup patch: ffffffffa04b8df0 _ZN18asic_configurationD2Ev 9.537246796 #0 12980:fbt:dup patch: ffffffffa049bdb0 _ZN2OS11shareMemoryEPvP6CMMMapP38_VIDEO_ATI_SHARE_MEMORY_INFORMATION_WA 9.538023720 #0 12980:fbt:dup patch: ffffffffa04e3750 _ZN7GpsBase13ULPS_WriteRegEjj 9.540924757 #0 12980:fbt:dup patch: ffffffffa047e6a0 DummyCailGetPowerControlRegisterTable 9.549279261 #0 12980:fbt:dup patch: ffffffffa04d7b40 UVDFWLib_GetFW_Ex 9.552684333 #0 12980:fbt:dup patch: ffffffffa047e730 DummyCailSelectSeSh 9.554667258 #0 12980:fbt:dup patch: ffffffffa041cda0 cxa_pure_virtual 9.565315970 #0 12980:fbt:dup patch: ffffffffa047e2c0 DummyCailSetIndRegSmc 9.565723327 #0 12980:fbt:dup patch: ffffffffa04e75d0 _ZN8GartPcie10EnableGartEv 9.565973366 #0 12980:fbt:dup patch: ffffffffa04e75e0 _ZN8GartPcie11DisableGartEv 9.566837639 #0 12980:fbt:dup patch: ffffffffa04d8b70 _ZN8AsicR60013loadMicrocodeEPjPKcS0S2 9.567066289 #0 12980:fbt:dup patch: ffffffffa04e6900 _ZN7GartPci23InitializeGartRegistersEv 9.567227966 #0 12980:fbt:dup patch: ffffffffa048f090 CMMQS_PowerDown 9.568104697 #0 12980:fbt:dup patch: ffffffffa048c470 WriteSysIOReg8 9.569073621 #0 12980:fbt:dup patch: ffffffffa04e9840 _ZN10GartCayman22InitExternalSemaphoresEv 9.571498165 #0 12980:fbt:dup patch: ffffffffa047e350 DummyCailMemoryConfigAndSize 9.574120182 #0 12980:fbt:dup patch: ffffffffa0452310 CailWriteMC 9.575423788 #0 12980:fbt:dup patch: ffffffffa05423a0 PhwTrinity_ReleaseMutex 9.575764905 #0 12980:fbt:dup patch: ffffffffa04ad580 _ZN4Asic15ElapsedTS_Sleep5delayEv 9.576490289 #0 12980:fbt:dup patch: ffffffffa04b4e80 _ZN8mmEngine14insertSubmitIBERPjP12QS_MMIBUFFERj 9.580616637 #0 12980:fbt:dup patch: ffffffffa04eab00 _ZN13GartVmptRv77023UpdateInvalidationRangeE9_GPS_HEAPmm 9.582115265 #0 12980:fbt:dup patch: ffffffffa047e5e0 DummyCailWriteSamIndirectRegister 9.585679284 #0 12980:fbt:dup patch: ffffffffa049bdc0 _ZN2OS13unshareMemoryEP6CMMMap 9.585805406 #0 12980:fbt:dup patch: ffffffffa04dba20 _ZN9AsicRV77013loadMicrocodeEv 9.590684033 #0 12980:fbt:dup patch: ffffffffa04c3620 ZN6AsicCI17initRingsPriorityEv 9.591773979 #0 12980:fbt:dup patch: ffffffffa0489290 cmdNOP 9.500375224 #1 12980:fbt:dup patch: ffffffffa048c520 WriteRegIO 9.501290105 #1 12980:fbt:dup patch: ffffffffa047e310 DummyCailUpdateSwConstantForHwConfig 9.502194529 #1 12980:fbt:dup patch: ffffffffa0421de0 firegl_pm_save_onchip_ram 9.503177429 #1 12980:fbt:dup patch: ffffffffa047e5a0 DummyCailExecuteDmaCopy 9.505224966 #1 12980:fbt:dup patch: ffffffffa04fcb40 SPECTRE_Enable_CP_ECC_Err_Int 9.505532931 #1 12980:fbt:dup patch: ffffffffa04efd20 R6XX_SetClockGating 9.506351539 #1 12980:fbt:dup patch: ffffffffa047e430 DummyCailTdrEnd 9.507260291 #1 12980:fbt:dup patch: ffffffffa04e75c0 _ZN8GartPcie23InitializeGartRegistersEv 9.509960992 #1 12980:fbt:dup patch: ffffffffa04deb50 _ZN9AsicRV63013loadMicrocodeEv 9.512341082 #1 12980:fbt:dup patch: ffffffffa04d8b60 _ZN8AsicR60013loadMicrocodeEv 9.512561980 #1 12980:fbt:dup patch: ffffffffa048c490 WriteSysIOReg32 9.515594470 #1 12980:fbt:dup patch: ffffffffa04522f0 CailWritePLL 9.516311447 #1 12980:fbt:dup patch: ffffffffa0487d20 IndirectIOCommand 9.520498507 #1 12980:fbt:dup patch: ffffffffa04e6910 _ZN7GartPci10EnableGartEv 9.521754770 #1 12980:fbt:dup patch: ffffffffa04f0190 R6XX_EnableVMCInterrupt 9.522448183 #1 12980:fbt:dup patch: ffffffffa0583b47 cleanup_module 9.524926464 #1 12980:fbt:dup patch: ffffffffa0580f70 _ZN10APLBinFileD1Ev 9.532883473 #1 12980:fbt:dup patch: ffffffffa04fb940 BONAIRE_Enable_CP_ECC_Err_Int 9.533043472 #1 12980:fbt:dup patch: ffffffffa047e710 DummyCailSetIndRegPcie 9.540605021 #1 12980:fbt:dup patch: ffffffffa049be90 _ZN2OS15program_Gart_PTEP4AsicP23_CMM_PROGRAM_GART_PT_WA 9.543031362 #1 12980:fbt:dup patch: ffffffffa0447f80 firegl_cmmqs_powerup 9.546016343 #1 12980:fbt:dup patch: ffffffffa04c0800 _ZN11AsicCypress18submit_PAINT_MULTIERN4Asic19_PAINT_MULTI_PARAMSE 9.550340845 #1 12980:fbt:dup patch: ffffffffa04a2500 _ZN14CMMHeapManager14programGart_PTEv 9.551540996 #1 12980:fbt:dup patch: ffffffffa048c480 WriteSysIOReg16 9.556120163 #1 12980:fbt:dup patch: ffffffffa0421df0 firegl_pm_restore_onchip_ram 9.557409312 #1 12980:fbt:dup patch: ffffffffa04acb40 _ZN4Asic9WaitUntil5delayEv 9.559379060 #1 12980:fbt:dup patch: ffffffffa00a69d9 cleanup_module 9.562233847 #1 12980:fbt:dup patch: ffffffffa0363445 cleanup_module 9.566158008 #1 12980:fbt:dup patch: ffffffffa0351ead cleanup_module 9.572419168 #1 12980:fbt:dup patch: ffffffffa0148a7d cleanup_module 9.576153503 #1 12980:fbt:dup patch: ffffffffa0332b9a cleanup_module 9.578568852 #1 12980:fbt:dup patch: ffffffffa026bfed cleanup_module 9.583551297 #1 12980:fbt:dup patch: ffffffffa03fdd0f cleanup_module 9.608064967 #1 12980:fbt:dup patch: ffffffffa02f7392 cleanup_module 9.655918887 #1 12980:fbt:dup patch: ffffffffa0229b64 cleanup_module 9.694543292 #1 12980:fbt:dup patch: ffffffffa0199104 cleanup_module 9.706866791 #1 12980:fbt:dup patch: ffffffffa0137236 cleanup_module 9.707426463 #1 12980:fbt:dup patch: ffffffffa00e2f11 cleanup_module 9.712312310 #1 12980:fbt:dup patch: ffffffffa0124be9 cleanup_module 9.714980636 #1 12980:fbt:dup patch: ffffffffa00caa97 cleanup_module 9.715291454 #1 12980:fbt:dup patch: ffffffffa00dd19a cleanup_module 9.716099512 #1 12980:fbt:dup patch: ffffffffa00f6d3d cleanup_module 9.716407344 #1 12980:fbt:dup patch: ffffffffa00c5b5d cleanup_module 9.717581696 #1 12980:fbt:dup patch: ffffffffa00eb7ad cleanup_module 9.719017816 #1 12980:fbt:dup patch: ffffffffa00933dd cleanup_module 9.725642770 #1 12980:fbt:dup patch: ffffffffa010c73d cleanup_module 9.729792140 #1 12980:fbt:dup patch: ffffffffa00bc9d2 cleanup_module 9.732127609 #1 12980:fbt:dup patch: ffffffffa00a0a61 cleanup_module 9.732480115 #1 12980:fbt:dup patch: ffffffffa0062ad2 cleanup_module 9.732784152 #1 12980:fbt:dup patch: ffffffffa00ac441 cleanup_module 9.734139147 #1 12980:fbt:dup patch: ffffffffa00d68e8 cleanup_module 9.737675089 #1 12980:fbt:dup patch: ffffffffa007d597 cleanup_module 9.740041463 #1 12980:fbt:dup patch: ffffffffa008b21f cleanup_module 9.741157494 #1 12980:fbt:dup patch: ffffffffa0070afa cleanup_module 9.741641453 #1 12980:fbt:dup patch: ffffffffa0050e6d cleanup_module 9.741697681 #1 12980:fbt:dup patch: ffffffffa006a055 cleanup_module 9.741852764 #1 12980:fbt:dup patch: ffffffffa004b363 cleanup_module 9.742582832 #1 12980:fbt:dup patch: ffffffffa0016471 cleanup_module 9.743655276 #1 12980:fbt:dup patch: ffffffffa005a091 cleanup_module 9.746075696 #1 12980:fbt:dup patch: ffffffffa003fff5 cleanup_module 9.748119540 #1 12980:fbt:dup patch: ffffffffa002e5c5 cleanup_module 9.749709221 #1 12980:fbt:dup patch: ffffffffa0037961 cleanup_module 9.755098538 #1 12980:fbt:dup patch: ffffffffa002440f cleanup_module 9.755522279 #1 12980:fbt:dup patch: ffffffffa000de31 cleanup_module 9.786567716 #1 12980:dtrace_linux.c:get_proc_addr: Failed to find 'sys32_clone' (warn=5) 9.817649455 #1 12980:dtrace_linux.c:get_proc_addr: Failed to find 'sys32_execve' (warn=6) 9.886132706 #1 12980:vmem_create(dtrace_aggid_0) ffff880069c828a0 14.663829733 #1 12980:teardown start xcalls=19 probes=0 14.663836333 #1 12980:teardown done 0.000007096 xcalls=20 probes=0 14.831221752 #0 12986:vmem_create(dtrace_aggid_0) ffff8801142b0ae0 14.776702330 #1 12986:teardown start xcalls=21 probes=0 14.776709431 #1 12986:teardown done 0.000007286 xcalls=22 probes=0 19.990378173 #1 13025:vmem_create(dtrace_aggid_0) ffff880069c82960 61.781674923 #1 13025:[cpu1] dtrace_linux_panic called. Dumping cpu stacks 61.782270332 #1 13025:dtrace_linux_panic: finished 61.879145484 #0 3673-This is CPU#0 62.855334789 #0 13025:teardown start xcalls=149 probes=1 62.855344553 #0 13025:kmem_free t=0.000000777 (1) 62.855355065 #0 13025:teardown done 0.000020447 xcalls=149 probes=0

— Reply to this email directly or view it on GitHubhttps://github.com/dtrace4linux/linux/issues/62#issuecomment-22070723 .

michaelmior commented 11 years ago

Nope, not a VM. I get the following in /var/log/kern.log when loading the DTrace module.

Aug  4 20:47:11 mmior-laptop kernel: [203690.336893] Call Trace:
Aug  4 20:47:11 mmior-laptop kernel: [203690.336948]  [<ffffffffa0cb74b6>] mutex_enter_common+0x36/0x130 [dtracedrv]
Aug  4 20:47:11 mmior-laptop kernel: [203690.336987]  [<ffffffffa0cb75cb>] dmutex_enter+0x1b/0x20 [dtracedrv]
Aug  4 20:47:11 mmior-laptop kernel: [203690.337019]  [<ffffffffa0caac8a>] par_alloc+0x2a/0x110 [dtracedrv]
Aug  4 20:47:11 mmior-laptop kernel: [203690.337053]  [<ffffffffa0cb4efe>] instr_provide_module+0x3e/0x240 [dtracedrv]
Aug  4 20:47:11 mmior-laptop kernel: [203690.337088]  [<ffffffffa0cb74e7>] ? mutex_enter_common+0x67/0x130 [dtracedrv]
Aug  4 20:47:11 mmior-laptop kernel: [203690.337116]  [<ffffffffa0c9b600>] dtrace_probe_provide+0x90/0x140 [dtracedrv]
Aug  4 20:47:11 mmior-laptop kernel: [203690.337143]  [<ffffffffa0ca35d5>] dtrace_open+0x65/0x140 [dtracedrv]
Aug  4 20:47:11 mmior-laptop kernel: [203690.337172]  [<ffffffffa0ca8ca1>] dtracedrv_open+0x51/0x60 [dtracedrv]
Aug  4 20:47:11 mmior-laptop kernel: [203690.337182]  [<ffffffff8144083f>] misc_open+0xaf/0x1c0
Aug  4 20:47:11 mmior-laptop kernel: [203690.337192]  [<ffffffff81198c9f>] chrdev_open+0xaf/0x1a0
Aug  4 20:47:11 mmior-laptop kernel: [203690.337199]  [<ffffffff81192853>] do_dentry_open+0x203/0x290
Aug  4 20:47:11 mmior-laptop kernel: [203690.337207]  [<ffffffff81198bf0>] ? cdev_put+0x30/0x30
Aug  4 20:47:11 mmior-laptop kernel: [203690.337214]  [<ffffffff81192929>] vfs_open+0x49/0x50
Aug  4 20:47:11 mmior-laptop kernel: [203690.337221]  [<ffffffff811a14e6>] do_last+0x296/0xea0
Aug  4 20:47:11 mmior-laptop kernel: [203690.337228]  [<ffffffff8119ee38>] ? inode_permission+0x18/0x50
Aug  4 20:47:11 mmior-laptop kernel: [203690.337234]  [<ffffffff811a094b>] ? link_path_walk+0x6b/0x880
Aug  4 20:47:11 mmior-laptop kernel: [203690.337242]  [<ffffffff811a3003>] path_openat+0xb3/0x4b0
Aug  4 20:47:11 mmior-laptop kernel: [203690.337250]  [<ffffffff811a3e01>] do_filp_open+0x41/0xa0
Aug  4 20:47:11 mmior-laptop kernel: [203690.337258]  [<ffffffff811b1589>] ? __alloc_fd+0xd9/0x130
Aug  4 20:47:11 mmior-laptop kernel: [203690.337265]  [<ffffffff81193be3>] do_sys_open+0xf3/0x230
Aug  4 20:47:11 mmior-laptop kernel: [203690.337272]  [<ffffffff81193d41>] sys_open+0x21/0x30
Aug  4 20:47:11 mmior-laptop kernel: [203690.337279]  [<ffffffff816d521d>] system_call_fastpath+0x1a/0x1f

Then I see this when trying to run the test probe

Aug  4 20:47:49 mmior-laptop kernel: [203728.397278] /home/mmior/apps/dtrace4linux/build-3.8.0-27-generic/driver/dtrace.c:dtrace_ioctl:16858: assertion failure buf->dtb_xamot != cached
Aug  4 20:47:49 mmior-laptop kernel: [203728.397893] Pid: 15486, comm: dtrace Tainted: PF         IO 3.8.0-27-generic #40-Ubuntu
Aug  4 20:47:49 mmior-laptop kernel: [203728.397914] Call Trace:
Aug  4 20:47:49 mmior-laptop kernel: [203728.397922] Call Trace:
Aug  4 20:47:49 mmior-laptop kernel: [203728.397965]  <IRQ>  [<ffffffffa0ca9709>] dump_cpu_stack+0x39/0x50 [dtracedrv]
Aug  4 20:47:49 mmior-laptop kernel: [203728.398015]  [<ffffffffa0ca735c>] dtrace_ioctl+0x22dc/0x28a0 [dtracedrv]
Aug  4 20:47:49 mmior-laptop kernel: [203728.398027]  [<ffffffff8109636b>] ? check_preempt_wakeup+0x15b/0x280
Aug  4 20:47:49 mmior-laptop kernel: [203728.398044]  [<ffffffff810ba08e>] generic_smp_call_function_single_interrupt+0xbe/0x120
Aug  4 20:47:49 mmior-laptop kernel: [203728.398055]  [<ffffffff810954ae>] ? dequeue_entity+0x13e/0x4b0
Aug  4 20:47:49 mmior-laptop kernel: [203728.398069]  [<ffffffff81037d07>] smp_call_function_single_interrupt+0x27/0x40
Aug  4 20:47:49 mmior-laptop kernel: [203728.398080]  [<ffffffff8101ba95>] ? native_sched_clock+0x15/0x80
Aug  4 20:47:49 mmior-laptop kernel: [203728.398092]  [<ffffffff816d615d>] call_function_single_interrupt+0x6d/0x80
Aug  4 20:47:49 mmior-laptop kernel: [203728.398103]  [<ffffffff8108bc3a>] ? finish_task_switch+0x4a/0xf0
Aug  4 20:47:49 mmior-laptop kernel: [203728.398111]  <EOI> 
Aug  4 20:47:49 mmior-laptop kernel: [203728.398120]  [<ffffffff816cb326>] ? __schedule+0x3c6/0x7f0
Aug  4 20:47:49 mmior-laptop kernel: [203728.398131]  [<ffffffff81044b49>] ? default_spin_lock_flags+0x9/0x10
Aug  4 20:47:49 mmior-laptop kernel: [203728.398138]  [<ffffffff816ccc7e>] ? _raw_spin_lock_irqsave+0x2e/0x40
Aug  4 20:47:49 mmior-laptop kernel: [203728.398147]  [<ffffffff81081720>] ? lock_hrtimer_base.isra.21+0x30/0x60
Aug  4 20:47:49 mmior-laptop kernel: [203728.398155]  [<ffffffff810819b1>] ? hrtimer_try_to_cancel+0x51/0xe0
Aug  4 20:47:49 mmior-laptop kernel: [203728.398163]  [<ffffffff81081a5a>] ? hrtimer_cancel+0x1a/0x30
Aug  4 20:47:49 mmior-laptop kernel: [203728.398172]  [<ffffffff810b5b59>] ? futex_wait+0x1c9/0x2d0
Aug  4 20:47:49 mmior-laptop kernel: [203728.398180]  [<ffffffff810b55a8>] ? get_futex_key+0x148/0x280
Aug  4 20:47:49 mmior-laptop kernel: [203728.398189]  [<ffffffff816cc97e>] ? _raw_spin_lock+0xe/0x20
Aug  4 20:47:49 mmior-laptop kernel: [203728.398196]  [<ffffffff810b586b>] ? futex_wake+0x10b/0x130
Aug  4 20:47:49 mmior-laptop kernel: [203728.398226]  [<ffffffffa0ca984d>] dtracedrv_ioctl.isra.2+0x5d/0x80 [dtracedrv]
Aug  4 20:47:49 mmior-laptop kernel: [203728.398256]  [<ffffffffa0ca989e>] dtracedrv_unlocked_ioctl+0xe/0x20 [dtracedrv]
Aug  4 20:47:49 mmior-laptop kernel: [203728.398265]  [<ffffffff811a5f19>] do_vfs_ioctl+0x99/0x570
Aug  4 20:47:49 mmior-laptop kernel: [203728.398273]  [<ffffffff8108bc3a>] ? finish_task_switch+0x4a/0xf0
Aug  4 20:47:49 mmior-laptop kernel: [203728.398281]  [<ffffffff811a6481>] sys_ioctl+0x91/0xb0
Aug  4 20:47:49 mmior-laptop kernel: [203728.398288]  [<ffffffff816d521d>] system_call_fastpath+0x1a/0x1
dtrace4linux commented 11 years ago

If this happens, the driver has disabled itself. You can reload the driver ("make load" or tools/load.pl) and try again. I have tried this on a 3.9 kernel and no issues. Am surprised you see it on the ubuntu kernel as i normally test this. Its possible that the build has misdetected something. If its a real cpu, what is this - dual core? Can you send me build/port.h - maybe its misdetected something.

On 4 August 2013 21:35, Paul Fox paul.d.fox@gmail.com wrote:

is this a VM? Is there anything in /var/log/kern.log or dmesg output? Does VM have enough memory?

tx

On 4 August 2013 13:10, Michael Mior notifications@github.com wrote:

Ubuntu 13.04 with kernel version 3.8.0-27. Here's the entirety of /proc/dtrace/trace after the failure.

1 12968:4dtracedrv loaded: /dev/dtrace available, dtrace_here=0 nr_cpus=2

1 12968:vmem_create(dtrace) ffff88004cde8900

1 12968:vmem_create(dtrace_minor) ffff88004cde8960

1 12968:**alloc_workqueue_key_ptr=ffffffff810783a0

1 12968:dtrace_linux.c:get_proc_addr: Failed to find 'lockdep_init_map' (warn=1)

1 12968:queue_delayed_work_ptr=ffffffff81077900

1 12968:destroy_workqueue_ptr=ffffffff81076320

1 12968:flush_workqueue_ptr=ffffffff81075da0

1 12968:delayed_work_timer_fn_ptr=ffffffff810774e0

1 12968:ctf loaded: /dev/ctf now available

1 12958:dtrace_linux.c:get_proc_addr: Failed to find 'sysrq_showregs_othercpus' (warn=2)

1 12958:dtrace_linux.c:get_proc_addr: Failed to find 'xtime_cache' (warn=3)

0.000000000 #1 12958:xen: [0] bind_virq ret==0 port=0 0.000002858 #1 12958:xen: [0] bind_ipi=0 0.000004188 #1 12958:xen: [1] bind_virq ret==0 port=0 0.000005574 #1 12958:xen: [1] bind_ipi=0 0.001314014 #1 12958:profile loaded: /dev/dtrace_profile available 0.136283220 #1 12958:dtrace_linux.c:get_proc_addr: Failed to find 'tcp_event_data_sent' (warn=4) 0.136287813 #1 12958:prcom_add_function: cannot locate 'tcp_event_data_sent' 1.088842807 #0 12958:dcpc.c:dcpc_attach:1333: TODO:please fill me in 1.088847093 #0 12958:dcpc initialised. 1.089278222 #0 12958:sdt loaded: /dev/sdt now available 1.091914689 #0 12958:ctl loaded: /dev/dtrace_ctl now available 1.097804834 #0 12958:dtrace_function_size: do_sync_read ffffffff81193fd0 size=224 1.097812108 #0 12958:io_prov_entry called io:start 1.098215362 #0 12958:io_prov_return called io:start ffffffff8119409f sz=1 1.101245041 #0 12958:dtrace_function_size: do_sync_write ffffffff81193ef0 size=224 1.101248014 #0 12958:io_prov_entry called io:start 1.101276422 #0 12958:io_prov_return called io:start ffffffff81193fbf sz=1 1.360980642 #1 12980:fbt:dup patch: ffffffff8100a499 xen_irq_enable_direct_end 1.361006305 #1 12980:fbt:dup patch: ffffffff8100a4a9 xen_irq_disable_direct_end 1.361031957 #1 12980:fbt:dup patch: ffffffff8100a4be xen_save_fl_direct_end 1.361069309 #1 12980:fbt:dup patch: ffffffff8100a4df xen_restore_fl_direct_end 2.455165276 #1 12980:fbt:dup patch: ffffffff816cd411 error_sti 2.460374783 #1 12980:fbt:dup patch: ffffffff816d4dc0 fentry** 2.460425626 #1 12980:fbt:dup patch: ffffffff816d4e6f ftrace_stub 6.267022726 #1 12980:initting a mutex 6.434220237 #1 12980:instr:dup patch: ffffffffa0c52d4d cleanup_module-callr 6.670963234 #1 12980:instr:dup patch: ffffffffa0bb063b cleanup_module-callr 6.678871966 #1 12980:instr:dup patch: ffffffffa0b35d73 cleanup_module-callr 6.688002243 #1 12980:instr:dup patch: ffffffffa0b970ef cleanup_module-callr 6.704034714 #1 12980:instr:dup patch: ffffffffa0b85817 cleanup_module-callr 6.717515991 #1 12980:instr:dup patch: ffffffffa0b3f0f4 cleanup_module-callr 6.730365385 #1 12980:instr:dup patch: ffffffffa0b2acb6 cleanup_module-callr 6.742566948 #1 12980:instr:dup patch: ffffffffa0a0552f cleanup_module-callr 6.885511551 #0 12980:instr:dup patch: ffffffffa0b7211b cleanup_module-callr 7.030017143 #0 12980:instr:dup patch: ffffffffa0abfef2 cleanup_module-callr 7.102769964 #0 12980:instr:dup patch: ffffffffa09e407b cleanup_module-callr 7.141124926 #0 12980:instr:dup patch: ffffffffa0a34eaa cleanup_module-callr 7.085577036 #1 12980:instr:dup patch: ffffffffa09fca47 cleanup_module-callr 7.092614582 #1 12980:instr:dup patch: ffffffffa09df02f cleanup_module-callr 7.095375114 #1 12980:instr:dup patch: ffffffffa09d631c cleanup_module-callr 7.098323037 #1 12980:instr:dup patch: ffffffffa09cc87c cleanup_module-callr 7.102509227 #1 12980:instr:dup patch: ffffffffa09ece73 cleanup_module-callr 7.125069960 #1 12980:instr:dup patch: ffffffffa098f6e7 cleanup_module-callr 7.163923712 #1 12980:instr:dup patch: ffffffffa092fb74 cleanup_module-callr 7.173088399 #1 12980:instr:dup patch: ffffffffa09c5d6f cleanup_module-callr 7.225475712 #1 12980:instr:dup patch: ffffffffa095dca4 cleanup_module-callr 7.475371598 #0 12980:instr:dup patch: ffffffffa0928404 cleanup_module-je 7.477407747 #0 12980:instr:dup patch: ffffffffa092103f cleanup_module-callr 7.477643914 #0 12980:instr:dup patch: ffffffffa091b237 cleanup_module-callr 7.478290200 #0 12980:instr:dup patch: ffffffffa0916588 cleanup_module-callr 7.479999754 #0 12980:instr:dup patch: ffffffffa03e3e50 cleanup_module-callr 7.480178341 #0 12980:instr:dup patch: ffffffffa03de14c cleanup_module-callr 7.480826625 #0 12980:instr:dup patch: ffffffffa03d981f cleanup_module-callr 7.482291646 #0 12980:instr:dup patch: ffffffffa03d31aa cleanup_module-callr 7.397843619 #1 12980:instr:dup patch: ffffffffa0908aa9 cleanup_module-callr 7.515301585 #0 12980:instr:dup patch: ffffffffa03c2444 cleanup_module-callr 7.521250046 #0 12980:instr:dup patch: ffffffffa03ca70f cleanup_module-callr 7.447831467 #1 12980:instr:dup patch: ffffffffa03b3783 cleanup_module-callr 7.457407685 #1 12980:instr:dup patch: ffffffffa02b875f cleanup_module-callr 7.458480079 #1 12980:instr:dup patch: ffffffffa02ae258 cleanup_module-callr 7.460200768 #1 12980:instr:dup patch: ffffffffa0278241 cleanup_module-callr 7.473371185 #1 12980:instr:dup patch: ffffffffa039b7fa cleanup_module-callr 7.500699021 #1 12980:instr:dup patch: ffffffffa037e107 cleanup_module-callr 7.507416400 #1 12980:instr:dup patch: ffffffffa00f11ec cleanup_module-callr 8.160198833 #1 12980:instr:dup patch: ffffffffa0583a23 cleanup_module-callr 8.283659225 #1 12980:instr:dup patch: ffffffffa00a69d3 cleanup_module-callr 8.292324332 #1 12980:instr:dup patch: ffffffffa036343f cleanup_module-callr 8.304797930 #1 12980:instr:dup patch: ffffffffa0351ea7 cleanup_module-callr 8.324171746 #1 12980:instr:dup patch: ffffffffa0148a77 cleanup_module-callr 8.334871615 #1 12980:instr:dup patch: ffffffffa0332b94 cleanup_module-callr 8.342857360 #1 12980:instr:dup patch: ffffffffa026bfe7 cleanup_module-callr 8.357780451 #1 12980:instr:dup patch: ffffffffa03fdd04 cleanup_module-callr 8.441065855 #1 12980:instr:dup patch: ffffffffa02f738c cleanup_module-callr 8.607226292 #1 12980:instr:dup patch: ffffffffa0229b3c cleanup_module-callr 8.878946655 #0 12980:instr:dup patch: ffffffffa01990cb cleanup_module-callr 8.934006308 #0 12980:instr:dup patch: ffffffffa013711d cleanup_module-je 8.936023649 #0 12980:instr:dup patch: ffffffffa00e2ef3 cleanup_module-callr 8.956808890 #0 12980:instr:dup patch: ffffffffa0124bcb cleanup_module-callr 8.965560739 #0 12980:instr:dup patch: ffffffffa00caa85 cleanup_module-callr 8.966575930 #0 12980:instr:dup patch: ffffffffa00dd175 cleanup_module-callr 8.969600160 #0 12980:instr:dup patch: ffffffffa00f6d37 cleanup_module-callr 8.973947114 #0 12980:instr:dup patch: ffffffffa00eb719 cleanup_module-callr 8.980539964 #0 12980:instr:dup patch: ffffffffa00933cb cleanup_module-callr 9.006245018 #0 12980:instr:dup patch: ffffffffa010c72b cleanup_module-callr 9.023352314 #0 12980:instr:dup patch: ffffffffa00bc9b8 cleanup_module-callr 9.032066865 #0 12980:instr:dup patch: ffffffffa00a0a5b cleanup_module-callr 9.033427278 #0 12980:instr:dup patch: ffffffffa0062aa8 cleanup_module-callr 9.034609842 #0 12980:instr:dup patch: ffffffffa00ac43b cleanup_module-callr 9.040308232 #0 12980:instr:dup patch: ffffffffa00d68ae cleanup_module-callr 9.081115639 #0 12980:instr:dup patch: ffffffffa007d578 cleanup_module-callr 9.089234327 #0 12980:instr:dup patch: ffffffffa008b16f cleanup_module-callr 9.093935617 #0 12980:instr:dup patch: ffffffffa0070af4 cleanup_module-callr 9.095509242 #0 12980:instr:dup patch: ffffffffa0050e67 cleanup_module-callr 9.095616695 #0 12980:instr:dup patch: ffffffffa006a04f cleanup_module-callr 9.096148184 #0 12980:instr:dup patch: ffffffffa004b34f cleanup_module-callr 9.099020475 #0 12980:instr:dup patch: ffffffffa001640c cleanup_module-callr 9.102504438 #0 12980:instr:dup patch: ffffffffa005a07a cleanup_module-je 9.111741087 #0 12980:instr:dup patch: ffffffffa003ffef cleanup_module-callr 9.118575414 #0 12980:instr:dup patch: ffffffffa002e5bf cleanup_module-callr 9.141326219 #0 12980:instr:dup patch: ffffffffa0024409 cleanup_module-callr 9.143006787 #0 12980:instr:dup patch: ffffffffa000de2b cleanup_module-callr 9.106097313 #1 12980:fbt:dup patch: ffffffffa0c52d8c cleanup_module 9.135466781 #1 12980:fbt:dup patch: ffffffffa0bb0652 cleanup_module 9.137998903 #1 12980:fbt:dup patch: ffffffffa0b35d8a cleanup_module 9.140477517 #1 12980:fbt:dup patch: ffffffffa0b97106 cleanup_module 9.144919585 #1 12980:fbt:dup patch: ffffffffa0b8582e cleanup_module 9.148677043 #1 12980:fbt:dup patch: ffffffffa0b3f10b cleanup_module 9.152261158 #1 12980:fbt:dup patch: ffffffffa0b2acfd cleanup_module 9.156506112 #1 12980:fbt:dup patch: ffffffffa0a05535 cleanup_module 9.164914426 #1 12980:fbt:dup patch: ffffffffa0b7217b cleanup_module 9.210732704 #1 12980:fbt:dup patch: ffffffffa0abff27 cleanup_module 9.230181524 #1 12980:fbt:dup patch: ffffffffa09e4081 cleanup_module 9.242143160 #1 12980:fbt:dup patch: ffffffffa0a34ec1 cleanup_module 9.252854382 #1 12980:fbt:dup patch: ffffffffa09fca63 cleanup_module 9.254712399 #1 12980:fbt:dup patch: ffffffffa09df035 cleanup_module 9.255461351 #1 12980:fbt:dup patch: ffffffffa09d6378 cleanup_module 9.256213503 #1 12980:fbt:dup patch: ffffffffa09cc8a7 cleanup_module 9.257392838 #1 12980:fbt:dup patch: ffffffffa09ece91 cleanup_module 9.264122957 #1 12980:fbt:dup patch: ffffffffa098f716 cleanup_module 9.277374908 #1 12980:fbt:dup patch: ffffffffa092fb7a cleanup_module 9.279910928 #1 12980:fbt:dup patch: ffffffffa09c5d97 cleanup_module 9.294604213 #1 12980:fbt:dup patch: ffffffffa095dcc3 cleanup_module 9.301811108 #1 12980:fbt:dup patch: ffffffffa0928471 cleanup_module 9.302479986 #1 12980:fbt:dup patch: ffffffffa0921069 cleanup_module 9.302600529 #1 12980:fbt:dup patch: ffffffffa091b255 cleanup_module 9.302790709 #1 12980:fbt:dup patch: ffffffffa091659a cleanup_module 9.303554485 #1 12980:fbt:dup patch: ffffffffa03e3e7f cleanup_module 9.303621006 #1 12980:fbt:dup patch: ffffffffa03de152 cleanup_module 9.303916079 #1 12980:fbt:dup patch: ffffffffa03d9836 cleanup_module 9.304498495 #1 12980:fbt:dup patch: ffffffffa03d321b cleanup_module 9.307814640 #1 12980:fbt:dup patch: ffffffffa0908ab4 cleanup_module 9.311298668 #1 12980:fbt:dup patch: ffffffffa03c2478 cleanup_module 9.311922877 #1 12980:fbt:dup patch: ffffffffa03ca721 cleanup_module 9.317962254 #1 12980:fbt:dup patch: ffffffffa03b37c7 cleanup_module 9.320822230 #1 12980:fbt:dup patch: ffffffffa02b8771 cleanup_module 9.321119238 #1 12980:fbt:dup patch: ffffffffa02ae26a cleanup_module 9.321683851 #1 12980:fbt:dup patch: ffffffffa0278253 cleanup_module 9.325593929 #1 12980:fbt:dup patch: ffffffffa039b805 cleanup_module 9.334079576 #1 12980:fbt:dup patch: ffffffffa037e11c cleanup_module 9.336647163 #1 12980:fbt:dup patch: ffffffffa00f11f2 cleanup_module 9.343316618 #1 12980:fbt:dup patch: ffffffffa043fa90 disable_HDP_cache_r6xx 9.343324356 #1 12980:fbt:dup patch: ffffffffa043faa0 restore_HDP_cache_r6xx 9.382904134 #1 12980:fbt:dup patch: ffffffffa04e8090 _ZN8GartPcie12flushGartTLBEv 9.383171086 #1 12980:fbt:dup patch: ffffffffa048c330 PostCharOutput 9.383584129 #1 12980:fbt:dup patch: ffffffffa047e770 DummyCailCheckDsmuSupport 9.386062968 #1 12980:fbt:dup patch: ffffffffa0447f70 firegl_cmmqs_powerdown 9.386158732 #1 12980:fbt:dup patch: ffffffffa04b8e00 _ZN18asic_configurationD1Ev 9.386619002 #1 12980:fbt:dup patch: ffffffffa047e320 DummyCailCheckMemoryConfiguration 9.389599347 #1 12980:fbt:dup patch: ffffffffa04952a0 _ZN11PasIDHelperD1Ev 9.390453591 #1 12980:fbt:dup patch: ffffffffa04e5d30 _ZN7GartAgp23InitializeGartRegistersEv 9.390787994 #1 12980:fbt:dup patch: ffffffffa04e6920 _ZN7GartPci11DisableGartEv 9.392021162 #1 12980:fbt:dup patch: ffffffffa047e750 DummyCailWriteMmPciConfigRegister 9.392496907 #1 12980:fbt:dup patch: ffffffffa04a46c0 _ZN23CMMHeap_SHARED_PAGEABLE16dropPoolFromHeapEP7CMMPool 9.393039018 #1 12980:fbt:dup patch: ffffffffa04e83d0 _ZN12GartPcieR30019ProgramPcieGartBaseEv 9.393928929 #1 12980:fbt:dup patch: ffffffffa04e0020 _ZdlPv 9.399515048 #1 12980:fbt:dup patch: ffffffffa047e3d0 DummyCailAsicState 9.400571101 #1 12980:fbt:dup patch: ffffffffa04efd30 R6XX_SetAllClockGating 9.403609345 #1 12980:fbt:dup patch: ffffffffa0580f60 _ZN10APLBinFileD2Ev 9.404744081 #1 12980:fbt:dup patch: ffffffffa048f0a0 CMMQS_PowerUp 9.405209255 #1 12980:fbt:dup patch: ffffffffa04e75b0 _ZN8GartPcie19ProgramPcieGartBaseEv 9.506582365 #0 12980:fbt:dup patch: ffffffffa048c340 CallerDebugFunc 9.509334109 #0 12980:fbt:dup patch: ffffffffa04d7b50 UVDFWLib_GetFW 9.509909555 #0 12980:fbt:dup patch: ffffffffa0450f80 vGetRegulation 9.511660531 #0 12980:fbt:dup patch: ffffffffa04dbc00 _ZN9AsicRV77018submit_PAINT_MULTIERN4Asic19_PAINT_MULTI_PARAMSE 9.512916719 #0 12980:fbt:dup patch: ffffffffa04c2f40 _ZN6AsicCI20registerRingLocationEv 9.513072389 #0 12980:fbt:dup patch: ffffffffa0495290 _ZN11PasIDHelperD2Ev 9.516381286 #0 12980:fbt:dup patch: ffffffffa04bbe20 _ZN7PM4Ring26freeScratchWritebackMemoryEv 9.516432686 #0 12980:fbt:dup patch: ffffffffa04acb00 _ZN4Asic18startVPURProcedureEv 9.516857676 #0 12980:fbt:dup patch: ffffffffa04e6930 _ZN7GartPci12flushGartTLBEv 9.519096201 #0 12980:fbt:dup patch: ffffffffa047e5c0 DummyCailWriteSamSabIndirectRegister 9.520894467 #0 12980:fbt:dup patch: ffffffffa04acc60 _ZN4Asic9WaitUntil22passDumpDataToMiniportEv 9.520902461 #0 12980:fbt:dup patch: ffffffffa04f8aa0 IRQMGR_WriteRegister_Dummy 9.521601320 #0 12980:fbt:dup patch: ffffffffa0450cd0 CAIL_AsicShutDown 9.530353211 #0 12980:fbt:dup patch: ffffffffa04b6580 _ZN18CMMApertureManager27reserveAperturesIfNecessaryEv 9.531119745 #0 12980:fbt:dup patch: ffffffffa048c680 usleep 9.536573202 #0 12980:fbt:dup patch: ffffffffa04b8df0 _ZN18asic_configurationD2Ev 9.537246796 #0 12980:fbt:dup patch: ffffffffa049bdb0 _ZN2OS11shareMemoryEPvP6CMMMapP38_VIDEO_ATI_SHARE_MEMORY_INFORMATION_WA 9.538023720 #0 12980:fbt:dup patch: ffffffffa04e3750 _ZN7GpsBase13ULPS_WriteRegEjj 9.540924757 #0 12980:fbt:dup patch: ffffffffa047e6a0 DummyCailGetPowerControlRegisterTable 9.549279261 #0 12980:fbt:dup patch: ffffffffa04d7b40 UVDFWLib_GetFW_Ex 9.552684333 #0 12980:fbt:dup patch: ffffffffa047e730 DummyCailSelectSeSh 9.554667258 #0 12980:fbt:dup patch: ffffffffa041cda0 cxa_pure_virtual 9.565315970 #0 12980:fbt:dup patch: ffffffffa047e2c0 DummyCailSetIndRegSmc 9.565723327 #0 12980:fbt:dup patch: ffffffffa04e75d0 _ZN8GartPcie10EnableGartEv 9.565973366 #0 12980:fbt:dup patch: ffffffffa04e75e0 _ZN8GartPcie11DisableGartEv 9.566837639 #0 12980:fbt:dup patch: ffffffffa04d8b70 _ZN8AsicR60013loadMicrocodeEPjPKcS0S2 9.567066289 #0 12980:fbt:dup patch: ffffffffa04e6900 _ZN7GartPci23InitializeGartRegistersEv 9.567227966 #0 12980:fbt:dup patch: ffffffffa048f090 CMMQS_PowerDown 9.568104697 #0 12980:fbt:dup patch: ffffffffa048c470 WriteSysIOReg8 9.569073621 #0 12980:fbt:dup patch: ffffffffa04e9840 _ZN10GartCayman22InitExternalSemaphoresEv 9.571498165 #0 12980:fbt:dup patch: ffffffffa047e350 DummyCailMemoryConfigAndSize 9.574120182 #0 12980:fbt:dup patch: ffffffffa0452310 CailWriteMC 9.575423788 #0 12980:fbt:dup patch: ffffffffa05423a0 PhwTrinity_ReleaseMutex 9.575764905 #0 12980:fbt:dup patch: ffffffffa04ad580 _ZN4Asic15ElapsedTS_Sleep5delayEv 9.576490289 #0 12980:fbt:dup patch: ffffffffa04b4e80 _ZN8mmEngine14insertSubmitIBERPjP12QS_MMIBUFFERj 9.580616637 #0 12980:fbt:dup patch: ffffffffa04eab00 _ZN13GartVmptRv77023UpdateInvalidationRangeE9_GPS_HEAPmm 9.582115265 #0 12980:fbt:dup patch: ffffffffa047e5e0 DummyCailWriteSamIndirectRegister 9.585679284 #0 12980:fbt:dup patch: ffffffffa049bdc0 _ZN2OS13unshareMemoryEP6CMMMap 9.585805406 #0 12980:fbt:dup patch: ffffffffa04dba20 _ZN9AsicRV77013loadMicrocodeEv 9.590684033 #0 12980:fbt:dup patch: ffffffffa04c3620 ZN6AsicCI17initRingsPriorityEv 9.591773979 #0 12980:fbt:dup patch: ffffffffa0489290 cmdNOP 9.500375224 #1 12980:fbt:dup patch: ffffffffa048c520 WriteRegIO 9.501290105 #1 12980:fbt:dup patch: ffffffffa047e310 DummyCailUpdateSwConstantForHwConfig 9.502194529 #1 12980:fbt:dup patch: ffffffffa0421de0 firegl_pm_save_onchip_ram 9.503177429 #1 12980:fbt:dup patch: ffffffffa047e5a0 DummyCailExecuteDmaCopy 9.505224966 #1 12980:fbt:dup patch: ffffffffa04fcb40 SPECTRE_Enable_CP_ECC_Err_Int 9.505532931 #1 12980:fbt:dup patch: ffffffffa04efd20 R6XX_SetClockGating 9.506351539 #1 12980:fbt:dup patch: ffffffffa047e430 DummyCailTdrEnd 9.507260291 #1 12980:fbt:dup patch: ffffffffa04e75c0 _ZN8GartPcie23InitializeGartRegistersEv 9.509960992 #1 12980:fbt:dup patch: ffffffffa04deb50 _ZN9AsicRV63013loadMicrocodeEv 9.512341082 #1 12980:fbt:dup patch: ffffffffa04d8b60 _ZN8AsicR60013loadMicrocodeEv 9.512561980 #1 12980:fbt:dup patch: ffffffffa048c490 WriteSysIOReg32 9.515594470 #1 12980:fbt:dup patch: ffffffffa04522f0 CailWritePLL 9.516311447 #1 12980:fbt:dup patch: ffffffffa0487d20 IndirectIOCommand 9.520498507 #1 12980:fbt:dup patch: ffffffffa04e6910 _ZN7GartPci10EnableGartEv 9.521754770 #1 12980:fbt:dup patch: ffffffffa04f0190 R6XX_EnableVMCInterrupt 9.522448183 #1 12980:fbt:dup patch: ffffffffa0583b47 cleanup_module 9.524926464 #1 12980:fbt:dup patch: ffffffffa0580f70 _ZN10APLBinFileD1Ev 9.532883473 #1 12980:fbt:dup patch: ffffffffa04fb940 BONAIRE_Enable_CP_ECC_Err_Int 9.533043472 #1 12980:fbt:dup patch: ffffffffa047e710 DummyCailSetIndRegPcie 9.540605021 #1 12980:fbt:dup patch: ffffffffa049be90 _ZN2OS15program_Gart_PTEP4AsicP23_CMM_PROGRAM_GART_PT_WA 9.543031362 #1 12980:fbt:dup patch: ffffffffa0447f80 firegl_cmmqs_powerup 9.546016343 #1 12980:fbt:dup patch: ffffffffa04c0800 _ZN11AsicCypress18submit_PAINT_MULTIERN4Asic19_PAINT_MULTI_PARAMSE 9.550340845 #1 12980:fbt:dup patch: ffffffffa04a2500 _ZN14CMMHeapManager14programGart_PTEv 9.551540996 #1 12980:fbt:dup patch: ffffffffa048c480 WriteSysIOReg16 9.556120163 #1 12980:fbt:dup patch: ffffffffa0421df0 firegl_pm_restore_onchip_ram 9.557409312 #1 12980:fbt:dup patch: ffffffffa04acb40 _ZN4Asic9WaitUntil5delayEv 9.559379060 #1 12980:fbt:dup patch: ffffffffa00a69d9 cleanup_module 9.562233847 #1 12980:fbt:dup patch: ffffffffa0363445 cleanup_module 9.566158008 #1 12980:fbt:dup patch: ffffffffa0351ead cleanup_module 9.572419168 #1 12980:fbt:dup patch: ffffffffa0148a7d cleanup_module 9.576153503 #1 12980:fbt:dup patch: ffffffffa0332b9a cleanup_module 9.578568852 #1 12980:fbt:dup patch: ffffffffa026bfed cleanup_module 9.583551297 #1 12980:fbt:dup patch: ffffffffa03fdd0f cleanup_module 9.608064967 #1 12980:fbt:dup patch: ffffffffa02f7392 cleanup_module 9.655918887 #1 12980:fbt:dup patch: ffffffffa0229b64 cleanup_module 9.694543292 #1 12980:fbt:dup patch: ffffffffa0199104 cleanup_module 9.706866791 #1 12980:fbt:dup patch: ffffffffa0137236 cleanup_module 9.707426463 #1 12980:fbt:dup patch: ffffffffa00e2f11 cleanup_module 9.712312310 #1 12980:fbt:dup patch: ffffffffa0124be9 cleanup_module 9.714980636 #1 12980:fbt:dup patch: ffffffffa00caa97 cleanup_module 9.715291454 #1 12980:fbt:dup patch: ffffffffa00dd19a cleanup_module 9.716099512 #1 12980:fbt:dup patch: ffffffffa00f6d3d cleanup_module 9.716407344 #1 12980:fbt:dup patch: ffffffffa00c5b5d cleanup_module 9.717581696 #1 12980:fbt:dup patch: ffffffffa00eb7ad cleanup_module 9.719017816 #1 12980:fbt:dup patch: ffffffffa00933dd cleanup_module 9.725642770 #1 12980:fbt:dup patch: ffffffffa010c73d cleanup_module 9.729792140 #1 12980:fbt:dup patch: ffffffffa00bc9d2 cleanup_module 9.732127609 #1 12980:fbt:dup patch: ffffffffa00a0a61 cleanup_module 9.732480115 #1 12980:fbt:dup patch: ffffffffa0062ad2 cleanup_module 9.732784152 #1 12980:fbt:dup patch: ffffffffa00ac441 cleanup_module 9.734139147 #1 12980:fbt:dup patch: ffffffffa00d68e8 cleanup_module 9.737675089 #1 12980:fbt:dup patch: ffffffffa007d597 cleanup_module 9.740041463 #1 12980:fbt:dup patch: ffffffffa008b21f cleanup_module 9.741157494 #1 12980:fbt:dup patch: ffffffffa0070afa cleanup_module 9.741641453 #1 12980:fbt:dup patch: ffffffffa0050e6d cleanup_module 9.741697681 #1 12980:fbt:dup patch: ffffffffa006a055 cleanup_module 9.741852764 #1 12980:fbt:dup patch: ffffffffa004b363 cleanup_module 9.742582832 #1 12980:fbt:dup patch: ffffffffa0016471 cleanup_module 9.743655276 #1 12980:fbt:dup patch: ffffffffa005a091 cleanup_module 9.746075696 #1 12980:fbt:dup patch: ffffffffa003fff5 cleanup_module 9.748119540 #1 12980:fbt:dup patch: ffffffffa002e5c5 cleanup_module 9.749709221 #1 12980:fbt:dup patch: ffffffffa0037961 cleanup_module 9.755098538 #1 12980:fbt:dup patch: ffffffffa002440f cleanup_module 9.755522279 #1 12980:fbt:dup patch: ffffffffa000de31 cleanup_module 9.786567716 #1 12980:dtrace_linux.c:get_proc_addr: Failed to find 'sys32_clone' (warn=5) 9.817649455 #1 12980:dtrace_linux.c:get_proc_addr: Failed to find 'sys32_execve' (warn=6) 9.886132706 #1 12980:vmem_create(dtrace_aggid_0) ffff880069c828a0 14.663829733 #1 12980:teardown start xcalls=19 probes=0 14.663836333 #1 12980:teardown done 0.000007096 xcalls=20 probes=0 14.831221752 #0 12986:vmem_create(dtrace_aggid_0) ffff8801142b0ae0 14.776702330 #1 12986:teardown start xcalls=21 probes=0 14.776709431 #1 12986:teardown done 0.000007286 xcalls=22 probes=0 19.990378173 #1 13025:vmem_create(dtrace_aggid_0) ffff880069c82960 61.781674923 #1 13025:[cpu1] dtrace_linux_panic called. Dumping cpu stacks 61.782270332 #1 13025:dtrace_linux_panic: finished 61.879145484 #0 3673-This is CPU#0 62.855334789 #0 13025:teardown start xcalls=149 probes=1 62.855344553 #0 13025:kmem_free t=0.000000777 (1) 62.855355065 #0 13025:teardown done 0.000020447 xcalls=149 probes=0

— Reply to this email directly or view it on GitHubhttps://github.com/dtrace4linux/linux/issues/62#issuecomment-22070723 .

michaelmior commented 11 years ago

I've always run make load immediately before testing. Here's build/port.h.

/* This file is automatically generated via mkport.pl */
/* kern=/lib/modules/3.8.0-27-generic/build */
/* kern_src=/lib/modules/3.8.0-27-generic/build */

# define DO_NOT_HAVE_ZLIB_IN_KERNEL 1
# define FUNC_DUMP_TRACE_ARGS 6
# define HAVE_ATOMIC_NOTIFIER_CHAIN_REGISTER 1
# define HAVE_BX_REGISTER 1
# define HAVE_CPLUS_DEMANGLE 1
# define HAVE_CPU_NUMBER 1
# define HAVE_ELF_C_READ_MMAP 1
# define HAVE_ELF_GETSHDRSTRNDX 1
# define HAVE_INCLUDE_LINUX_CRED_H 1
# define HAVE_INCLUDE_LINUX_HRTIMER_H 1
# define HAVE_INCLUDE_LINUX_KDEBUG_H 1
# define HAVE_INCLUDE_LINUX_MUTEX_H 1
# define HAVE_INCLUDE_LINUX_SEMAPHORE_H 1
# define HAVE_INCLUDE_LINUX_SLAB_H 1
# define HAVE_LEX_YYTEXT_PTR 1
# define HAVE_LIB_LIBDWARF 1
# define HAVE_LINUX_FDTABLE_H 1
# define HAVE_LINUX_MIGRATE_H 1
# define HAVE_STACKTRACE_OPS 
# define HAVE_VMALLOC_SYNC_ALL 1
# define SMP_CALL_FUNCTION_ARGS 3
# define SMP_CALL_FUNCTION_SINGLE_ARGS 4
dtrace4linux commented 11 years ago

Michael - thanks for this. I wander if this problem shows up on real HW - I rarely run dtrace on real HW, so now I need to. Will see what I can find in the next day or so, but if I dont succeed, then it will have to wait til i am back to look at this.

The stack trace is showing the cross-cpu call not doing what it should, so dtrace is failing "safely" and not panicing or corrupting your system. I cant reproduce the simple case in one of my VMs - its such a basic test, but its a good test to prove the cross-cpu call is working, and surprising it isnt. (But then, cross-cpu calls are strange).

Out of interest - is your system running under Xen? Is it Intel or AMD cpu?

thanks

On 5 August 2013 22:38, Michael Mior notifications@github.com wrote:

I've always run make load immediately before testing. Here's build/port.h.

/* This file is automatically generated via mkport.pl / / kern=/lib/modules/3.8.0-27-generic/build / / kern_src=/lib/modules/3.8.0-27-generic/build */

define DO_NOT_HAVE_ZLIB_IN_KERNEL 1

define FUNC_DUMP_TRACE_ARGS 6

define HAVE_ATOMIC_NOTIFIER_CHAIN_REGISTER 1

define HAVE_BX_REGISTER 1

define HAVE_CPLUS_DEMANGLE 1

define HAVE_CPU_NUMBER 1

define HAVE_ELF_C_READ_MMAP 1

define HAVE_ELF_GETSHDRSTRNDX 1

define HAVE_INCLUDE_LINUX_CRED_H 1

define HAVE_INCLUDE_LINUX_HRTIMER_H 1

define HAVE_INCLUDE_LINUX_KDEBUG_H 1

define HAVE_INCLUDE_LINUX_MUTEX_H 1

define HAVE_INCLUDE_LINUX_SEMAPHORE_H 1

define HAVE_INCLUDE_LINUX_SLAB_H 1

define HAVE_LEX_YYTEXT_PTR 1

define HAVE_LIB_LIBDWARF 1

define HAVE_LINUX_FDTABLE_H 1

define HAVE_LINUX_MIGRATE_H 1

define HAVE_STACKTRACE_OPS

define HAVE_VMALLOC_SYNC_ALL 1

define SMP_CALL_FUNCTION_ARGS 3

define SMP_CALL_FUNCTION_SINGLE_ARGS 4

— Reply to this email directly or view it on GitHubhttps://github.com/dtrace4linux/linux/issues/62#issuecomment-22143065 .

michaelmior commented 11 years ago

Thanks for helping look into this. Not running under Xen. CPU is AMD E2-3000M. Unfortunately I'll be out of town the rest of the week so I'll be unable to respond for a few days but I should be able to reply to any further requests over the weekend.

lukas999 commented 10 years ago

Hello, I experience similar problem:

dtrace -c 'ls' -n 'syscall:::entry /pid == $target/ {@[probefunc] = count();}'

parent: waiting for child parent: after waitpid pid=12305 status=137f rd_loadobj_iter rd_loadobj_iter: /lib64/libc-2.19.so 0x7fdcc0383000 rd_loadobj_iter: /lib64/libdl-2.19.so 0x7fdcc0729000 rd_loadobj_iter: /usr/lib64/libelf-0.158.so 0x7fdcc092d000 rd_loadobj_iter: /lib64/libpthread-2.19.so 0x7fdcc0b43000 rd_loadobj_iter: /lib64/librt-2.19.so 0x7fdcc0d61000 rd_loadobj_iter: /lib64/ld-2.19.so 0x7fdcc117f000 proc-stub:rd_event_enable proc-stub:rd_event_addr addr=(nil) proc-stub:rd_event_addr addr=(nil) proc-stub:rd_event_addr addr=(nil) dtrace: description 'syscall:::entry ' matched 661 probes dtrace: processing aborted: No such device PTRACE_TRACEME: Operation not permitted child 12305 about to exec ls

on Gentoo distribution, kernel version 3.15.2 from Gentoo sources # cat /proc/dtrace/trace #0 9425:4dtracedrv loaded: /dev/dtrace available, dtrace_here=0 nr_cpus=8 #0 9425:vmem_create(dtrace) ffff8801d9c475a0 #0 9425:vmem_create(dtrace_minor) ffff8801d9c474e0 #0 9425:__alloc_workqueue_key_ptr=ffffffff81065c30 #0 9425:dtrace_linux.c:get_proc_addr: Failed to find 'queue_delayed_work' (warn=1) #0 9425:dtrace_linux.c:get_proc_addr: Failed to find 'lockdep_init_map' (warn=2) #0 9425:queue_delayed_work_ptr=0000000000000000 #0 9425:destroy_workqueue_ptr=ffffffff810633d0 #0 9425:flush_workqueue_ptr=ffffffff81061b60 #0 9425:delayed_work_timer_fn_ptr=ffffffff81063210 #0 9425:ctf loaded: /dev/ctf now available #0 9418:dtrace_linux.c:get_proc_addr: Failed to find 'sysrq_showregs_othercpus' (warn=3) #0 9418:dtrace_linux.c:get_proc_addr: Failed to find 'xtime_cache' (warn=4) 0.000000000 #0 9418:profile loaded: /dev/dtrace_profile available 0.036411062 #0 9418:dtrace_linux.c:get_proc_addr: Failed to find 'tcp_event_data_sent' (warn=5) 0.036412021 #0 9418:prcom_add_function: cannot locate 'tcp_event_data_sent' 0.239416063 #0 9418:dtrace_linux.c:get_proc_addr: Failed to find 'xen_start_info' (warn=6) 0.239471835 #0 9418:dcpc.c:dcpc_attach:1333: TODO:please fill me in 0.239472280 #0 9418:dcpc initialised. 0.239539170 #0 9418:sdt loaded: /dev/sdt now available 0.239944537 #0 9418:ctl loaded: /dev/dtrace_ctl now available 0.241259341 #0 9418:dtrace_function_size: do_sync_read ffffffff81175f80 size=144 0.241260524 #0 9418:io_prov_entry called io:start 0.241264555 #0 9418:io_prov_return called io:start ffffffff81175fea sz=1 0.241266216 #0 9418:io_prov_return called io:start ffffffff81176006 sz=1 0.241938996 #0 9418:dtrace_function_size: do_sync_write ffffffff81176300 size=144 0.241939498 #0 9418:io_prov_entry called io:start 0.241942464 #0 9418:io_prov_return called io:start ffffffff8117636a sz=1 0.241943796 #0 9418:io_prov_return called io:start ffffffff81176386 sz=1 0.533992507 #0 9440:fbt:dup patch: ffffffff818469be error_sti 1.664905760 #1 9440:instr:dup patch: ffffffffa00740ab cleanup_module-callr 1.665254382 #1 9440:instr:dup patch: ffffffffa006be2f cleanup_module-callr 1.674877930 #1 9440:instr:dup patch: ffffffffa0264219 cleanup_module-callr 1.683695022 #1 9440:instr:dup patch: ffffffffa00e83fc cleanup_module-callr 1.686395870 #1 9440:instr:dup patch: ffffffffa0083a4b cleanup_module-callr 1.687905339 #1 9440:instr:dup patch: ffffffffa002474b cleanup_module-callr 1.690215271 #1 9440:instr:dup patch: ffffffffa00d0d4b cleanup_module-callr 1.693679117 #1 9440:instr:dup patch: ffffffffa002d7b7 cleanup_module-callr 1.694453633 #1 9440:instr:dup patch: ffffffffa006637c cleanup_module-callr 1.694779969 #1 9440:instr:dup patch: ffffffffa000207f cleanup_module-callr 1.695434956 #1 9440:instr:dup patch: ffffffffa0f62d4c cleanup_module-callr 1.695685350 #1 9440:instr:dup patch: ffffffffa0f5c83b cleanup_module-callr 1.695836732 #1 9440:instr:dup patch: ffffffffa0f5887f cleanup_module-callr 1.696346731 #1 9440:instr:dup patch: ffffffffa0f544f5 cleanup_module-callr 1.699285409 #1 9440:instr:dup patch: ffffffffa0f45a40 cleanup_module-callr 1.705773608 #1 9440:instr:dup patch: ffffffffa0f07183 cleanup_module-callr 1.708220029 #1 9440:instr:dup patch: ffffffffa0eefc1b cleanup_module-callr 1.708689437 #1 9440:instr:dup patch: ffffffffa0eea9ab cleanup_module-callr 1.708965148 #1 9440:instr:dup patch: ffffffffa0ee69e7 cleanup_module-callr 1.709312969 #1 9440:instr:dup patch: ffffffffa0ee24f4 cleanup_module-callr 1.709603995 #1 9440:instr:dup patch: ffffffffa0edcb4f cleanup_module-callr 1.710091290 #1 9440:instr:dup patch: ffffffffa0ed84df cleanup_module-callr 1.710457591 #1 9440:instr:dup patch: ffffffffa0ed3493 cleanup_module-callr 1.710714606 #1 9440:instr:dup patch: ffffffffa0ecdeab cleanup_module-callr 1.710947167 #1 9440:instr:dup patch: ffffffffa0ec89d7 cleanup_module-callr 1.711717750 #1 9440:instr:dup patch: ffffffffa0ec3003 cleanup_module-callr 1.712814935 #1 9440:instr:dup patch: ffffffffa0ebad9f cleanup_module-callr 1.712861479 #1 9440:instr:dup patch: ffffffffa0eb41a3 cleanup_module-callr 1.713285698 #1 9440:instr:dup patch: ffffffffa0eb0107 cleanup_module-callr 1.713317044 #1 9440:instr:dup patch: ffffffffa0eaa0ce cleanup_module-callr 1.714136098 #1 9440:instr:dup patch: ffffffffa0ea4dcd cleanup_module-callr 1.717790214 #1 9440:instr:dup patch: ffffffffa0e90317 cleanup_module-callr 1.720354953 #1 9440:instr:dup patch: ffffffffa0e78313 cleanup_module-callr 1.721326180 #1 9440:instr:dup patch: ffffffffa0e689ab cleanup_module-callr 1.721353611 #1 9440:instr:dup patch: ffffffffa0e6207b cleanup_module-callr 1.721433566 #1 9440:instr:dup patch: ffffffffa0e5e2ab cleanup_module-callr 1.721475707 #1 9440:instr:dup patch: ffffffffa0e5a103 cleanup_module-callr 1.721677228 #1 9440:instr:dup patch: ffffffffa0e566fc cleanup_module-callr 1.722252117 #1 9440:instr:dup patch: ffffffffa0e50c7b cleanup_module-callr 1.722455320 #1 9440:instr:dup patch: ffffffffa0e4aa53 cleanup_module-callr 1.722462429 #1 9440:instr:dup patch: ffffffffa0e46037 cleanup_module-callr 1.722589929 #1 9440:instr:dup patch: ffffffffa0e424b8 cleanup_module-callr 1.722596577 #1 9440:instr:dup patch: ffffffffa0e3e017 cleanup_module-callr 1.723006466 #1 9440:instr:dup patch: ffffffffa0e383d1 cleanup_module-callr 1.723037256 #1 9440:instr:dup patch: ffffffffa0e33154 cleanup_module-callr 1.723290095 #1 9440:instr:dup patch: ffffffffa0e2e9ef cleanup_module-je 1.723391960 #1 9440:instr:dup patch: ffffffffa0e2a547 cleanup_module-callr 1.723448699 #1 9440:instr:dup patch: ffffffffa0e2620b cleanup_module-callr 1.723510453 #1 9440:instr:dup patch: ffffffffa0e222c7 cleanup_module-callr 1.723930658 #1 9440:instr:dup patch: ffffffffa0e1dda3 cleanup_module-callr 1.723957022 #1 9440:instr:dup patch: ffffffffa0e190c3 cleanup_module-callr 1.724233676 #1 9440:instr:dup patch: ffffffffa0e1497c cleanup_module-callr 1.725198291 #1 9440:instr:dup patch: ffffffffa0e0b569 cleanup_module-callr 1.725597322 #1 9440:instr:dup patch: ffffffffa0e0407f cleanup_module-callr 1.726124565 #1 9440:instr:dup patch: ffffffffa0e00425 cleanup_module-callr 1.726144560 #1 9440:instr:dup patch: ffffffffa0dfb073 cleanup_module-callr 1.726578097 #1 9440:instr:dup patch: ffffffffa0df6a66 cleanup_module-callr 1.726673751 #1 9440:instr:dup patch: ffffffffa0df14c0 cleanup_module-callr 1.726717411 #1 9440:instr:dup patch: ffffffffa0ded164 cleanup_module-callr 1.726750844 #1 9440:instr:dup patch: ffffffffa0de9177 cleanup_module-callr 1.727108677 #1 9440:instr:dup patch: ffffffffa0de5046 cleanup_module-callr 1.727155693 #1 9440:instr:dup patch: ffffffffa0de029b cleanup_module-callr 1.727192379 #1 9440:instr:dup patch: ffffffffa0ddc137 cleanup_module-callr 1.727265473 #1 9440:instr:dup patch: ffffffffa0dd832f cleanup_module-callr 1.727350319 #1 9440:instr:dup patch: ffffffffa0dd43ea cleanup_module-callr 1.727436887 #1 9440:instr:dup patch: ffffffffa0dcf272 cleanup_module-je 1.727495037 #1 9440:instr:dup patch: ffffffffa0dca182 cleanup_module-je 1.728376784 #1 9440:instr:dup patch: ffffffffa0dc2cf6 cleanup_module-je 1.728805830 #1 9440:instr:dup patch: ffffffffa0dbb623 cleanup_module-callr 1.729177252 #1 9440:instr:dup patch: ffffffffa0db6033 cleanup_module-callr 1.729375118 #1 9440:instr:dup patch: ffffffffa0db0973 cleanup_module-callr 1.729584727 #1 9440:instr:dup patch: ffffffffa0dab933 cleanup_module-callr 1.731730693 #1 9440:instr:dup patch: ffffffffa0da591d cleanup_module-callr 1.731745364 #1 9440:instr:dup patch: ffffffffa0d9c01f cleanup_module-callr 1.731896700 #1 9440:instr:dup patch: ffffffffa0d93423 cleanup_module-je 1.733015686 #1 9440:instr:dup patch: ffffffffa0d82bab cleanup_module-callr 1.733325018 #1 9440:instr:dup patch: ffffffffa0d7ab58 cleanup_module-je 1.733597247 #1 9440:instr:dup patch: ffffffffa0d75b78 cleanup_module-callr 1.733662239 #1 9440:instr:dup patch: ffffffffa0d712d3 cleanup_module-callr 1.733832846 #1 9440:instr:dup patch: ffffffffa0d6d7d8 cleanup_module-callr 1.733875648 #1 9440:instr:dup patch: ffffffffa0d69188 cleanup_module-callr 1.733975676 #1 9440:instr:dup patch: ffffffffa0d6549c cleanup_module-callr 1.734076182 #1 9440:instr:dup patch: ffffffffa0d6146c cleanup_module-callr 1.734103176 #1 9440:instr:dup patch: ffffffffa0d5d0a3 cleanup_module-callr 1.734160512 #1 9440:instr:dup patch: ffffffffa0d591ff cleanup_module-callr 1.734201287 #1 9440:instr:dup patch: ffffffffa0d551bb cleanup_module-callr 1.734295664 #1 9440:instr:dup patch: ffffffffa0d514e4 cleanup_module-callr 1.734322600 #1 9440:instr:dup patch: ffffffffa0d4d0af cleanup_module-callr 1.734673307 #1 9440:instr:dup patch: ffffffffa0d4751f cleanup_module-callr 1.734992120 #1 9440:instr:dup patch: ffffffffa0d4224c cleanup_module-callr 1.735006459 #1 9440:instr:dup patch: ffffffffa0d3e05f cleanup_module-callr 1.735029156 #1 9440:instr:dup patch: ffffffffa0d3a06b cleanup_module-callr 1.735082251 #1 9440:instr:dup patch: ffffffffa0d362ef cleanup_module-callr 1.735099302 #1 9440:instr:dup patch: ffffffffa0d32090 cleanup_module-callr 1.735148445 #1 9440:instr:dup patch: ffffffffa0d2e1e0 cleanup_module-callr 1.735190853 #1 9440:instr:dup patch: ffffffffa0d2a127 cleanup_module-callr 1.735665586 #1 9440:instr:dup patch: ffffffffa0d254a8 cleanup_module-callr 1.735737358 #1 9440:instr:dup patch: ffffffffa0d202e4 cleanup_module-callr 1.735765935 #1 9440:instr:dup patch: ffffffffa0d1c10c cleanup_module-callr 1.735840541 #1 9440:instr:dup patch: ffffffffa0d1836c cleanup_module-callr 1.735959575 #1 9440:instr:dup patch: ffffffffa0d14684 cleanup_module-callr 1.736018493 #1 9440:instr:dup patch: ffffffffa0d101e3 cleanup_module-callr 1.736027647 #1 9440:instr:dup patch: ffffffffa0d0c024 cleanup_module-callr 1.736168885 #1 9440:instr:dup patch: ffffffffa0d08550 cleanup_module-callr 1.736204039 #1 9440:instr:dup patch: ffffffffa0d040bf cleanup_module-callr 1.736245524 #1 9440:instr:dup patch: ffffffffa0d0010e cleanup_module-callr 1.736394535 #1 9440:instr:dup patch: ffffffffa0cfc598 cleanup_module-callr 1.736543489 #1 9440:instr:dup patch: ffffffffa0cf87bb cleanup_module-callr 1.736896060 #1 9440:instr:dup patch: ffffffffa0cf1ca7 cleanup_module-callr 1.737254815 #1 9440:instr:dup patch: ffffffffa0cec1de cleanup_module-callr 1.737447970 #1 9440:instr:dup patch: ffffffffa0ce7901 cleanup_module-callr 1.737537815 #1 9440:instr:dup patch: ffffffffa0ce311e cleanup_module-callr 1.738642279 #1 9440:instr:dup patch: ffffffffa0cdd341 cleanup_module-callr 1.739302619 #1 9440:instr:dup patch: ffffffffa0cca367 cleanup_module-je 1.741471276 #1 9440:instr:dup patch: ffffffffa0c9e87f cleanup_module-callr 1.742376220 #1 9440:instr:dup patch: ffffffffa0c92a44 cleanup_module-callr 1.756915818 #1 9440:instr:dup patch: ffffffffa0c73f0d cleanup_module-callr 1.768695735 #1 9440:instr:dup patch: ffffffffa0c2d4b7 cleanup_module-callr 1.791819105 #1 9440:instr:dup patch: ffffffffa0bb55a8 cleanup_module-callr 1.806805004 #1 9440:instr:dup patch: ffffffffa0b46efc cleanup_module-callr 1.810351039 #1 9440:instr:dup patch: ffffffffa0b30627 cleanup_module-callr 1.813496804 #1 9440:instr:dup patch: ffffffffa0b1babb cleanup_module-callr 1.830847524 #1 9440:instr:dup patch: ffffffffa0aa30cf cleanup_module-callr 1.842210495 #1 9440:instr:dup patch: ffffffffa0a5dc63 cleanup_module-callr 1.845918303 #1 9440:instr:dup patch: ffffffffa0a47598 cleanup_module-callr 1.849259744 #1 9440:instr:dup patch: ffffffffa0a34e77 cleanup_module-callr 1.849517819 #1 9440:instr:dup patch: ffffffffa0a2db73 cleanup_module-callr 1.851102051 #1 9440:instr:dup patch: ffffffffa0a2339f cleanup_module-callr 1.851887549 #1 9440:instr:dup patch: ffffffffa0a1aa4b cleanup_module-callr 1.851915007 #1 9440:instr:dup patch: ffffffffa0a161bd cleanup_module-callr 1.852289452 #1 9440:instr:dup patch: ffffffffa09e6a8e cleanup_module-callr 1.852651366 #1 9440:instr:dup patch: ffffffffa09af04b cleanup_module-callr 1.852995150 #1 9440:instr:dup patch: ffffffffa0989e73 cleanup_module-callr 1.857312481 #1 9440:instr:dup patch: ffffffffa084a6fe cleanup_module-callr 1.879496238 #1 9440:instr:dup patch: ffffffffa03d67ef cleanup_module-callr 1.879610467 #1 9440:instr:dup patch: ffffffffa03b63ef cleanup_module-callr 1.879937872 #1 9440:instr:dup patch: ffffffffa03774bf cleanup_module-callr 1.882126194 #1 9440:instr:dup patch: ffffffffa0233830 cleanup_module-callr 1.882390093 #1 9440:instr:dup patch: ffffffffa01ef757 cleanup_module-callr 1.886362502 #1 9440:instr:dup patch: ffffffffa01d5eec cleanup_module-je 1.886474714 #1 9440:instr:dup patch: ffffffffa01b384f cleanup_module-callr 1.887883154 #1 9440:instr:dup patch: ffffffffa0157057 cleanup_module-callr 1.888420663 #1 9440:instr:dup patch: ffffffffa0134fe7 cleanup_module-callr 1.890478366 #1 9440:instr:dup patch: ffffffffa0115e58 cleanup_module-callr 1.891410269 #1 9440:instr:dup patch: ffffffffa010f87b cleanup_module-callr 1.891527728 #1 9440:instr:dup patch: ffffffffa010252b cleanup_module-callr 1.899905364 #1 9440:instr:dup patch: ffffffffa0099f33 cleanup_module-je 1.900722452 #1 9440:instr:dup patch: ffffffffa008ca2f cleanup_module-callr 1.900812674 #1 9440:instr:dup patch: ffffffffa008820b cleanup_module-callr 1.901240050 #1 9440:instr:dup patch: ffffffffa007b157 cleanup_module-callr 1.901832458 #1 9440:instr:dup patch: ffffffffa0071fa7 cleanup_module-callr 1.911632782 #1 9440:instr:dup patch: ffffffffa0057408 cleanup_module-callr 1.915484457 #1 9440:instr:dup patch: ffffffffa002875f cleanup_module-callr 1.918652350 #1 9440:instr:dup patch: ffffffffa00169c1 cleanup_module-callr 1.922723083 #1 9440:instr:dup patch: ffffffffa000007b cleanup_module-callr 1.923897013 #1 9440:fbt:dup patch: ffffffffa00740b1 cleanup_module 1.924008134 #1 9440:fbt:dup patch: ffffffffa006be59 cleanup_module 1.926836322 #1 9440:fbt:dup patch: ffffffffa0264267 cleanup_module 1.929286472 #1 9440:fbt:dup patch: ffffffffa00e8416 cleanup_module 1.930099200 #1 9440:fbt:dup patch: ffffffffa0083a73 cleanup_module 1.930537258 #1 9440:fbt:dup patch: ffffffffa002475d cleanup_module 1.931143645 #1 9440:fbt:dup patch: ffffffffa00d0d69 cleanup_module 1.932229995 #1 9440:fbt:dup patch: ffffffffa002d7c8 cleanup_module 1.932445341 #1 9440:fbt:dup patch: ffffffffa0066468 cleanup_module 1.932536177 #1 9440:fbt:dup patch: ffffffffa0002085 cleanup_module 1.932707688 #1 9440:fbt:dup patch: ffffffffa0f62d87 cleanup_module 1.932805024 #1 9440:fbt:dup patch: ffffffffa0f5c841 cleanup_module 1.932867824 #1 9440:fbt:dup patch: ffffffffa0f58891 cleanup_module 1.933005721 #1 9440:fbt:dup patch: ffffffffa0f54513 cleanup_module 1.933799445 #1 9440:fbt:dup patch: ffffffffa0f45a4b cleanup_module 1.935725141 #1 9440:fbt:dup patch: ffffffffa0f07198 cleanup_module 1.936436940 #1 9440:fbt:dup patch: ffffffffa0eefc31 cleanup_module 1.936577390 #1 9440:fbt:dup patch: ffffffffa0eea9b1 cleanup_module 1.936647389 #1 9440:fbt:dup patch: ffffffffa0ee69ed cleanup_module 1.936760253 #1 9440:fbt:dup patch: ffffffffa0ee24fa cleanup_module 1.936841023 #1 9440:fbt:dup patch: ffffffffa0edcb55 cleanup_module 1.936960336 #1 9440:fbt:dup patch: ffffffffa0ed84e5 cleanup_module 1.937100377 #1 9440:fbt:dup patch: ffffffffa0ed3499 cleanup_module 1.937190648 #1 9440:fbt:dup patch: ffffffffa0ecdeb1 cleanup_module 1.937270358 #1 9440:fbt:dup patch: ffffffffa0ec89dd cleanup_module 1.937500337 #1 9440:fbt:dup patch: ffffffffa0ec3009 cleanup_module 1.937746694 #1 9440:fbt:dup patch: ffffffffa0ebada5 cleanup_module 1.937774796 #1 9440:fbt:dup patch: ffffffffa0eb41a9 cleanup_module 1.937957692 #1 9440:fbt:dup patch: ffffffffa0eb010d cleanup_module 1.937972663 #1 9440:fbt:dup patch: ffffffffa0eaa0e0 cleanup_module 1.938189386 #1 9440:fbt:dup patch: ffffffffa0ea4df0 cleanup_module 1.939442356 #1 9440:fbt:dup patch: ffffffffa0e90350 cleanup_module 1.940145161 #1 9440:fbt:dup patch: ffffffffa0e78319 cleanup_module 1.940375821 #1 9440:fbt:dup patch: ffffffffa0e689b1 cleanup_module 1.940388211 #1 9440:fbt:dup patch: ffffffffa0e62081 cleanup_module 1.940411529 #1 9440:fbt:dup patch: ffffffffa0e5e2b1 cleanup_module 1.940431036 #1 9440:fbt:dup patch: ffffffffa0e5a109 cleanup_module 1.940491137 #1 9440:fbt:dup patch: ffffffffa0e5670e cleanup_module 1.940648743 #1 9440:fbt:dup patch: ffffffffa0e50caa cleanup_module 1.940718193 #1 9440:fbt:dup patch: ffffffffa0e4aa71 cleanup_module 1.940727621 #1 9440:fbt:dup patch: ffffffffa0e4603d cleanup_module 1.940762971 #1 9440:fbt:dup patch: ffffffffa0e424be cleanup_module 1.940772165 #1 9440:fbt:dup patch: ffffffffa0e3e01d cleanup_module 1.940911798 #1 9440:fbt:dup patch: ffffffffa0e383e3 cleanup_module 1.940932780 #1 9440:fbt:dup patch: ffffffffa0e3315a cleanup_module 1.941004977 #1 9440:fbt:dup patch: ffffffffa0e2ea16 cleanup_module 1.941041036 #1 9440:fbt:dup patch: ffffffffa0e2a54d cleanup_module 1.941070949 #1 9440:fbt:dup patch: ffffffffa0e26229 cleanup_module 1.941093864 #1 9440:fbt:dup patch: ffffffffa0e222cd cleanup_module 1.941198227 #1 9440:fbt:dup patch: ffffffffa0e1ddd2 cleanup_module 1.941211731 #1 9440:fbt:dup patch: ffffffffa0e190c9 cleanup_module 1.941293823 #1 9440:fbt:dup patch: ffffffffa0e14993 cleanup_module 1.941550072 #1 9440:fbt:dup patch: ffffffffa0e0b587 cleanup_module 1.941656026 #1 9440:fbt:dup patch: ffffffffa0e04085 cleanup_module 1.941778191 #1 9440:fbt:dup patch: ffffffffa0e0042b cleanup_module 1.941788349 #1 9440:fbt:dup patch: ffffffffa0dfb079 cleanup_module 1.941940246 #1 9440:fbt:dup patch: ffffffffa0df6a71 cleanup_module 1.941977502 #1 9440:fbt:dup patch: ffffffffa0df14c6 cleanup_module 1.941996507 #1 9440:fbt:dup patch: ffffffffa0ded16a cleanup_module 1.942015672 #1 9440:fbt:dup patch: ffffffffa0de917d cleanup_module 1.942124570 #1 9440:fbt:dup patch: ffffffffa0de505d cleanup_module 1.942146960 #1 9440:fbt:dup patch: ffffffffa0de02a1 cleanup_module 1.942161865 #1 9440:fbt:dup patch: ffffffffa0ddc13d cleanup_module 1.942197974 #1 9440:fbt:dup patch: ffffffffa0dd8335 cleanup_module 1.942224881 #1 9440:fbt:dup patch: ffffffffa0dd4417 cleanup_module 1.942246292 #1 9440:fbt:dup patch: ffffffffa0dcf2b8 cleanup_module 1.942262153 #1 9440:fbt:dup patch: ffffffffa0dca1bc cleanup_module 1.942525912 #1 9440:fbt:dup patch: ffffffffa0dc2d57 cleanup_module 1.942652860 #1 9440:fbt:dup patch: ffffffffa0dbb641 cleanup_module 1.942774483 #1 9440:fbt:dup patch: ffffffffa0db6051 cleanup_module 1.942834877 #1 9440:fbt:dup patch: ffffffffa0db0979 cleanup_module 1.942903939 #1 9440:fbt:dup patch: ffffffffa0dab945 cleanup_module 1.943456010 #1 9440:fbt:dup patch: ffffffffa0da5952 cleanup_module 1.943467015 #1 9440:fbt:dup patch: ffffffffa0d9c025 cleanup_module 1.943510641 #1 9440:fbt:dup patch: ffffffffa0d9345c cleanup_module 1.943838361 #1 9440:fbt:dup patch: ffffffffa0d82bed cleanup_module 1.943944203 #1 9440:fbt:dup patch: ffffffffa0d7abc2 cleanup_module 1.944016102 #1 9440:fbt:dup patch: ffffffffa0d75b7e cleanup_module 1.944039701 #1 9440:fbt:dup patch: ffffffffa0d712d9 cleanup_module 1.944093183 #1 9440:fbt:dup patch: ffffffffa0d6d7de cleanup_module 1.944110409 #1 9440:fbt:dup patch: ffffffffa0d6918e cleanup_module 1.944143803 #1 9440:fbt:dup patch: ffffffffa0d654a2 cleanup_module 1.944180796 #1 9440:fbt:dup patch: ffffffffa0d61472 cleanup_module 1.944193020 #1 9440:fbt:dup patch: ffffffffa0d5d0a9 cleanup_module 1.944214503 #1 9440:fbt:dup patch: ffffffffa0d59205 cleanup_module 1.944236313 #1 9440:fbt:dup patch: ffffffffa0d551c1 cleanup_module 1.944277131 #1 9440:fbt:dup patch: ffffffffa0d514ea cleanup_module 1.944292364 #1 9440:fbt:dup patch: ffffffffa0d4d0b5 cleanup_module 1.944395850 #1 9440:fbt:dup patch: ffffffffa0d47549 cleanup_module 1.944465104 #1 9440:fbt:dup patch: ffffffffa0d42252 cleanup_module 1.944479469 #1 9440:fbt:dup patch: ffffffffa0d3e071 cleanup_module 1.944491807 #1 9440:fbt:dup patch: ffffffffa0d3a071 cleanup_module 1.944529343 #1 9440:fbt:dup patch: ffffffffa0d362f5 cleanup_module 1.944544045 #1 9440:fbt:dup patch: ffffffffa0d32096 cleanup_module 1.944564615 #1 9440:fbt:dup patch: ffffffffa0d2e1e6 cleanup_module 1.944584047 #1 9440:fbt:dup patch: ffffffffa0d2a12d cleanup_module 1.944731892 #1 9440:fbt:dup patch: ffffffffa0d254cb cleanup_module 1.944766842 #1 9440:fbt:dup patch: ffffffffa0d202ea cleanup_module 1.944800185 #1 9440:fbt:dup patch: ffffffffa0d1c112 cleanup_module 1.944829544 #1 9440:fbt:dup patch: ffffffffa0d1837e cleanup_module 1.944883761 #1 9440:fbt:dup patch: ffffffffa0d1468a cleanup_module 1.944917488 #1 9440:fbt:dup patch: ffffffffa0d101f5 cleanup_module 1.944927490 #1 9440:fbt:dup patch: ffffffffa0d0c02a cleanup_module 1.944975542 #1 9440:fbt:dup patch: ffffffffa0d08556 cleanup_module 1.944994474 #1 9440:fbt:dup patch: ffffffffa0d040c5 cleanup_module 1.945025022 #1 9440:fbt:dup patch: ffffffffa0d00120 cleanup_module 1.945073341 #1 9440:fbt:dup patch: ffffffffa0cfc5aa cleanup_module 1.945144296 #1 9440:fbt:dup patch: ffffffffa0cf87d2 cleanup_module 1.945300334 #1 9440:fbt:dup patch: ffffffffa0cf1cf8 cleanup_module 1.945439236 #1 9440:fbt:dup patch: ffffffffa0cec1f0 cleanup_module 1.945506236 #1 9440:fbt:dup patch: ffffffffa0ce7913 cleanup_module 1.945573625 #1 9440:fbt:dup patch: ffffffffa0ce3130 cleanup_module 1.945906015 #1 9440:fbt:dup patch: ffffffffa0cdd375 cleanup_module 1.946060586 #1 9440:fbt:dup patch: ffffffffa0cca39e cleanup_module 1.946657283 #1 9440:fbt:dup patch: ffffffffa0c9e88a cleanup_module 1.946906072 #1 9440:fbt:dup patch: ffffffffa0c92a4a cleanup_module 1.950641575 #1 9440:fbt:dup patch: ffffffffa0c73f38 cleanup_module 1.953888136 #1 9440:fbt:dup patch: ffffffffa0c2d4c2 cleanup_module 1.960877076 #1 9440:fbt:dup patch: ffffffffa0bb55c2 cleanup_module 1.965110372 #1 9440:fbt:dup patch: ffffffffa0b46f02 cleanup_module 1.966179693 #1 9440:fbt:dup patch: ffffffffa0b3062d cleanup_module 1.966995011 #1 9440:fbt:dup patch: ffffffffa0b1bac1 cleanup_module 1.971934097 #1 9440:fbt:dup patch: ffffffffa0aa3108 cleanup_module 1.974890624 #1 9440:fbt:dup patch: ffffffffa0a5dc69 cleanup_module 1.975959439 #1 9440:fbt:dup patch: ffffffffa0a475b4 cleanup_module 1.976883592 #1 9440:fbt:dup patch: ffffffffa0a34e7d cleanup_module 1.976975633 #1 9440:fbt:dup patch: ffffffffa0a2db9d cleanup_module 1.977479351 #1 9440:fbt:dup patch: ffffffffa0a233a5 cleanup_module 1.977741661 #1 9440:fbt:dup patch: ffffffffa0a1aa5f cleanup_module 1.977762300 #1 9440:fbt:dup patch: ffffffffa0a161c3 cleanup_module 1.977880592 #1 9440:fbt:dup patch: ffffffffa09e6b9d cleanup_module 1.978010301 #1 9440:fbt:dup patch: ffffffffa09af092 cleanup_module 1.978017891 #1 9440:fbt:dup patch: ffffffffa09aef3f init_module 1.978020340 #1 9440:fbt:dup patch: ffffffffa09aefc5 init_module 1.978132002 #1 9440:fbt:dup patch: ffffffffa0989f07 cleanup_module 1.979393382 #1 9440:fbt:dup patch: ffffffffa084a77b cleanup_module 1.986511244 #1 9440:fbt:dup patch: ffffffffa03d67f5 cleanup_module 1.986570418 #1 9440:fbt:dup patch: ffffffffa03b63f5 cleanup_module 1.986966470 #1 9440:fbt:dup patch: ffffffffa03774c5 cleanup_module 1.987165541 #1 9440:fbt:dup patch: ffffffffa021b90d _key_expansion_256a 1.987925888 #1 9440:fbt:dup patch: ffffffffa023383b cleanup_module 1.988051397 #1 9440:fbt:dup patch: ffffffffa01ef75d cleanup_module 1.989247074 #1 9440:fbt:dup patch: ffffffffa01d600a cleanup_module 1.989304561 #1 9440:fbt:dup patch: ffffffffa01b3855 cleanup_module 1.989815743 #1 9440:fbt:dup patch: ffffffffa015705d cleanup_module 1.990089737 #1 9440:fbt:dup patch: ffffffffa0134ff9 cleanup_module 1.990770114 #1 9440:fbt:dup patch: ffffffffa0115e76 cleanup_module 1.991028598 #1 9440:fbt:dup patch: ffffffffa010f881 cleanup_module 1.991079165 #1 9440:fbt:dup patch: ffffffffa0102531 cleanup_module 1.993842291 #1 9440:fbt:dup patch: ffffffffa0099f6c cleanup_module 1.994074263 #1 9440:fbt:dup patch: ffffffffa008ca35 cleanup_module 1.994123185 #1 9440:fbt:dup patch: ffffffffa0088211 cleanup_module 1.994252113 #1 9440:fbt:dup patch: ffffffffa007b177 cleanup_module 1.994421080 #1 9440:fbt:dup patch: ffffffffa0071fc5 cleanup_module 1.997181758 #1 9440:fbt:dup patch: ffffffffa005740e cleanup_module 1.998210972 #1 9440:fbt:dup patch: ffffffffa0028765 cleanup_module 1.999143353 #1 9440:fbt:dup patch: ffffffffa00169cc cleanup_module 2.000291338 #1 9440:fbt:dup patch: ffffffffa0000081 cleanup_module 2.007079325 #1 9440:dtrace_linux.c:get_proc_addr: Failed to find 'sys32_clone' (warn=7) 2.014433409 #1 9440:dtrace_linux.c:get_proc_addr: Failed to find 'sys32_execve' (warn=8) 2.032398521 #1 9440:dtrace_linux.c:get_proc_addr: Failed to find 'save_rest' (warn=9) 3.179221407 #1 9440:vmem_create(dtrace_aggid_0) ffff8801111a76c0 4.072040885 #0 9440:teardown start xcalls=19 probes=0 4.072043534 #0 9440:teardown done 0.000002741 xcalls=20 probes=0 4.077767573 #5 9444:vmem_create(dtrace_aggid_0) ffff88018cc71720 4.082787113 #0 9444:teardown start xcalls=21 probes=0 4.082788596 #0 9444:teardown done 0.000001464 xcalls=22 probes=0 174.013040970 #7 9502:vmem_create(dtrace_aggid_0) ffff880037a62e40 174.155415591 #0 9502:teardown start xcalls=23 probes=0 174.155417462 #0 9502:teardown done 0.000001910 xcalls=24 probes=0 182.764790589 #7 9504:vmem_create(dtrace_aggid_0) ffff880037a625a0 182.901762746 #7 9504:teardown start xcalls=25 probes=0 182.901764609 #7 9504:teardown done 0.000001930 xcalls=26 probes=0 1175.466120765 #3 10785:vmem_create(dtrace_aggid_0) ffff8800bc37da20 1175.603801952 #3 10785:teardown start xcalls=27 probes=0 1175.603803914 #3 10785:teardown done 0.000002057 xcalls=28 probes=0 1223.080105908 #0 10805:vmem_create(dtrace_aggid_0) ffff88020f1afba0 1229.292237122 #6 10805:[cpu6] dtrace_linux_panic called. Dumping cpu stacks 1229.292366709 #6 10805:dtrace_linux_panic: finished 1229.292368130 #5 10673-This is CPU#5 1229.292540797 #4 26638-This is CPU#4 24.292540862 #2 0-This is CPU#2 1230.288047341 #0 10805:teardown start xcalls=134 probes=320904 1230.288070253 #0 10805:kmem_free t=0.000000102 (1) 1230.288073808 #0 10805:kmem_free t=0.000000175 (3) 1230.288075456 #0 10805:kmem_free t=0.000000348 (7) 1230.288102811 #0 10805:kmem_free t=0.000000373 (159) 1230.288131789 #0 10805:kmem_free t=0.000000420 (324) 1230.288187130 #0 10805:teardown done 0.000139729 xcalls=134 probes=0 1596.234721401 #5 10899:vmem_create(dtrace_aggid_0) ffff88012cd3a600 1596.424537792 #5 10899:teardown start xcalls=134 probes=1 1596.424638299 #5 10899:teardown done 0.000100594 xcalls=134 probes=0 1613.341404855 #5 10904:vmem_create(dtrace_aggid_0) ffff880100d878a0 1613.626268448 #6 10904:teardown start xcalls=134 probes=1 1613.626376857 #6 10904:kmem_free t=0.000000514 (1782) 1613.626416078 #6 10904:teardown done 0.000147596 xcalls=134 probes=0 1719.874009890 #3 10964:vmem_create(dtrace_aggid_0) ffff8800bc37d240 1720.067582464 #3 10964:teardown start xcalls=134 probes=1 1720.067682651 #3 10964:teardown done 0.000100093 xcalls=134 probes=0 1780.955353641 #1 10979:vmem_create(dtrace_aggid_0) ffff88001409c600 1781.145599312 #1 10979:teardown start xcalls=134 probes=1 1781.145687532 #1 10979:teardown done 0.000088161 xcalls=134 probes=0 1947.191688288 #1 11025:vmem_create(dtrace_aggid_0) ffff88002184ca80 1947.380021950 #1 11025:teardown start xcalls=134 probes=1 1947.380110862 #1 11025:teardown done 0.000088872 xcalls=134 probes=0 2106.215943491 #5 11057:vmem_create(dtrace_aggid_0) ffff880106fa3d20 2106.408716337 #4 11057:teardown start xcalls=134 probes=1 2106.408811359 #4 11057:teardown done 0.000094983 xcalls=134 probes=0 2178.065358434 #3 11074:vmem_create(dtrace_aggid_0) ffff880086c79e40 2178.230261062 #3 11074:teardown start xcalls=134 probes=1 2178.230264886 #3 11074:teardown done 0.000003844 xcalls=134 probes=0 2693.598103757 #1 11730:vmem_create(dtrace_aggid_0) ffff88002f8969c0 2693.761623422 #1 11730:teardown start xcalls=134 probes=1 2693.761631275 #1 11730:teardown done 0.000007577 xcalls=134 probes=0 2907.101936223 #1 11802:vmem_create(dtrace_aggid_0) ffff88002f896000 2907.305012552 #0 11802:teardown start xcalls=134 probes=1 2907.305184928 #0 11802:teardown done 0.000172142 xcalls=134 probes=0 3892.008815281 #5 12042:vmem_create(dtrace_aggid_0) ffff8801139ad9c0 3892.118977822 #5 12042:teardown start xcalls=134 probes=0 3892.118979917 #5 12042:teardown done 0.000002240 xcalls=134 probes=0 3989.884416993 #0 12070:vmem_create(dtrace_aggid_0) ffff8800a6fa44e0 3990.075608368 #0 12070:teardown start xcalls=134 probes=1 3990.075704843 #0 12070:teardown done 0.000096431 xcalls=134 probes=0 4065.799672953 #5 12104:vmem_create(dtrace_aggid_0) ffff8801139ad960 4065.919783633 #4 12104:teardown start xcalls=134 probes=0 4065.919785338 #4 12104:teardown done 0.000001783 xcalls=134 probes=0 4815.097468218 #5 12304:vmem_create(dtrace_aggid_0) ffff8801139ad7e0 4815.299634975 #1 12304:teardown start xcalls=134 probes=1 4815.299749009 #1 12304:kmem_free t=0.000005179 (6406) 4815.299770808 #1 12304:kmem_free t=0.000009590 (6466) 4815.299808033 #1 12304:teardown done 0.000173032 xcalls=134 probes=0 4987.303705969 #7 12331:vmem_create(dtrace_aggid_0) ffff8800100870c0 4987.503622510 #5 12331:teardown start xcalls=134 probes=1 4987.503720389 #5 12331:teardown done 0.000097815 xcalls=134 probes=0 #0 9425:4dtracedrv loaded: /dev/dtrace available, dtrace_here=0 nr_cpus=8 #0 9425:vmem_create(dtrace) ffff8801d9c475a0 #0 9425:vmem_create(dtrace_minor) ffff8801d9c474e0 #0 9425:__alloc_workqueue_key_ptr=ffffffff81065c30 #0 9425:dtrace_linux.c:get_proc_addr: Failed to find 'queue_delayed_work' (warn=1) #0 9425:dtrace_linux.c:get_proc_addr: Failed to find 'lockdep_init_map' (warn=2) #0 9425:queue_delayed_work_ptr=0000000000000000 #0 9425:destroy_workqueue_ptr=ffffffff810633d0 #0 9425:flush_workqueue_ptr=ffffffff81061b60 #0 9425:delayed_work_timer_fn_ptr=ffffffff81063210 #0 9425:ctf loaded: /dev/ctf now available #0 9418:dtrace_linux.c:get_proc_addr: Failed to find 'sysrq_showregs_othercpus' (warn=3) #0 9418:dtrace_linux.c:get_proc_addr: Failed to find 'xtime_cache' (warn=4) 0.000000000 #0 9418:profile loaded: /dev/dtrace_profile available 0.036411062 #0 9418:dtrace_linux.c:get_proc_addr: Failed to find 'tcp_event_data_sent' (warn=5) 0.036412021 #0 9418:prcom_add_function: cannot locate 'tcp_event_data_sent' 0.239416063 #0 9418:dtrace_linux.c:get_proc_addr: Failed to find 'xen_start_info' (warn=6) 0.239471835 #0 9418:dcpc.c:dcpc_attach:1333: TODO:please fill me in 0.239472280 #0 9418:dcpc initialised. 0.239539170 #0 9418:sdt loaded: /dev/sdt now available 0.239944537 #0 9418:ctl loaded: /dev/dtrace_ctl now available 0.241259341 #0 9418:dtrace_function_size: do_sync_read ffffffff81175f80 size=144 0.241260524 #0 9418:io_prov_entry called io:start 0.241264555 #0 9418:io_prov_return called io:start ffffffff81175fea sz=1 0.241266216 #0 9418:io_prov_return called io:start ffffffff81176006 sz=1 0.241938996 #0 9418:dtrace_function_size: do_sync_write ffffffff81176300 size=144 0.241939498 #0 9418:io_prov_entry called io:start 0.241942464 #0 9418:io_prov_return called io:start ffffffff8117636a sz=1 0.241943796 #0 9418:io_prov_return called io:start ffffffff81176386 sz=1 0.533992507 #0 9440:fbt:dup patch: ffffffff818469be error_sti 1.664905760 #1 9440:instr:dup patch: ffffffffa00740ab cleanup_module-callr 1.665254382 #1 9440:instr:dup patch: ffffffffa006be2f cleanup_module-callr 1.674877930 #1 9440:instr:dup patch: ffffffffa0264219 cleanup_module-callr 1.683695022 #1 9440:instr:dup patch: ffffffffa00e83fc cleanup_module-callr 1.686395870 #1 9440:instr:dup patch: ffffffffa0083a4b cleanup_module-callr 1.687905339 #1 9440:instr:dup patch: ffffffffa002474b cleanup_module-callr 1.690215271 #1 9440:instr:dup patch: ffffffffa00d0d4b cleanup_module-callr 1.693679117 #1 9440:instr:dup patch: ffffffffa002d7b7 cleanup_module-callr 1.694453633 #1 9440:instr:dup patch: ffffffffa006637c cleanup_module-callr 1.694779969 #1 9440:instr:dup patch: ffffffffa000207f cleanup_module-callr 1.695434956 #1 9440:instr:dup patch: ffffffffa0f62d4c cleanup_module-callr 1.695685350 #1 9440:instr:dup patch: ffffffffa0f5c83b cleanup_module-callr 1.695836732 #1 9440:instr:dup patch: ffffffffa0f5887f cleanup_module-callr 1.696346731 #1 9440:instr:dup patch: ffffffffa0f544f5 cleanup_module-callr 1.699285409 #1 9440:instr:dup patch: ffffffffa0f45a40 cleanup_module-callr 1.705773608 #1 9440:instr:dup patch: ffffffffa0f07183 cleanup_module-callr 1.708220029 #1 9440:instr:dup patch: ffffffffa0eefc1b cleanup_module-callr 1.708689437 #1 9440:instr:dup patch: ffffffffa0eea9ab cleanup_module-callr 1.708965148 #1 9440:instr:dup patch: ffffffffa0ee69e7 cleanup_module-callr 1.709312969 #1 9440:instr:dup patch: ffffffffa0ee24f4 cleanup_module-callr 1.709603995 #1 9440:instr:dup patch: ffffffffa0edcb4f cleanup_module-callr 1.710091290 #1 9440:instr:dup patch: ffffffffa0ed84df cleanup_module-callr 1.710457591 #1 9440:instr:dup patch: ffffffffa0ed3493 cleanup_module-callr 1.710714606 #1 9440:instr:dup patch: ffffffffa0ecdeab cleanup_module-callr 1.710947167 #1 9440:instr:dup patch: ffffffffa0ec89d7 cleanup_module-callr 1.711717750 #1 9440:instr:dup patch: ffffffffa0ec3003 cleanup_module-callr 1.712814935 #1 9440:instr:dup patch: ffffffffa0ebad9f cleanup_module-callr 1.712861479 #1 9440:instr:dup patch: ffffffffa0eb41a3 cleanup_module-callr 1.713285698 #1 9440:instr:dup patch: ffffffffa0eb0107 cleanup_module-callr 1.713317044 #1 9440:instr:dup patch: ffffffffa0eaa0ce cleanup_module-callr 1.714136098 #1 9440:instr:dup patch: ffffffffa0ea4dcd cleanup_module-callr 1.717790214 #1 9440:instr:dup patch: ffffffffa0e90317 cleanup_module-callr 1.720354953 #1 9440:instr:dup patch: ffffffffa0e78313 cleanup_module-callr 1.721326180 #1 9440:instr:dup patch: ffffffffa0e689ab cleanup_module-callr 1.721353611 #1 9440:instr:dup patch: ffffffffa0e6207b cleanup_module-callr 1.721433566 #1 9440:instr:dup patch: ffffffffa0e5e2ab cleanup_module-callr 1.721475707 #1 9440:instr:dup patch: ffffffffa0e5a103 cleanup_module-callr 1.721677228 #1 9440:instr:dup patch: ffffffffa0e566fc cleanup_module-callr 1.722252117 #1 9440:instr:dup patch: ffffffffa0e50c7b cleanup_module-callr 1.722455320 #1 9440:instr:dup patch: ffffffffa0e4aa53 cleanup_module-callr 1.722462429 #1 9440:instr:dup patch: ffffffffa0e46037 cleanup_module-callr 1.722589929 #1 9440:instr:dup patch: ffffffffa0e424b8 cleanup_module-callr 1.722596577 #1 9440:instr:dup patch: ffffffffa0e3e017 cleanup_module-callr 1.723006466 #1 9440:instr:dup patch: ffffffffa0e383d1 cleanup_module-callr 1.723037256 #1 9440:instr:dup patch: ffffffffa0e33154 cleanup_module-callr 1.723290095 #1 9440:instr:dup patch: ffffffffa0e2e9ef cleanup_module-je 1.723391960 #1 9440:instr:dup patch: ffffffffa0e2a547 cleanup_module-callr 1.723448699 #1 9440:instr:dup patch: ffffffffa0e2620b cleanup_module-callr 1.723510453 #1 9440:instr:dup patch: ffffffffa0e222c7 cleanup_module-callr 1.723930658 #1 9440:instr:dup patch: ffffffffa0e1dda3 cleanup_module-callr 1.723957022 #1 9440:instr:dup patch: ffffffffa0e190c3 cleanup_module-callr 1.724233676 #1 9440:instr:dup patch: ffffffffa0e1497c cleanup_module-callr 1.725198291 #1 9440:instr:dup patch: ffffffffa0e0b569 cleanup_module-callr 1.725597322 #1 9440:instr:dup patch: ffffffffa0e0407f cleanup_module-callr 1.726124565 #1 9440:instr:dup patch: ffffffffa0e00425 cleanup_module-callr 1.726144560 #1 9440:instr:dup patch: ffffffffa0dfb073 cleanup_module-callr 1.726578097 #1 9440:instr:dup patch: ffffffffa0df6a66 cleanup_module-callr 1.726673751 #1 9440:instr:dup patch: ffffffffa0df14c0 cleanup_module-callr 1.726717411 #1 9440:instr:dup patch: ffffffffa0ded164 cleanup_module-callr 1.726750844 #1 9440:instr:dup patch: ffffffffa0de9177 cleanup_module-callr 1.727108677 #1 9440:instr:dup patch: ffffffffa0de5046 cleanup_module-callr 1.727155693 #1 9440:instr:dup patch: ffffffffa0de029b cleanup_module-callr 1.727192379 #1 9440:instr:dup patch: ffffffffa0ddc137 cleanup_module-callr 1.727265473 #1 9440:instr:dup patch: ffffffffa0dd832f cleanup_module-callr 1.727350319 #1 9440:instr:dup patch: ffffffffa0dd43ea cleanup_module-callr 1.727436887 #1 9440:instr:dup patch: ffffffffa0dcf272 cleanup_module-je 1.727495037 #1 9440:instr:dup patch: ffffffffa0dca182 cleanup_module-je 1.728376784 #1 9440:instr:dup patch: ffffffffa0dc2cf6 cleanup_module-je 1.728805830 #1 9440:instr:dup patch: ffffffffa0dbb623 cleanup_module-callr 1.729177252 #1 9440:instr:dup patch: ffffffffa0db6033 cleanup_module-callr 1.729375118 #1 9440:instr:dup patch: ffffffffa0db0973 cleanup_module-callr 1.729584727 #1 9440:instr:dup patch: ffffffffa0dab933 cleanup_module-callr 1.731730693 #1 9440:instr:dup patch: ffffffffa0da591d cleanup_module-callr 1.731745364 #1 9440:instr:dup patch: ffffffffa0d9c01f cleanup_module-callr 1.731896700 #1 9440:instr:dup patch: ffffffffa0d93423 cleanup_module-je 1.733015686 #1 9440:instr:dup patch: ffffffffa0d82bab cleanup_module-callr 1.733325018 #1 9440:instr:dup patch: ffffffffa0d7ab58 cleanup_module-je 1.733597247 #1 9440:instr:dup patch: ffffffffa0d75b78 cleanup_module-callr 1.733662239 #1 9440:instr:dup patch: ffffffffa0d712d3 cleanup_module-callr 1.733832846 #1 9440:instr:dup patch: ffffffffa0d6d7d8 cleanup_module-callr 1.733875648 #1 9440:instr:dup patch: ffffffffa0d69188 cleanup_module-callr 1.733975676 #1 9440:instr:dup patch: ffffffffa0d6549c cleanup_module-callr 1.734076182 #1 9440:instr:dup patch: ffffffffa0d6146c cleanup_module-callr 1.734103176 #1 9440:instr:dup patch: ffffffffa0d5d0a3 cleanup_module-callr 1.734160512 #1 9440:instr:dup patch: ffffffffa0d591ff cleanup_module-callr 1.734201287 #1 9440:instr:dup patch: ffffffffa0d551bb cleanup_module-callr 1.734295664 #1 9440:instr:dup patch: ffffffffa0d514e4 cleanup_module-callr 1.734322600 #1 9440:instr:dup patch: ffffffffa0d4d0af cleanup_module-callr 1.734673307 #1 9440:instr:dup patch: ffffffffa0d4751f cleanup_module-callr 1.734992120 #1 9440:instr:dup patch: ffffffffa0d4224c cleanup_module-callr 1.735006459 #1 9440:instr:dup patch: ffffffffa0d3e05f cleanup_module-callr 1.735029156 #1 9440:instr:dup patch: ffffffffa0d3a06b cleanup_module-callr 1.735082251 #1 9440:instr:dup patch: ffffffffa0d362ef cleanup_module-callr 1.735099302 #1 9440:instr:dup patch: ffffffffa0d32090 cleanup_module-callr 1.735148445 #1 9440:instr:dup patch: ffffffffa0d2e1e0 cleanup_module-callr 1.735190853 #1 9440:instr:dup patch: ffffffffa0d2a127 cleanup_module-callr 1.735665586 #1 9440:instr:dup patch: ffffffffa0d254a8 cleanup_module-callr 1.735737358 #1 9440:instr:dup patch: ffffffffa0d202e4 cleanup_module-callr 1.735765935 #1 9440:instr:dup patch: ffffffffa0d1c10c cleanup_module-callr 1.735840541 #1 9440:instr:dup patch: ffffffffa0d1836c cleanup_module-callr 1.735959575 #1 9440:instr:dup patch: ffffffffa0d14684 cleanup_module-callr 1.736018493 #1 9440:instr:dup patch: ffffffffa0d101e3 cleanup_module-callr 1.736027647 #1 9440:instr:dup patch: ffffffffa0d0c024 cleanup_module-callr 1.736168885 #1 9440:instr:dup patch: ffffffffa0d08550 cleanup_module-callr 1.736204039 #1 9440:instr:dup patch: ffffffffa0d040bf cleanup_module-callr 1.736245524 #1 9440:instr:dup patch: ffffffffa0d0010e cleanup_module-callr 1.736394535 #1 9440:instr:dup patch: ffffffffa0cfc598 cleanup_module-callr 1.736543489 #1 9440:instr:dup patch: ffffffffa0cf87bb cleanup_module-callr 1.736896060 #1 9440:instr:dup patch: ffffffffa0cf1ca7 cleanup_module-callr 1.737254815 #1 9440:instr:dup patch: ffffffffa0cec1de cleanup_module-callr 1.737447970 #1 9440:instr:dup patch: ffffffffa0ce7901 cleanup_module-callr 1.737537815 #1 9440:instr:dup patch: ffffffffa0ce311e cleanup_module-callr 1.738642279 #1 9440:instr:dup patch: ffffffffa0cdd341 cleanup_module-callr 1.739302619 #1 9440:instr:dup patch: ffffffffa0cca367 cleanup_module-je 1.741471276 #1 9440:instr:dup patch: ffffffffa0c9e87f cleanup_module-callr 1.742376220 #1 9440:instr:dup patch: ffffffffa0c92a44 cleanup_module-callr 1.756915818 #1 9440:instr:dup patch: ffffffffa0c73f0d cleanup_module-callr 1.768695735 #1 9440:instr:dup patch: ffffffffa0c2d4b7 cleanup_module-callr 1.791819105 #1 9440:instr:dup patch: ffffffffa0bb55a8 cleanup_module-callr 1.806805004 #1 9440:instr:dup patch: ffffffffa0b46efc cleanup_module-callr 1.810351039 #1 9440:instr:dup patch: ffffffffa0b30627 cleanup_module-callr 1.813496804 #1 9440:instr:dup patch: ffffffffa0b1babb cleanup_module-callr 1.830847524 #1 9440:instr:dup patch: ffffffffa0aa30cf cleanup_module-callr 1.842210495 #1 9440:instr:dup patch: ffffffffa0a5dc63 cleanup_module-callr 1.845918303 #1 9440:instr:dup patch: ffffffffa0a47598 cleanup_module-callr 1.849259744 #1 9440:instr:dup patch: ffffffffa0a34e77 cleanup_module-callr 1.849517819 #1 9440:instr:dup patch: ffffffffa0a2db73 cleanup_module-callr 1.851102051 #1 9440:instr:dup patch: ffffffffa0a2339f cleanup_module-callr 1.851887549 #1 9440:instr:dup patch: ffffffffa0a1aa4b cleanup_module-callr 1.851915007 #1 9440:instr:dup patch: ffffffffa0a161bd cleanup_module-callr 1.852289452 #1 9440:instr:dup patch: ffffffffa09e6a8e cleanup_module-callr 1.852651366 #1 9440:instr:dup patch: ffffffffa09af04b cleanup_module-callr 1.852995150 #1 9440:instr:dup patch: ffffffffa0989e73 cleanup_module-callr 1.857312481 #1 9440:instr:dup patch: ffffffffa084a6fe cleanup_module-callr 1.879496238 #1 9440:instr:dup patch: ffffffffa03d67ef cleanup_module-callr 1.879610467 #1 9440:instr:dup patch: ffffffffa03b63ef cleanup_module-callr 1.879937872 #1 9440:instr:dup patch: ffffffffa03774bf cleanup_module-callr 1.882126194 #1 9440:instr:dup patch: ffffffffa0233830 cleanup_module-callr 1.882390093 #1 9440:instr:dup patch: ffffffffa01ef757 cleanup_module-callr 1.886362502 #1 9440:instr:dup patch: ffffffffa01d5eec cleanup_module-je 1.886474714 #1 9440:instr:dup patch: ffffffffa01b384f cleanup_module-callr 1.887883154 #1 9440:instr:dup patch: ffffffffa0157057 cleanup_module-callr 1.888420663 #1 9440:instr:dup patch: ffffffffa0134fe7 cleanup_module-callr 1.890478366 #1 9440:instr:dup patch: ffffffffa0115e58 cleanup_module-callr 1.891410269 #1 9440:instr:dup patch: ffffffffa010f87b cleanup_module-callr 1.891527728 #1 9440:instr:dup patch: ffffffffa010252b cleanup_module-callr 1.899905364 #1 9440:instr:dup patch: ffffffffa0099f33 cleanup_module-je 1.900722452 #1 9440:instr:dup patch: ffffffffa008ca2f cleanup_module-callr 1.900812674 #1 9440:instr:dup patch: ffffffffa008820b cleanup_module-callr 1.901240050 #1 9440:instr:dup patch: ffffffffa007b157 cleanup_module-callr 1.901832458 #1 9440:instr:dup patch: ffffffffa0071fa7 cleanup_module-callr 1.911632782 #1 9440:instr:dup patch: ffffffffa0057408 cleanup_module-callr 1.915484457 #1 9440:instr:dup patch: ffffffffa002875f cleanup_module-callr 1.918652350 #1 9440:instr:dup patch: ffffffffa00169c1 cleanup_module-callr 1.922723083 #1 9440:instr:dup patch: ffffffffa000007b cleanup_module-callr 1.923897013 #1 9440:fbt:dup patch: ffffffffa00740b1 cleanup_module 1.924008134 #1 9440:fbt:dup patch: ffffffffa006be59 cleanup_module 1.926836322 #1 9440:fbt:dup patch: ffffffffa0264267 cleanup_module 1.929286472 #1 9440:fbt:dup patch: ffffffffa00e8416 cleanup_module 1.930099200 #1 9440:fbt:dup patch: ffffffffa0083a73 cleanup_module 1.930537258 #1 9440:fbt:dup patch: ffffffffa002475d cleanup_module 1.931143645 #1 9440:fbt:dup patch: ffffffffa00d0d69 cleanup_module 1.932229995 #1 9440:fbt:dup patch: ffffffffa002d7c8 cleanup_module 1.932445341 #1 9440:fbt:dup patch: ffffffffa0066468 cleanup_module 1.932536177 #1 9440:fbt:dup patch: ffffffffa0002085 cleanup_module 1.932707688 #1 9440:fbt:dup patch: ffffffffa0f62d87 cleanup_module 1.932805024 #1 9440:fbt:dup patch: ffffffffa0f5c841 cleanup_module 1.932867824 #1 9440:fbt:dup patch: ffffffffa0f58891 cleanup_module 1.933005721 #1 9440:fbt:dup patch: ffffffffa0f54513 cleanup_module 1.933799445 #1 9440:fbt:dup patch: ffffffffa0f45a4b cleanup_module 1.935725141 #1 9440:fbt:dup patch: ffffffffa0f07198 cleanup_module 1.936436940 #1 9440:fbt:dup patch: ffffffffa0eefc31 cleanup_module 1.936577390 #1 9440:fbt:dup patch: ffffffffa0eea9b1 cleanup_module 1.936647389 #1 9440:fbt:dup patch: ffffffffa0ee69ed cleanup_module 1.936760253 #1 9440:fbt:dup patch: ffffffffa0ee24fa cleanup_module 1.936841023 #1 9440:fbt:dup patch: ffffffffa0edcb55 cleanup_module 1.936960336 #1 9440:fbt:dup patch: ffffffffa0ed84e5 cleanup_module 1.937100377 #1 9440:fbt:dup patch: ffffffffa0ed3499 cleanup_module 1.937190648 #1 9440:fbt:dup patch: ffffffffa0ecdeb1 cleanup_module 1.937270358 #1 9440:fbt:dup patch: ffffffffa0ec89dd cleanup_module 1.937500337 #1 9440:fbt:dup patch: ffffffffa0ec3009 cleanup_module 1.937746694 #1 9440:fbt:dup patch: ffffffffa0ebada5 cleanup_module 1.937774796 #1 9440:fbt:dup patch: ffffffffa0eb41a9 cleanup_module 1.937957692 #1 9440:fbt:dup patch: ffffffffa0eb010d cleanup_module 1.937972663 #1 9440:fbt:dup patch: ffffffffa0eaa0e0 cleanup_module 1.938189386 #1 9440:fbt:dup patch: ffffffffa0ea4df0 cleanup_module 1.939442356 #1 9440:fbt:dup patch: ffffffffa0e90350 cleanup_module 1.940145161 #1 9440:fbt:dup patch: ffffffffa0e78319 cleanup_module 1.940375821 #1 9440:fbt:dup patch: ffffffffa0e689b1 cleanup_module 1.940388211 #1 9440:fbt:dup patch: ffffffffa0e62081 cleanup_module 1.940411529 #1 9440:fbt:dup patch: ffffffffa0e5e2b1 cleanup_module 1.940431036 #1 9440:fbt:dup patch: ffffffffa0e5a109 cleanup_module 1.940491137 #1 9440:fbt:dup patch: ffffffffa0e5670e cleanup_module 1.940648743 #1 9440:fbt:dup patch: ffffffffa0e50caa cleanup_module 1.940718193 #1 9440:fbt:dup patch: ffffffffa0e4aa71 cleanup_module 1.940727621 #1 9440:fbt:dup patch: ffffffffa0e4603d cleanup_module 1.940762971 #1 9440:fbt:dup patch: ffffffffa0e424be cleanup_module 1.940772165 #1 9440:fbt:dup patch: ffffffffa0e3e01d cleanup_module 1.940911798 #1 9440:fbt:dup patch: ffffffffa0e383e3 cleanup_module 1.940932780 #1 9440:fbt:dup patch: ffffffffa0e3315a cleanup_module 1.941004977 #1 9440:fbt:dup patch: ffffffffa0e2ea16 cleanup_module 1.941041036 #1 9440:fbt:dup patch: ffffffffa0e2a54d cleanup_module 1.941070949 #1 9440:fbt:dup patch: ffffffffa0e26229 cleanup_module 1.941093864 #1 9440:fbt:dup patch: ffffffffa0e222cd cleanup_module 1.941198227 #1 9440:fbt:dup patch: ffffffffa0e1ddd2 cleanup_module 1.941211731 #1 9440:fbt:dup patch: ffffffffa0e190c9 cleanup_module 1.941293823 #1 9440:fbt:dup patch: ffffffffa0e14993 cleanup_module 1.941550072 #1 9440:fbt:dup patch: ffffffffa0e0b587 cleanup_module 1.941656026 #1 9440:fbt:dup patch: ffffffffa0e04085 cleanup_module 1.941778191 #1 9440:fbt:dup patch: ffffffffa0e0042b cleanup_module 1.941788349 #1 9440:fbt:dup patch: ffffffffa0dfb079 cleanup_module 1.941940246 #1 9440:fbt:dup patch: ffffffffa0df6a71 cleanup_module 1.941977502 #1 9440:fbt:dup patch: ffffffffa0df14c6 cleanup_module 1.941996507 #1 9440:fbt:dup patch: ffffffffa0ded16a cleanup_module 1.942015672 #1 9440:fbt:dup patch: ffffffffa0de917d cleanup_module 1.942124570 #1 9440:fbt:dup patch: ffffffffa0de505d cleanup_module 1.942146960 #1 9440:fbt:dup patch: ffffffffa0de02a1 cleanup_module 1.942161865 #1 9440:fbt:dup patch: ffffffffa0ddc13d cleanup_module 1.942197974 #1 9440:fbt:dup patch: ffffffffa0dd8335 cleanup_module 1.942224881 #1 9440:fbt:dup patch: ffffffffa0dd4417 cleanup_module 1.942246292 #1 9440:fbt:dup patch: ffffffffa0dcf2b8 cleanup_module 1.942262153 #1 9440:fbt:dup patch: ffffffffa0dca1bc cleanup_module 1.942525912 #1 9440:fbt:dup patch: ffffffffa0dc2d57 cleanup_module 1.942652860 #1 9440:fbt:dup patch: ffffffffa0dbb641 cleanup_module 1.942774483 #1 9440:fbt:dup patch: ffffffffa0db6051 cleanup_module 1.942834877 #1 9440:fbt:dup patch: ffffffffa0db0979 cleanup_module 1.942903939 #1 9440:fbt:dup patch: ffffffffa0dab945 cleanup_module 1.943456010 #1 9440:fbt:dup patch: ffffffffa0da5952 cleanup_module 1.943467015 #1 9440:fbt:dup patch: ffffffffa0d9c025 cleanup_module 1.943510641 #1 9440:fbt:dup patch: ffffffffa0d9345c cleanup_module 1.943838361 #1 9440:fbt:dup patch: ffffffffa0d82bed cleanup_module 1.943944203 #1 9440:fbt:dup patch: ffffffffa0d7abc2 cleanup_module 1.944016102 #1 9440:fbt:dup patch: ffffffffa0d75b7e cleanup_module 1.944039701 #1 9440:fbt:dup patch: ffffffffa0d712d9 cleanup_module 1.944093183 #1 9440:fbt:dup patch: ffffffffa0d6d7de cleanup_module 1.944110409 #1 9440:fbt:dup patch: ffffffffa0d6918e cleanup_module 1.944143803 #1 9440:fbt:dup patch: ffffffffa0d654a2 cleanup_module 1.944180796 #1 9440:fbt:dup patch: ffffffffa0d61472 cleanup_module 1.944193020 #1 9440:fbt:dup patch: ffffffffa0d5d0a9 cleanup_module 1.944214503 #1 9440:fbt:dup patch: ffffffffa0d59205 cleanup_module 1.944236313 #1 9440:fbt:dup patch: ffffffffa0d551c1 cleanup_module 1.944277131 #1 9440:fbt:dup patch: ffffffffa0d514ea cleanup_module 1.944292364 #1 9440:fbt:dup patch: ffffffffa0d4d0b5 cleanup_module 1.944395850 #1 9440:fbt:dup patch: ffffffffa0d47549 cleanup_module 1.944465104 #1 9440:fbt:dup patch: ffffffffa0d42252 cleanup_module 1.944479469 #1 9440:fbt:dup patch: ffffffffa0d3e071 cleanup_module 1.944491807 #1 9440:fbt:dup patch: ffffffffa0d3a071 cleanup_module 1.944529343 #1 9440:fbt:dup patch: ffffffffa0d362f5 cleanup_module 1.944544045 #1 9440:fbt:dup patch: ffffffffa0d32096 cleanup_module 1.944564615 #1 9440:fbt:dup patch: ffffffffa0d2e1e6 cleanup_module 1.944584047 #1 9440:fbt:dup patch: ffffffffa0d2a12d cleanup_module 1.944731892 #1 9440:fbt:dup patch: ffffffffa0d254cb cleanup_module 1.944766842 #1 9440:fbt:dup patch: ffffffffa0d202ea cleanup_module 1.944800185 #1 9440:fbt:dup patch: ffffffffa0d1c112 cleanup_module 1.944829544 #1 9440:fbt:dup patch: ffffffffa0d1837e cleanup_module 1.944883761 #1 9440:fbt:dup patch: ffffffffa0d1468a cleanup_module 1.944917488 #1 9440:fbt:dup patch: ffffffffa0d101f5 cleanup_module 1.944927490 #1 9440:fbt:dup patch: ffffffffa0d0c02a cleanup_module 1.944975542 #1 9440:fbt:dup patch: ffffffffa0d08556 cleanup_module 1.944994474 #1 9440:fbt:dup patch: ffffffffa0d040c5 cleanup_module 1.945025022 #1 9440:fbt:dup patch: ffffffffa0d00120 cleanup_module 1.945073341 #1 9440:fbt:dup patch: ffffffffa0cfc5aa cleanup_module 1.945144296 #1 9440:fbt:dup patch: ffffffffa0cf87d2 cleanup_module 1.945300334 #1 9440:fbt:dup patch: ffffffffa0cf1cf8 cleanup_module 1.945439236 #1 9440:fbt:dup patch: ffffffffa0cec1f0 cleanup_module 1.945506236 #1 9440:fbt:dup patch: ffffffffa0ce7913 cleanup_module 1.945573625 #1 9440:fbt:dup patch: ffffffffa0ce3130 cleanup_module 1.945906015 #1 9440:fbt:dup patch: ffffffffa0cdd375 cleanup_module 1.946060586 #1 9440:fbt:dup patch: ffffffffa0cca39e cleanup_module 1.946657283 #1 9440:fbt:dup patch: ffffffffa0c9e88a cleanup_module 1.946906072 #1 9440:fbt:dup patch: ffffffffa0c92a4a cleanup_module 1.950641575 #1 9440:fbt:dup patch: ffffffffa0c73f38 cleanup_module 1.953888136 #1 9440:fbt:dup patch: ffffffffa0c2d4c2 cleanup_module 1.960877076 #1 9440:fbt:dup patch: ffffffffa0bb55c2 cleanup_module 1.965110372 #1 9440:fbt:dup patch: ffffffffa0b46f02 cleanup_module 1.966179693 #1 9440:fbt:dup patch: ffffffffa0b3062d cleanup_module 1.966995011 #1 9440:fbt:dup patch: ffffffffa0b1bac1 cleanup_module 1.971934097 #1 9440:fbt:dup patch: ffffffffa0aa3108 cleanup_module 1.974890624 #1 9440:fbt:dup patch: ffffffffa0a5dc69 cleanup_module 1.975959439 #1 9440:fbt:dup patch: ffffffffa0a475b4 cleanup_module 1.976883592 #1 9440:fbt:dup patch: ffffffffa0a34e7d cleanup_module 1.976975633 #1 9440:fbt:dup patch: ffffffffa0a2db9d cleanup_module 1.977479351 #1 9440:fbt:dup patch: ffffffffa0a233a5 cleanup_module 1.977741661 #1 9440:fbt:dup patch: ffffffffa0a1aa5f cleanup_module 1.977762300 #1 9440:fbt:dup patch: ffffffffa0a161c3 cleanup_module 1.977880592 #1 9440:fbt:dup patch: ffffffffa09e6b9d cleanup_module 1.978010301 #1 9440:fbt:dup patch: ffffffffa09af092 cleanup_module 1.978017891 #1 9440:fbt:dup patch: ffffffffa09aef3f init_module 1.978020340 #1 9440:fbt:dup patch: ffffffffa09aefc5 init_module 1.978132002 #1 9440:fbt:dup patch: ffffffffa0989f07 cleanup_module 1.979393382 #1 9440:fbt:dup patch: ffffffffa084a77b cleanup_module 1.986511244 #1 9440:fbt:dup patch: ffffffffa03d67f5 cleanup_module 1.986570418 #1 9440:fbt:dup patch: ffffffffa03b63f5 cleanup_module 1.986966470 #1 9440:fbt:dup patch: ffffffffa03774c5 cleanup_module 1.987165541 #1 9440:fbt:dup patch: ffffffffa021b90d _key_expansion_256a 1.987925888 #1 9440:fbt:dup patch: ffffffffa023383b cleanup_module 1.988051397 #1 9440:fbt:dup patch: ffffffffa01ef75d cleanup_module 1.989247074 #1 9440:fbt:dup patch: ffffffffa01d600a cleanup_module 1.989304561 #1 9440:fbt:dup patch: ffffffffa01b3855 cleanup_module 1.989815743 #1 9440:fbt:dup patch: ffffffffa015705d cleanup_module 1.990089737 #1 9440:fbt:dup patch: ffffffffa0134ff9 cleanup_module 1.990770114 #1 9440:fbt:dup patch: ffffffffa0115e76 cleanup_module 1.991028598 #1 9440:fbt:dup patch: ffffffffa010f881 cleanup_module 1.991079165 #1 9440:fbt:dup patch: ffffffffa0102531 cleanup_module 1.993842291 #1 9440:fbt:dup patch: ffffffffa0099f6c cleanup_module 1.994074263 #1 9440:fbt:dup patch: ffffffffa008ca35 cleanup_module 1.994123185 #1 9440:fbt:dup patch: ffffffffa0088211 cleanup_module 1.994252113 #1 9440:fbt:dup patch: ffffffffa007b177 cleanup_module 1.994421080 #1 9440:fbt:dup patch: ffffffffa0071fc5 cleanup_module 1.997181758 #1 9440:fbt:dup patch: ffffffffa005740e cleanup_module 1.998210972 #1 9440:fbt:dup patch: ffffffffa0028765 cleanup_module 1.999143353 #1 9440:fbt:dup patch: ffffffffa00169cc cleanup_module 2.000291338 #1 9440:fbt:dup patch: ffffffffa0000081 cleanup_module 2.007079325 #1 9440:dtrace_linux.c:get_proc_addr: Failed to find 'sys32_clone' (warn=7) 2.014433409 #1 9440:dtrace_linux.c:get_proc_addr: Failed to find 'sys32_execve' (warn=8) 2.032398521 #1 9440:dtrace_linux.c:get_proc_addr: Failed to find 'save_rest' (warn=9) 3.179221407 #1 9440:vmem_create(dtrace_aggid_0) ffff8801111a76c0 4.072040885 #0 9440:teardown start xcalls=19 probes=0 4.072043534 #0 9440:teardown done 0.000002741 xcalls=20 probes=0 4.077767573 #5 9444:vmem_create(dtrace_aggid_0) ffff88018cc71720 4.082787113 #0 9444:teardown start xcalls=21 probes=0 4.082788596 #0 9444:teardown done 0.000001464 xcalls=22 probes=0 174.013040970 #7 9502:vmem_create(dtrace_aggid_0) ffff880037a62e40 174.155415591 #0 9502:teardown start xcalls=23 probes=0 174.155417462 #0 9502:teardown done 0.000001910 xcalls=24 probes=0 182.764790589 #7 9504:vmem_create(dtrace_aggid_0) ffff880037a625a0 182.901762746 #7 9504:teardown start xcalls=25 probes=0 182.901764609 #7 9504:teardown done 0.000001930 xcalls=26 probes=0 1175.466120765 #3 10785:vmem_create(dtrace_aggid_0) ffff8800bc37da20 1175.603801952 #3 10785:teardown start xcalls=27 probes=0 1175.603803914 #3 10785:teardown done 0.000002057 xcalls=28 probes=0 1223.080105908 #0 10805:vmem_create(dtrace_aggid_0) ffff88020f1afba0 1229.292237122 #6 10805:[cpu6] dtrace_linux_panic called. Dumping cpu stacks 1229.292366709 #6 10805:dtrace_linux_panic: finished 1229.292368130 #5 10673-This is CPU#5 1229.292540797 #4 26638-This is CPU#4 24.292540862 #2 0-This is CPU#2 1230.288047341 #0 10805:teardown start xcalls=134 probes=320904 1230.288070253 #0 10805:kmem_free t=0.000000102 (1) 1230.288073808 #0 10805:kmem_free t=0.000000175 (3) 1230.288075456 #0 10805:kmem_free t=0.000000348 (7) 1230.288102811 #0 10805:kmem_free t=0.000000373 (159) 1230.288131789 #0 10805:kmem_free t=0.000000420 (324) 1230.288187130 #0 10805:teardown done 0.000139729 xcalls=134 probes=0 1596.234721401 #5 10899:vmem_create(dtrace_aggid_0) ffff88012cd3a600 1596.424537792 #5 10899:teardown start xcalls=134 probes=1 1596.424638299 #5 10899:teardown done 0.000100594 xcalls=134 probes=0 1613.341404855 #5 10904:vmem_create(dtrace_aggid_0) ffff880100d878a0 1613.626268448 #6 10904:teardown start xcalls=134 probes=1 1613.626376857 #6 10904:kmem_free t=0.000000514 (1782) 1613.626416078 #6 10904:teardown done 0.000147596 xcalls=134 probes=0 1719.874009890 #3 10964:vmem_create(dtrace_aggid_0) ffff8800bc37d240 1720.067582464 #3 10964:teardown start xcalls=134 probes=1 1720.067682651 #3 10964:teardown done 0.000100093 xcalls=134 probes=0 1780.955353641 #1 10979:vmem_create(dtrace_aggid_0) ffff88001409c600 1781.145599312 #1 10979:teardown start xcalls=134 probes=1 1781.145687532 #1 10979:teardown done 0.000088161 xcalls=134 probes=0 1947.191688288 #1 11025:vmem_create(dtrace_aggid_0) ffff88002184ca80 1947.380021950 #1 11025:teardown start xcalls=134 probes=1 1947.380110862 #1 11025:teardown done 0.000088872 xcalls=134 probes=0 2106.215943491 #5 11057:vmem_create(dtrace_aggid_0) ffff880106fa3d20 2106.408716337 #4 11057:teardown start xcalls=134 probes=1 2106.408811359 #4 11057:teardown done 0.000094983 xcalls=134 probes=0 2178.065358434 #3 11074:vmem_create(dtrace_aggid_0) ffff880086c79e40 2178.230261062 #3 11074:teardown start xcalls=134 probes=1 2178.230264886 #3 11074:teardown done 0.000003844 xcalls=134 probes=0 2693.598103757 #1 11730:vmem_create(dtrace_aggid_0) ffff88002f8969c0 2693.761623422 #1 11730:teardown start xcalls=134 probes=1 2693.761631275 #1 11730:teardown done 0.000007577 xcalls=134 probes=0 2907.101936223 #1 11802:vmem_create(dtrace_aggid_0) ffff88002f896000 2907.305012552 #0 11802:teardown start xcalls=134 probes=1 2907.305184928 #0 11802:teardown done 0.000172142 xcalls=134 probes=0 3892.008815281 #5 12042:vmem_create(dtrace_aggid_0) ffff8801139ad9c0 3892.118977822 #5 12042:teardown start xcalls=134 probes=0 3892.118979917 #5 12042:teardown done 0.000002240 xcalls=134 probes=0 3989.884416993 #0 12070:vmem_create(dtrace_aggid_0) ffff8800a6fa44e0 3990.075608368 #0 12070:teardown start xcalls=134 probes=1 3990.075704843 #0 12070:teardown done 0.000096431 xcalls=134 probes=0 4065.799672953 #5 12104:vmem_create(dtrace_aggid_0) ffff8801139ad960 4065.919783633 #4 12104:teardown start xcalls=134 probes=0 4065.919785338 #4 12104:teardown done 0.000001783 xcalls=134 probes=0 4815.097468218 #5 12304:vmem_create(dtrace_aggid_0) ffff8801139ad7e0 4815.299634975 #1 12304:teardown start xcalls=134 probes=1 4815.299749009 #1 12304:kmem_free t=0.000005179 (6406) 4815.299770808 #1 12304:kmem_free t=0.000009590 (6466) 4815.299808033 #1 12304:teardown done 0.000173032 xcalls=134 probes=0 4987.303705969 #7 12331:vmem_create(dtrace_aggid_0) ffff8800100870c0 4987.503622510 #5 12331:teardown start xcalls=134 probes=1 4987.503720389 #5 12331:teardown done 0.000097815 xcalls=134 probes=0 I have no idea about what is going on and would appreciate any hints.
dtrace4linux commented 10 years ago

I cant say at present - I will need to look and reproduce - I presume the PID provider did something wrong - hopefully this is a generic linux issue and not a linux 3.15 specific issue. dtrace -c was supposed to work but it needs more work.

Having spent some time on my strace replacement (ptrace - its documented on my blog), the whole ptrace() semantics for launching a child process is very different from Solaris; but we shouldnt be crashing the kernel.

Will take a look in the next few days (maybe at the weekend).

On 17 September 2014 20:47, lukas999 notifications@github.com wrote:

Hello, I experience similar problem: dtrace -c 'ls' -n 'syscall:::entry /pid == $target/ {@[probefunc] = count();}'

parent: waiting for child parent: after waitpid pid=12305 status=137f rd_loadobj_iter rd_loadobj_iter: /lib64/libc-2.19.so 0x7fdcc0383000 rd_loadobj_iter: /lib64/libdl-2.19.so 0x7fdcc0729000 rd_loadobj_iter: /usr/lib64/libelf-0.158.so 0x7fdcc092d000 rd_loadobj_iter: /lib64/libpthread-2.19.so 0x7fdcc0b43000 rd_loadobj_iter: /lib64/librt-2.19.so 0x7fdcc0d61000 rd_loadobj_iter: /lib64/ld-2.19.so 0x7fdcc117f000 proc-stub:rd_event_enable proc-stub:rd_event_addr addr=(nil) proc-stub:rd_event_addr addr=(nil) proc-stub:rd_event_addr addr=(nil) dtrace: description 'syscall:::entry ' matched 661 probes dtrace: processing aborted: No such device PTRACE_TRACEME: Operation not permitted child 12305 about to exec ls

on Gentoo distribution, kernel version 3.15.2 from Gentoo sources cat /proc/dtrace/trace

0 9425:4dtracedrv loaded: /dev/dtrace available, dtrace_here=0 nr_cpus=8

0 9425:vmem_create(dtrace) ffff8801d9c475a0

0 9425:vmem_create(dtrace_minor) ffff8801d9c474e0

0 9425:__alloc_workqueue_key_ptr=ffffffff81065c30

0 9425:dtrace_linux.c:get_proc_addr: Failed to find 'queue_delayed_work'

(warn=1)

0 9425:dtrace_linux.c:get_proc_addr: Failed to find 'lockdep_init_map'

(warn=2)

0 9425:queue_delayed_work_ptr=0000000000000000

0 9425:destroy_workqueue_ptr=ffffffff810633d0

0 9425:flush_workqueue_ptr=ffffffff81061b60

0 9425:delayed_work_timer_fn_ptr=ffffffff81063210

0 9425:ctf loaded: /dev/ctf now available

0 9418:dtrace_linux.c:get_proc_addr: Failed to find

'sysrq_showregs_othercpus' (warn=3)

0 9418:dtrace_linux.c:get_proc_addr: Failed to find 'xtime_cache' (warn=4)

0.000000000 #0 9418:profile loaded: /dev/dtrace_profile available 0.036411062 #0 9418:dtrace_linux.c:get_proc_addr: Failed to find 'tcp_event_data_sent' (warn=5) 0.036412021 #0 9418:prcom_add_function: cannot locate 'tcp_event_data_sent' 0.239416063 #0 9418:dtrace_linux.c:get_proc_addr: Failed to find 'xen_start_info' (warn=6) 0.239471835 #0 9418:dcpc.c:dcpc_attach:1333: TODO:please fill me in 0.239472280 #0 9418:dcpc initialised. 0.239539170 #0 9418:sdt loaded: /dev/sdt now available 0.239944537 #0 9418:ctl loaded: /dev/dtrace_ctl now available 0.241259341 #0 9418:dtrace_function_size: do_sync_read ffffffff81175f80 size=144 0.241260524 #0 9418:io_prov_entry called io:start 0.241264555 #0 9418:io_prov_return called io:start ffffffff81175fea sz=1 0.241266216 #0 9418:io_prov_return called io:start ffffffff81176006 sz=1 0.241938996 #0 9418:dtrace_function_size: do_sync_write ffffffff81176300 size=144 0.241939498 #0 9418:io_prov_entry called io:start 0.241942464 #0 9418:io_prov_return called io:start ffffffff8117636a sz=1 0.241943796 #0 9418:io_prov_return called io:start ffffffff81176386 sz=1 0.533992507 #0 9440:fbt:dup patch: ffffffff818469be error_sti 1.664905760 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa00740ab cleanup_module-callr 1.665254382 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa006be2f cleanup_module-callr 1.674877930 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0264219 cleanup_module-callr 1.683695022 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa00e83fc cleanup_module-callr 1.686395870 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0083a4b cleanup_module-callr 1.687905339 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa002474b cleanup_module-callr 1.690215271 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa00d0d4b cleanup_module-callr 1.693679117 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa002d7b7 cleanup_module-callr 1.694453633 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa006637c cleanup_module-callr 1.694779969 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa000207f cleanup_module-callr 1.695434956 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0f62d4c cleanup_module-callr 1.695685350 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0f5c83b cleanup_module-callr 1.695836732 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0f5887f cleanup_module-callr 1.696346731 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0f544f5 cleanup_module-callr 1.699285409 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0f45a40 cleanup_module-callr 1.705773608 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0f07183 cleanup_module-callr 1.708220029 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0eefc1b cleanup_module-callr 1.708689437 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0eea9ab cleanup_module-callr 1.708965148 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0ee69e7 cleanup_module-callr 1.709312969 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0ee24f4 cleanup_module-callr 1.709603995 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0edcb4f cleanup_module-callr 1.710091290 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0ed84df cleanup_module-callr 1.710457591 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0ed3493 cleanup_module-callr 1.710714606 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0ecdeab cleanup_module-callr 1.710947167 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0ec89d7 cleanup_module-callr 1.711717750 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0ec3003 cleanup_module-callr 1.712814935 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0ebad9f cleanup_module-callr 1.712861479 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0eb41a3 cleanup_module-callr 1.713285698 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0eb0107 cleanup_module-callr 1.713317044 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0eaa0ce cleanup_module-callr 1.714136098 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0ea4dcd cleanup_module-callr 1.717790214 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e90317 cleanup_module-callr 1.720354953 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e78313 cleanup_module-callr 1.721326180 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e689ab cleanup_module-callr 1.721353611 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e6207b cleanup_module-callr 1.721433566 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e5e2ab cleanup_module-callr 1.721475707 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e5a103 cleanup_module-callr 1.721677228 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e566fc cleanup_module-callr 1.722252117 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e50c7b cleanup_module-callr 1.722455320 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e4aa53 cleanup_module-callr 1.722462429 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e46037 cleanup_module-callr 1.722589929 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e424b8 cleanup_module-callr 1.722596577 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e3e017 cleanup_module-callr 1.723006466 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e383d1 cleanup_module-callr 1.723037256 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e33154 cleanup_module-callr 1.723290095 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e2e9ef cleanup_module-je 1.723391960 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e2a547 cleanup_module-callr 1.723448699 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e2620b cleanup_module-callr 1.723510453 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e222c7 cleanup_module-callr 1.723930658 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e1dda3 cleanup_module-callr 1.723957022 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e190c3 cleanup_module-callr 1.724233676 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e1497c cleanup_module-callr 1.725198291 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e0b569 cleanup_module-callr 1.725597322 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e0407f cleanup_module-callr 1.726124565 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e00425 cleanup_module-callr 1.726144560 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0dfb073 cleanup_module-callr 1.726578097 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0df6a66 cleanup_module-callr 1.726673751 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0df14c0 cleanup_module-callr 1.726717411 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0ded164 cleanup_module-callr 1.726750844 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0de9177 cleanup_module-callr 1.727108677 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0de5046 cleanup_module-callr 1.727155693 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0de029b cleanup_module-callr 1.727192379 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0ddc137 cleanup_module-callr 1.727265473 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0dd832f cleanup_module-callr 1.727350319 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0dd43ea cleanup_module-callr 1.727436887 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0dcf272 cleanup_module-je 1.727495037 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0dca182 cleanup_module-je 1.728376784 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0dc2cf6 cleanup_module-je 1.728805830 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0dbb623 cleanup_module-callr 1.729177252 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0db6033 cleanup_module-callr 1.729375118 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0db0973 cleanup_module-callr 1.729584727 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0dab933 cleanup_module-callr 1.731730693 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0da591d cleanup_module-callr 1.731745364 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d9c01f cleanup_module-callr 1.731896700 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d93423 cleanup_module-je 1.733015686 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d82bab cleanup_module-callr 1.733325018 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d7ab58 cleanup_module-je 1.733597247 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d75b78 cleanup_module-callr 1.733662239 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d712d3 cleanup_module-callr 1.733832846 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d6d7d8 cleanup_module-callr 1.733875648 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d69188 cleanup_module-callr 1.733975676 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d6549c cleanup_module-callr 1.734076182 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d6146c cleanup_module-callr 1.734103176 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d5d0a3 cleanup_module-callr 1.734160512 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d591ff cleanup_module-callr 1.734201287 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d551bb cleanup_module-callr 1.734295664 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d514e4 cleanup_module-callr 1.734322600 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d4d0af cleanup_module-callr 1.734673307 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d4751f cleanup_module-callr 1.734992120 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d4224c cleanup_module-callr 1.735006459 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d3e05f cleanup_module-callr 1.735029156 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d3a06b cleanup_module-callr 1.735082251 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d362ef cleanup_module-callr 1.735099302 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d32090 cleanup_module-callr 1.735148445 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d2e1e0 cleanup_module-callr 1.735190853 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d2a127 cleanup_module-callr 1.735665586 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d254a8 cleanup_module-callr 1.735737358 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d202e4 cleanup_module-callr 1.735765935 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d1c10c cleanup_module-callr 1.735840541 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d1836c cleanup_module-callr 1.735959575 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d14684 cleanup_module-callr 1.736018493 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d101e3 cleanup_module-callr 1.736027647 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d0c024 cleanup_module-callr 1.736168885 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d08550 cleanup_module-callr 1.736204039 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d040bf cleanup_module-callr 1.736245524 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d0010e cleanup_module-callr 1.736394535 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0cfc598 cleanup_module-callr 1.736543489 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0cf87bb cleanup_module-callr 1.736896060 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0cf1ca7 cleanup_module-callr 1.737254815 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0cec1de cleanup_module-callr 1.737447970 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0ce7901 cleanup_module-callr 1.737537815 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0ce311e cleanup_module-callr 1.738642279 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0cdd341 cleanup_module-callr 1.739302619 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0cca367 cleanup_module-je 1.741471276 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0c9e87f cleanup_module-callr 1.742376220 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0c92a44 cleanup_module-callr 1.756915818 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0c73f0d cleanup_module-callr 1.768695735 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0c2d4b7 cleanup_module-callr 1.791819105 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0bb55a8 cleanup_module-callr 1.806805004 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0b46efc cleanup_module-callr 1.810351039 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0b30627 cleanup_module-callr 1.813496804 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0b1babb cleanup_module-callr 1.830847524 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0aa30cf cleanup_module-callr 1.842210495 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0a5dc63 cleanup_module-callr 1.845918303 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0a47598 cleanup_module-callr 1.849259744 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0a34e77 cleanup_module-callr 1.849517819 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0a2db73 cleanup_module-callr 1.851102051 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0a2339f cleanup_module-callr 1.851887549 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0a1aa4b cleanup_module-callr 1.851915007 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0a161bd cleanup_module-callr 1.852289452 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa09e6a8e cleanup_module-callr 1.852651366 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa09af04b cleanup_module-callr 1.852995150 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0989e73 cleanup_module-callr 1.857312481 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa084a6fe cleanup_module-callr 1.879496238 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa03d67ef cleanup_module-callr 1.879610467 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa03b63ef cleanup_module-callr 1.879937872 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa03774bf cleanup_module-callr 1.882126194 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0233830 cleanup_module-callr 1.882390093 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa01ef757 cleanup_module-callr 1.886362502 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa01d5eec cleanup_module-je 1.886474714 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa01b384f cleanup_module-callr 1.887883154 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0157057 cleanup_module-callr 1.888420663 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0134fe7 cleanup_module-callr 1.890478366 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0115e58 cleanup_module-callr 1.891410269 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa010f87b cleanup_module-callr 1.891527728 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa010252b cleanup_module-callr 1.899905364 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0099f33 cleanup_module-je 1.900722452 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa008ca2f cleanup_module-callr 1.900812674 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa008820b cleanup_module-callr 1.901240050 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa007b157 cleanup_module-callr 1.901832458 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0071fa7 cleanup_module-callr 1.911632782 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0057408 cleanup_module-callr 1.915484457 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa002875f cleanup_module-callr 1.918652350 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa00169c1 cleanup_module-callr 1.922723083 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa000007b cleanup_module-callr 1.923897013 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa00740b1 cleanup_module 1.924008134 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa006be59 cleanup_module 1.926836322 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0264267 cleanup_module 1.929286472 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa00e8416 cleanup_module 1.930099200 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0083a73 cleanup_module 1.930537258 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa002475d cleanup_module 1.931143645 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa00d0d69 cleanup_module 1.932229995 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa002d7c8 cleanup_module 1.932445341 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0066468 cleanup_module 1.932536177 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0002085 cleanup_module 1.932707688 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0f62d87 cleanup_module 1.932805024 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0f5c841 cleanup_module 1.932867824 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0f58891 cleanup_module 1.933005721 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0f54513 cleanup_module 1.933799445 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0f45a4b cleanup_module 1.935725141 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0f07198 cleanup_module 1.936436940 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0eefc31 cleanup_module 1.936577390 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0eea9b1 cleanup_module 1.936647389 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0ee69ed cleanup_module 1.936760253 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0ee24fa cleanup_module 1.936841023 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0edcb55 cleanup_module 1.936960336 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0ed84e5 cleanup_module 1.937100377 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0ed3499 cleanup_module 1.937190648 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0ecdeb1 cleanup_module 1.937270358 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0ec89dd cleanup_module 1.937500337 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0ec3009 cleanup_module 1.937746694 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0ebada5 cleanup_module 1.937774796 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0eb41a9 cleanup_module 1.937957692 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0eb010d cleanup_module 1.937972663 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0eaa0e0 cleanup_module 1.938189386 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0ea4df0 cleanup_module 1.939442356 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0e90350 cleanup_module 1.940145161 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0e78319 cleanup_module 1.940375821 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0e689b1 cleanup_module 1.940388211 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0e62081 cleanup_module 1.940411529 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0e5e2b1 cleanup_module 1.940431036 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0e5a109 cleanup_module 1.940491137 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0e5670e cleanup_module 1.940648743 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0e50caa cleanup_module 1.940718193 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0e4aa71 cleanup_module 1.940727621 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0e4603d cleanup_module 1.940762971 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0e424be cleanup_module 1.940772165 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0e3e01d cleanup_module 1.940911798 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0e383e3 cleanup_module 1.940932780 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0e3315a cleanup_module 1.941004977 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0e2ea16 cleanup_module 1.941041036 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0e2a54d cleanup_module 1.941070949 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0e26229 cleanup_module 1.941093864 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0e222cd cleanup_module 1.941198227 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0e1ddd2 cleanup_module 1.941211731 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0e190c9 cleanup_module 1.941293823 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0e14993 cleanup_module 1.941550072 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0e0b587 cleanup_module 1.941656026 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0e04085 cleanup_module 1.941778191 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0e0042b cleanup_module 1.941788349 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0dfb079 cleanup_module 1.941940246 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0df6a71 cleanup_module 1.941977502 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0df14c6 cleanup_module 1.941996507 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0ded16a cleanup_module 1.942015672 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0de917d cleanup_module 1.942124570 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0de505d cleanup_module 1.942146960 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0de02a1 cleanup_module 1.942161865 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0ddc13d cleanup_module 1.942197974 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0dd8335 cleanup_module 1.942224881 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0dd4417 cleanup_module 1.942246292 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0dcf2b8 cleanup_module 1.942262153 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0dca1bc cleanup_module 1.942525912 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0dc2d57 cleanup_module 1.942652860 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0dbb641 cleanup_module 1.942774483 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0db6051 cleanup_module 1.942834877 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0db0979 cleanup_module 1.942903939 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0dab945 cleanup_module 1.943456010 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0da5952 cleanup_module 1.943467015 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0d9c025 cleanup_module 1.943510641 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0d9345c cleanup_module 1.943838361 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0d82bed cleanup_module 1.943944203 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0d7abc2 cleanup_module 1.944016102 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0d75b7e cleanup_module 1.944039701 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0d712d9 cleanup_module 1.944093183 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0d6d7de cleanup_module 1.944110409 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0d6918e cleanup_module 1.944143803 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0d654a2 cleanup_module 1.944180796 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0d61472 cleanup_module 1.944193020 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0d5d0a9 cleanup_module 1.944214503 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0d59205 cleanup_module 1.944236313 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0d551c1 cleanup_module 1.944277131 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0d514ea cleanup_module 1.944292364 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0d4d0b5 cleanup_module 1.944395850 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0d47549 cleanup_module 1.944465104 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0d42252 cleanup_module 1.944479469 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0d3e071 cleanup_module 1.944491807 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0d3a071 cleanup_module 1.944529343 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0d362f5 cleanup_module 1.944544045 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0d32096 cleanup_module 1.944564615 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0d2e1e6 cleanup_module 1.944584047 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0d2a12d cleanup_module 1.944731892 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0d254cb cleanup_module 1.944766842 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0d202ea cleanup_module 1.944800185 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0d1c112 cleanup_module 1.944829544 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0d1837e cleanup_module 1.944883761 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0d1468a cleanup_module 1.944917488 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0d101f5 cleanup_module 1.944927490 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0d0c02a cleanup_module 1.944975542 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0d08556 cleanup_module 1.944994474 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0d040c5 cleanup_module 1.945025022 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0d00120 cleanup_module 1.945073341 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0cfc5aa cleanup_module 1.945144296 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0cf87d2 cleanup_module 1.945300334 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0cf1cf8 cleanup_module 1.945439236 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0cec1f0 cleanup_module 1.945506236 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0ce7913 cleanup_module 1.945573625 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0ce3130 cleanup_module 1.945906015 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0cdd375 cleanup_module 1.946060586 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0cca39e cleanup_module 1.946657283 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0c9e88a cleanup_module 1.946906072 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0c92a4a cleanup_module 1.950641575 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0c73f38 cleanup_module 1.953888136 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0c2d4c2 cleanup_module 1.960877076 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0bb55c2 cleanup_module 1.965110372 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0b46f02 cleanup_module 1.966179693 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0b3062d cleanup_module 1.966995011 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0b1bac1 cleanup_module 1.971934097 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0aa3108 cleanup_module 1.974890624 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0a5dc69 cleanup_module 1.975959439 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0a475b4 cleanup_module 1.976883592 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0a34e7d cleanup_module 1.976975633 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0a2db9d cleanup_module 1.977479351 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0a233a5 cleanup_module 1.977741661 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0a1aa5f cleanup_module 1.977762300 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0a161c3 cleanup_module 1.977880592 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa09e6b9d cleanup_module 1.978010301 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa09af092 cleanup_module 1.978017891 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa09aef3f init_module 1.978020340 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa09aefc5 init_module 1.978132002 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0989f07 cleanup_module 1.979393382 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa084a77b cleanup_module 1.986511244 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa03d67f5 cleanup_module 1.986570418 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa03b63f5 cleanup_module 1.986966470 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa03774c5 cleanup_module 1.987165541 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa021b90d _key_expansion_256a 1.987925888 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa023383b cleanup_module 1.988051397 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa01ef75d cleanup_module 1.989247074 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa01d600a cleanup_module 1.989304561 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa01b3855 cleanup_module 1.989815743 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa015705d cleanup_module 1.990089737 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0134ff9 cleanup_module 1.990770114 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0115e76 cleanup_module 1.991028598 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa010f881 cleanup_module 1.991079165 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0102531 cleanup_module 1.993842291 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0099f6c cleanup_module 1.994074263 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa008ca35 cleanup_module 1.994123185 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0088211 cleanup_module 1.994252113 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa007b177 cleanup_module 1.994421080 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0071fc5 cleanup_module 1.997181758 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa005740e cleanup_module 1.998210972 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0028765 cleanup_module 1.999143353 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa00169cc cleanup_module 2.000291338 #1 https://github.com/dtrace4linux/linux/pull/1 9440:fbt:dup patch: ffffffffa0000081 cleanup_module 2.007079325 #1 https://github.com/dtrace4linux/linux/pull/1 9440:dtrace_linux.c:get_proc_addr: Failed to find 'sys32_clone' (warn=7) 2.014433409 #1 https://github.com/dtrace4linux/linux/pull/1 9440:dtrace_linux.c:get_proc_addr: Failed to find 'sys32_execve' (warn=8) 2.032398521 #1 https://github.com/dtrace4linux/linux/pull/1 9440:dtrace_linux.c:get_proc_addr: Failed to find 'save_rest' (warn=9) 3.179221407 #1 https://github.com/dtrace4linux/linux/pull/1 9440:vmem_create(dtrace_aggid_0) ffff8801111a76c0 4.072040885 #0 9440:teardown start xcalls=19 probes=0 4.072043534 #0 9440:teardown done 0.000002741 xcalls=20 probes=0 4.077767573 #5 https://github.com/dtrace4linux/linux/issues/5 9444:vmem_create(dtrace_aggid_0) ffff88018cc71720 4.082787113 #0 9444:teardown start xcalls=21 probes=0 4.082788596 #0 9444:teardown done 0.000001464 xcalls=22 probes=0 174.013040970 #7 https://github.com/dtrace4linux/linux/issues/7 9502:vmem_create(dtrace_aggid_0) ffff880037a62e40 174.155415591 #0 9502:teardown start xcalls=23 probes=0 174.155417462 #0 9502:teardown done 0.000001910 xcalls=24 probes=0 182.764790589 #7 https://github.com/dtrace4linux/linux/issues/7 9504:vmem_create(dtrace_aggid_0) ffff880037a625a0 182.901762746 #7 https://github.com/dtrace4linux/linux/issues/7 9504:teardown start xcalls=25 probes=0 182.901764609 #7 https://github.com/dtrace4linux/linux/issues/7 9504:teardown done 0.000001930 xcalls=26 probes=0 1175.466120765 #3 https://github.com/dtrace4linux/linux/issues/3 10785:vmem_create(dtrace_aggid_0) ffff8800bc37da20 1175.603801952 #3 https://github.com/dtrace4linux/linux/issues/3 10785:teardown start xcalls=27 probes=0 1175.603803914 #3 https://github.com/dtrace4linux/linux/issues/3 10785:teardown done 0.000002057 xcalls=28 probes=0 1223.080105908 #0 10805:vmem_create(dtrace_aggid_0) ffff88020f1afba0 1229.292237122 #6 https://github.com/dtrace4linux/linux/pull/6 10805:[cpu6] dtrace_linux_panic called. Dumping cpu stacks 1229.292366709 #6 https://github.com/dtrace4linux/linux/pull/6 10805:dtrace_linux_panic: finished 1229.292368130 #5 https://github.com/dtrace4linux/linux/issues/5 10673-This is CPU#5 1229.292540797 #4 https://github.com/dtrace4linux/linux/pull/4 26638-This is CPU#4 24.292540862 #2 https://github.com/dtrace4linux/linux/issues/2 0-This is CPU#2 1230.288047341 #0 10805:teardown start xcalls=134 probes=320904 1230.288070253 #0 10805:kmem_free t=0.000000102 (1) 1230.288073808 #0 10805:kmem_free t=0.000000175 (3) 1230.288075456 #0 10805:kmem_free t=0.000000348 (7) 1230.288102811 #0 10805:kmem_free t=0.000000373 (159) 1230.288131789 #0 10805:kmem_free t=0.000000420 (324) 1230.288187130 #0 10805:teardown done 0.000139729 xcalls=134 probes=0 1596.234721401 #5 https://github.com/dtrace4linux/linux/issues/5 10899:vmem_create(dtrace_aggid_0) ffff88012cd3a600 1596.424537792 #5 https://github.com/dtrace4linux/linux/issues/5 10899:teardown start xcalls=134 probes=1 1596.424638299 #5 https://github.com/dtrace4linux/linux/issues/5 10899:teardown done 0.000100594 xcalls=134 probes=0 1613.341404855 #5 https://github.com/dtrace4linux/linux/issues/5 10904:vmem_create(dtrace_aggid_0) ffff880100d878a0 1613.626268448 #6 https://github.com/dtrace4linux/linux/pull/6 10904:teardown start xcalls=134 probes=1 1613.626376857 #6 https://github.com/dtrace4linux/linux/pull/6 10904:kmem_free t=0.000000514 (1782) 1613.626416078 #6 https://github.com/dtrace4linux/linux/pull/6 10904:teardown done 0.000147596 xcalls=134 probes=0 1719.874009890 #3 https://github.com/dtrace4linux/linux/issues/3 10964:vmem_create(dtrace_aggid_0) ffff8800bc37d240 1720.067582464 #3 https://github.com/dtrace4linux/linux/issues/3 10964:teardown start xcalls=134 probes=1 1720.067682651 #3 https://github.com/dtrace4linux/linux/issues/3 10964:teardown done 0.000100093 xcalls=134 probes=0 1780.955353641 #1 https://github.com/dtrace4linux/linux/pull/1 10979:vmem_create(dtrace_aggid_0) ffff88001409c600 1781.145599312 #1 https://github.com/dtrace4linux/linux/pull/1 10979:teardown start xcalls=134 probes=1 1781.145687532 #1 https://github.com/dtrace4linux/linux/pull/1 10979:teardown done 0.000088161 xcalls=134 probes=0 1947.191688288 #1 https://github.com/dtrace4linux/linux/pull/1 11025:vmem_create(dtrace_aggid_0) ffff88002184ca80 1947.380021950 #1 https://github.com/dtrace4linux/linux/pull/1 11025:teardown start xcalls=134 probes=1 1947.380110862 #1 https://github.com/dtrace4linux/linux/pull/1 11025:teardown done 0.000088872 xcalls=134 probes=0 2106.215943491 #5 https://github.com/dtrace4linux/linux/issues/5 11057:vmem_create(dtrace_aggid_0) ffff880106fa3d20 2106.408716337 #4 https://github.com/dtrace4linux/linux/pull/4 11057:teardown start xcalls=134 probes=1 2106.408811359 #4 https://github.com/dtrace4linux/linux/pull/4 11057:teardown done 0.000094983 xcalls=134 probes=0 2178.065358434 #3 https://github.com/dtrace4linux/linux/issues/3 11074:vmem_create(dtrace_aggid_0) ffff880086c79e40 2178.230261062 #3 https://github.com/dtrace4linux/linux/issues/3 11074:teardown start xcalls=134 probes=1 2178.230264886 #3 https://github.com/dtrace4linux/linux/issues/3 11074:teardown done 0.000003844 xcalls=134 probes=0 2693.598103757 #1 https://github.com/dtrace4linux/linux/pull/1 11730:vmem_create(dtrace_aggid_0) ffff88002f8969c0 2693.761623422 #1 https://github.com/dtrace4linux/linux/pull/1 11730:teardown start xcalls=134 probes=1 2693.761631275 #1 https://github.com/dtrace4linux/linux/pull/1 11730:teardown done 0.000007577 xcalls=134 probes=0 2907.101936223 #1 https://github.com/dtrace4linux/linux/pull/1 11802:vmem_create(dtrace_aggid_0) ffff88002f896000 2907.305012552 #0 11802:teardown start xcalls=134 probes=1 2907.305184928 #0 11802:teardown done 0.000172142 xcalls=134 probes=0 3892.008815281 #5 https://github.com/dtrace4linux/linux/issues/5 12042:vmem_create(dtrace_aggid_0) ffff8801139ad9c0 3892.118977822 #5 https://github.com/dtrace4linux/linux/issues/5 12042:teardown start xcalls=134 probes=0 3892.118979917 #5 https://github.com/dtrace4linux/linux/issues/5 12042:teardown done 0.000002240 xcalls=134 probes=0 3989.884416993 #0 12070:vmem_create(dtrace_aggid_0) ffff8800a6fa44e0 3990.075608368 #0 12070:teardown start xcalls=134 probes=1 3990.075704843 #0 12070:teardown done 0.000096431 xcalls=134 probes=0 4065.799672953 #5 https://github.com/dtrace4linux/linux/issues/5 12104:vmem_create(dtrace_aggid_0) ffff8801139ad960 4065.919783633 #4 https://github.com/dtrace4linux/linux/pull/4 12104:teardown start xcalls=134 probes=0 4065.919785338 #4 https://github.com/dtrace4linux/linux/pull/4 12104:teardown done 0.000001783 xcalls=134 probes=0 4815.097468218 #5 https://github.com/dtrace4linux/linux/issues/5 12304:vmem_create(dtrace_aggid_0) ffff8801139ad7e0 4815.299634975 #1 https://github.com/dtrace4linux/linux/pull/1 12304:teardown start xcalls=134 probes=1 4815.299749009 #1 https://github.com/dtrace4linux/linux/pull/1 12304:kmem_free t=0.000005179 (6406) 4815.299770808 #1 https://github.com/dtrace4linux/linux/pull/1 12304:kmem_free t=0.000009590 (6466) 4815.299808033 #1 https://github.com/dtrace4linux/linux/pull/1 12304:teardown done 0.000173032 xcalls=134 probes=0 4987.303705969 #7 https://github.com/dtrace4linux/linux/issues/7 12331:vmem_create(dtrace_aggid_0) ffff8800100870c0 4987.503622510 #5 https://github.com/dtrace4linux/linux/issues/5 12331:teardown start xcalls=134 probes=1 4987.503720389 #5 https://github.com/dtrace4linux/linux/issues/5 12331:teardown done 0.000097815 xcalls=134 probes=0

0 9425:4dtracedrv loaded: /dev/dtrace available, dtrace_here=0 nr_cpus=8

0 9425:vmem_create(dtrace) ffff8801d9c475a0

0 9425:vmem_create(dtrace_minor) ffff8801d9c474e0

0 9425:__alloc_workqueue_key_ptr=ffffffff81065c30

0 9425:dtrace_linux.c:get_proc_addr: Failed to find 'queue_delayed_work'

(warn=1)

0 9425:dtrace_linux.c:get_proc_addr: Failed to find 'lockdep_init_map'

(warn=2)

0 9425:queue_delayed_work_ptr=0000000000000000

0 9425:destroy_workqueue_ptr=ffffffff810633d0

0 9425:flush_workqueue_ptr=ffffffff81061b60

0 9425:delayed_work_timer_fn_ptr=ffffffff81063210

0 9425:ctf loaded: /dev/ctf now available

0 9418:dtrace_linux.c:get_proc_addr: Failed to find

'sysrq_showregs_othercpus' (warn=3)

0 9418:dtrace_linux.c:get_proc_addr: Failed to find 'xtime_cache' (warn=4)

0.000000000 #0 9418:profile loaded: /dev/dtrace_profile available 0.036411062 #0 9418:dtrace_linux.c:get_proc_addr: Failed to find 'tcp_event_data_sent' (warn=5) 0.036412021 #0 9418:prcom_add_function: cannot locate 'tcp_event_data_sent' 0.239416063 #0 9418:dtrace_linux.c:get_proc_addr: Failed to find 'xen_start_info' (warn=6) 0.239471835 #0 9418:dcpc.c:dcpc_attach:1333: TODO:please fill me in 0.239472280 #0 9418:dcpc initialised. 0.239539170 #0 9418:sdt loaded: /dev/sdt now available 0.239944537 #0 9418:ctl loaded: /dev/dtrace_ctl now available 0.241259341 #0 9418:dtrace_function_size: do_sync_read ffffffff81175f80 size=144 0.241260524 #0 9418:io_prov_entry called io:start 0.241264555 #0 9418:io_prov_return called io:start ffffffff81175fea sz=1 0.241266216 #0 9418:io_prov_return called io:start ffffffff81176006 sz=1 0.241938996 #0 9418:dtrace_function_size: do_sync_write ffffffff81176300 size=144 0.241939498 #0 9418:io_prov_entry called io:start 0.241942464 #0 9418:io_prov_return called io:start ffffffff8117636a sz=1 0.241943796 #0 9418:io_prov_return called io:start ffffffff81176386 sz=1 0.533992507 #0 9440:fbt:dup patch: ffffffff818469be error_sti 1.664905760 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa00740ab cleanup_module-callr 1.665254382 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa006be2f cleanup_module-callr 1.674877930 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0264219 cleanup_module-callr 1.683695022 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa00e83fc cleanup_module-callr 1.686395870 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0083a4b cleanup_module-callr 1.687905339 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa002474b cleanup_module-callr 1.690215271 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa00d0d4b cleanup_module-callr 1.693679117 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa002d7b7 cleanup_module-callr 1.694453633 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa006637c cleanup_module-callr 1.694779969 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa000207f cleanup_module-callr 1.695434956 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0f62d4c cleanup_module-callr 1.695685350 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0f5c83b cleanup_module-callr 1.695836732 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0f5887f cleanup_module-callr 1.696346731 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0f544f5 cleanup_module-callr 1.699285409 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0f45a40 cleanup_module-callr 1.705773608 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0f07183 cleanup_module-callr 1.708220029 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0eefc1b cleanup_module-callr 1.708689437 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0eea9ab cleanup_module-callr 1.708965148 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0ee69e7 cleanup_module-callr 1.709312969 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0ee24f4 cleanup_module-callr 1.709603995 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0edcb4f cleanup_module-callr 1.710091290 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0ed84df cleanup_module-callr 1.710457591 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0ed3493 cleanup_module-callr 1.710714606 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0ecdeab cleanup_module-callr 1.710947167 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0ec89d7 cleanup_module-callr 1.711717750 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0ec3003 cleanup_module-callr 1.712814935 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0ebad9f cleanup_module-callr 1.712861479 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0eb41a3 cleanup_module-callr 1.713285698 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0eb0107 cleanup_module-callr 1.713317044 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0eaa0ce cleanup_module-callr 1.714136098 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0ea4dcd cleanup_module-callr 1.717790214 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e90317 cleanup_module-callr 1.720354953 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e78313 cleanup_module-callr 1.721326180 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e689ab cleanup_module-callr 1.721353611 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e6207b cleanup_module-callr 1.721433566 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e5e2ab cleanup_module-callr 1.721475707 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e5a103 cleanup_module-callr 1.721677228 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e566fc cleanup_module-callr 1.722252117 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e50c7b cleanup_module-callr 1.722455320 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e4aa53 cleanup_module-callr 1.722462429 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e46037 cleanup_module-callr 1.722589929 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e424b8 cleanup_module-callr 1.722596577 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e3e017 cleanup_module-callr 1.723006466 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e383d1 cleanup_module-callr 1.723037256 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e33154 cleanup_module-callr 1.723290095 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e2e9ef cleanup_module-je 1.723391960 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e2a547 cleanup_module-callr 1.723448699 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e2620b cleanup_module-callr 1.723510453 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e222c7 cleanup_module-callr 1.723930658 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e1dda3 cleanup_module-callr 1.723957022 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e190c3 cleanup_module-callr 1.724233676 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e1497c cleanup_module-callr 1.725198291 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e0b569 cleanup_module-callr 1.725597322 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e0407f cleanup_module-callr 1.726124565 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0e00425 cleanup_module-callr 1.726144560 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0dfb073 cleanup_module-callr 1.726578097 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0df6a66 cleanup_module-callr 1.726673751 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0df14c0 cleanup_module-callr 1.726717411 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0ded164 cleanup_module-callr 1.726750844 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0de9177 cleanup_module-callr 1.727108677 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0de5046 cleanup_module-callr 1.727155693 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0de029b cleanup_module-callr 1.727192379 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0ddc137 cleanup_module-callr 1.727265473 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0dd832f cleanup_module-callr 1.727350319 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0dd43ea cleanup_module-callr 1.727436887 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0dcf272 cleanup_module-je 1.727495037 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0dca182 cleanup_module-je 1.728376784 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0dc2cf6 cleanup_module-je 1.728805830 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0dbb623 cleanup_module-callr 1.729177252 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0db6033 cleanup_module-callr 1.729375118 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0db0973 cleanup_module-callr 1.729584727 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0dab933 cleanup_module-callr 1.731730693 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0da591d cleanup_module-callr 1.731745364 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d9c01f cleanup_module-callr 1.731896700 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d93423 cleanup_module-je 1.733015686 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d82bab cleanup_module-callr 1.733325018 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d7ab58 cleanup_module-je 1.733597247 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d75b78 cleanup_module-callr 1.733662239 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d712d3 cleanup_module-callr 1.733832846 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d6d7d8 cleanup_module-callr 1.733875648 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d69188 cleanup_module-callr 1.733975676 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d6549c cleanup_module-callr 1.734076182 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d6146c cleanup_module-callr 1.734103176 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d5d0a3 cleanup_module-callr 1.734160512 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d591ff cleanup_module-callr 1.734201287 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d551bb cleanup_module-callr 1.734295664 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d514e4 cleanup_module-callr 1.734322600 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d4d0af cleanup_module-callr 1.734673307 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d4751f cleanup_module-callr 1.734992120 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d4224c cleanup_module-callr 1.735006459 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d3e05f cleanup_module-callr 1.735029156 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d3a06b cleanup_module-callr 1.735082251 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d362ef cleanup_module-callr 1.735099302 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d32090 cleanup_module-callr 1.735148445 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d2e1e0 cleanup_module-callr 1.735190853 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d2a127 cleanup_module-callr 1.735665586 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d254a8 cleanup_module-callr 1.735737358 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d202e4 cleanup_module-callr 1.735765935 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d1c10c cleanup_module-callr 1.735840541 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d1836c cleanup_module-callr 1.735959575 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d14684 cleanup_module-callr 1.736018493 #1 https://github.com/dtrace4linux/linux/pull/1 9440:instr:dup patch: ffffffffa0d101e3 cleanup_module-callr 1

lukas999 commented 10 years ago

Thanks for quick reply. I think this is more general problem since even very basic onliner fails:

root # dtrace -n BEGIN dtrace: description 'BEGIN' matched 1 probe dtrace: processing aborted: No such device

...

And just to make sure, the driver is loaded and the device eixsts.

lsmod | grep dtrace dtracedrv 691680 0

root # ls -l /dev/dtrace* crw-rw-rw- 1 root root 10, 54 Sep 17 16:28 /dev/dtrace crw-rw-rw- 1 root root 10, 50 Sep 17 16:28 /dev/dtrace_ctl crw-rw-rw- 1 root root 10, 53 Sep 17 16:28 /dev/dtrace_helper crw------- 1 root root 10, 52 Sep 17 16:28 /dev/dtrace_profile

dtrace4linux commented 10 years ago

Works for me

build/dtrace -n BEGIN dtrace: description 'BEGIN' matched 1 probe CPU ID FUNCTION:NAME 1 1 :BEGIN ^C

You need to verify if you are using the right dtrace binary and that it is loaded.

Assuming this is dtrace4linux (and not an oracle version), then try looking at dmesg after loading the driver and see if there are any interesting messages there.

I need to try out on a 3.15 or later kernel.

On 18 September 2014 06:04, lukas999 notifications@github.com wrote:

Thanks for quick reply. I think this is more general problem since even very basic onliner fails: dtrace -n BEGIN

dtrace: description 'BEGIN' matched 1 probe dtrace: processing aborted: No such device

...

And just to make sure, the driver is loaded and the device eixsts.

lsmod | grep dtrace dtracedrv 691680 0 ls -l /dev/dtrace*

crw-rw-rw- 1 root root 10, 54 Sep 17 16:28 /dev/dtrace crw-rw-rw- 1 root root 10, 50 Sep 17 16:28 /dev/dtrace_ctl crw-rw-rw- 1 root root 10, 53 Sep 17 16:28 /dev/dtrace_helper crw------- 1 root root 10, 52 Sep 17 16:28 /dev/dtrace_profile

— Reply to this email directly or view it on GitHub https://github.com/dtrace4linux/linux/issues/62#issuecomment-55995343.

lukas999 commented 10 years ago

After a reboot, I may be onse step closer to working dtrace since dtrace prints something out but the message still persists.

root # make load tools/load.pl 06:46:19 Syncing... 06:46:19 Loading: build-3.15.2-gentoo/driver/dtracedrv.ko 06:46:20 Preparing symbols... 06:46:20 Probes available: 452144 06:46:23 Time: 4s root@sam linux # root@sam linux # dmesg | tail ... [85428.820242] dtracedrv: module license 'CDDL' taints kernel. [85428.820246] Disabling lock debugging due to kernel taint

root # ./build/dtrace -n BEGIN dtrace: description 'BEGIN' matched 1 probe CPU ID FUNCTION:NAME 0 1 :BEGIN dtrace: processing aborted: No such device

The devices dtrace, dtrace_ctl, dtrace_helper and dtrace_profile were created.

I can try any of earlier kernels. What kernel worked for you?

lukas999 commented 10 years ago

And one more question - are these four devices enough? Shouldn'n there be any more devices?