rr-debugger / rr

Record and Replay Framework
http://rr-project.org/
Other
9.2k stars 585 forks source link

test failures on aarch64 Ampere Altra #3861

Open GitMensch opened 3 weeks ago

GitMensch commented 3 weeks ago

Here's a partial test run and its verbose output:

$ ctest --verbose -R timer-no-syscallbuf
UpdateCTestConfiguration  from :/home/opc/rr/build/DartConfiguration.tcl
UpdateCTestConfiguration  from :/home/opc/rr/build/DartConfiguration.tcl
Test project /home/opc/rr/build
Constructing a list of tests
Done constructing a list of tests
Updating test list for fixtures
Added 0 tests to meet fixture requirements
Checking test dependency graph...
Checking test dependency graph end
test 226
    Start 226: setitimer-no-syscallbuf

226: Test command: /usr/bin/bash "source_dir/src/test/basic_test.run" "setitimer" "-n" "bin_dir" "120"
226: Working Directory: /home/opc/rr/build
226: Test timeout computed to be: 10000000
226: source_dir/src/test/util.sh: line 280: 1987981 Aborted                 (core dumped) _RR_TRACE_DIR="$workdir" test-monitor $TIMEOUT record.err $RR_EXE $GLOBAL_OPTIONS record $LIB_ARG $RECORD_ARGS "$exe" $exeargs > record.out 2> record.err
226: Test 'setitimer' FAILED: : error during recording:
226: --------------------------------------------------
226: [FATAL src/PerfCounters.cc:1072:read_ticks()]
226:  (task 1987991 (rec:1987991) at time 103)
226:  -> Assertion `false' failed to hold. 1 (speculatively) executed strex instructions detected.
226: On aarch64, rr only supports applications making use of LSE
226: atomics rather than legacy LL/SC-based atomics.
226: Aborting. Retry with -F to override, but replaying such
226: a recording will probably fail.
226: Tail of trace dump:
226: {
226:   real_time:35373927.429429 global_time:83, event:`SYSCALL: faccessat' (state:ENTERING_SYSCALL) tid:1987991, ticks:11476
226: x[0]:0xffffffffffffff9c x[1]:0xffff88269528 x[2]:0x4 x[3]:0x0 x[4]:0x4 x[5]:0xffff88256e40 x[6]:0x3 x[7]:0xffffffff90000023 x[8]:0x30 x[9]:0x1 x[10]:0x6ad1d x[11]:0x6fffffff x[12]:0x1050 x[13]:0x38 x[14]:0x6ffffdff x[15]:0x6ffffe3b x[16]:0xffff88256e40 x[17]:0x6ffffeff x[18]:0x1f000 x[19]:0x1 x[20]:0x2 x[21]:0xffff882872b0 x[22]:0xffff88269000 x[23]:0xffff88269528 x[24]:0xffffcdb734c0 x[25]:0xffffcdb734a8 x[26]:0x400040 x[27]:0xffff88285000 x[28]:0x0 x[29]:0xffffcdb73390 x[30]:0xffff8825f960 sp:0xffffcdb73380 pc:0xffff882624d4 pstate:0x20001000
226: }
226: {
226:   real_time:35373927.429661 global_time:84, event:`SYSCALL: faccessat' (state:EXITING_SYSCALL) tid:1987991, ticks:11476
226: x[0]:0xfffffffffffffffe x[1]:0xffff88269528 x[2]:0x4 x[3]:0x0 x[4]:0x4 x[5]:0xffff88256e40 x[6]:0x3 x[7]:0xffffffff90000023 x[8]:0x30 x[9]:0x1 x[10]:0x6ad1d x[11]:0x6fffffff x[12]:0x1050 x[13]:0x38 x[14]:0x6ffffdff x[15]:0x6ffffe3b x[16]:0xffff88256e40 x[17]:0x6ffffeff x[18]:0x1f000 x[19]:0x1 x[20]:0x2 x[21]:0xffff882872b0 x[22]:0xffff88269000 x[23]:0xffff88269528 x[24]:0xffffcdb734c0 x[25]:0xffffcdb734a8 x[26]:0x400040 x[27]:0xffff88285000 x[28]:0x0 x[29]:0xffffcdb73390 x[30]:0xffff8825f960 sp:0xffffcdb73380 pc:0xffff882624d4 pstate:0x20001000
226: }
226: {
226:   real_time:35373927.429906 global_time:85, event:`SYSCALL: openat' (state:ENTERING_SYSCALL) tid:1987991, ticks:11782
226: x[0]:0xffffffffffffff9c x[1]:0xffffcdb726a0 x[2]:0x80000 x[3]:0x0 x[4]:0xffffcdb728f7 x[5]:0x0 x[6]:0x0 x[7]:0x362e6f732e6362 x[8]:0x38 x[9]:0x5 x[10]:0xffff87dfae86 x[11]:0x6fffffff x[12]:0x1050 x[13]:0x38 x[14]:0x6ffffdff x[15]:0x6ffffe3b x[16]:0xffff88285f98 x[17]:0xffff8825aaf0 x[18]:0x1f000 x[19]:0xffffcdb726a0 x[20]:0xffff88285000 x[21]:0xffff882872b0 x[22]:0x19 x[23]:0xffffcdb728f7 x[24]:0xffffcdb726af x[25]:0x8 x[26]:0xffff88284d48 x[27]:0xffff88281024 x[28]:0xffffcdb72908 x[29]:0xffffcdb72610 x[30]:0xffff8824ac68 sp:0xffffcdb725d0 pc:0xffff88262684 pstate:0x80001000
226: }
226: {
226:   real_time:35373927.430147 global_time:86, event:`SYSCALL: openat' (state:EXITING_SYSCALL) tid:1987991, ticks:11782
226: x[0]:0xfffffffffffffffe x[1]:0xffffcdb726a0 x[2]:0x80000 x[3]:0x0 x[4]:0xffffcdb728f7 x[5]:0x0 x[6]:0x0 x[7]:0x362e6f732e6362 x[8]:0x38 x[9]:0x5 x[10]:0xffff87dfae86 x[11]:0x6fffffff x[12]:0x1050 x[13]:0x38 x[14]:0x6ffffdff x[15]:0x6ffffe3b x[16]:0xffff88285f98 x[17]:0xffff8825aaf0 x[18]:0x1f000 x[19]:0xffffcdb726a0 x[20]:0xffff88285000 x[21]:0xffff882872b0 x[22]:0x19 x[23]:0xffffcdb728f7 x[24]:0xffffcdb726af x[25]:0x8 x[26]:0xffff88284d48 x[27]:0xffff88281024 x[28]:0xffffcdb72908 x[29]:0xffffcdb72610 x[30]:0xffff8824ac68 sp:0xffffcdb725d0 pc:0xffff88262684 pstate:0x80001000
226: }
226: {
226:   real_time:35373927.430387 global_time:87, event:`SYSCALL: openat' (state:ENTERING_SYSCALL) tid:1987991, ticks:12073
226: x[0]:0xffffffffffffff9c x[1]:0xffff88281ae0 x[2]:0x80000 x[3]:0x0 x[4]:0xffffcdb728f7 x[5]:0x0 x[6]:0x0 x[7]:0x362e6f732e636269 x[8]:0x38 x[9]:0x8000000000000100 x[10]:0x100 x[11]:0x1c2 x[12]:0x696c2f343662696c x[13]:0x362e6f732e6362 x[14]:0x6ffffdff x[15]:0x6ffffe3b x[16]:0xffff88285f98 x[17]:0xffff8825aaf0 x[18]:0x1f000 x[19]:0xffff88281ae0 x[20]:0xffff88285000 x[21]:0xffff882872b0 x[22]:0x0 x[23]:0xffffcdb728f7 x[24]:0x0 x[25]:0xffff88286000 x[26]:0xffff88285000 x[27]:0xffff88284000 x[28]:0xffffcdb72908 x[29]:0xffffcdb727b0 x[30]:0xffff8824ac68 sp:0xffffcdb72770 pc:0xffff88262684 pstate:0x80001000
226: }
226: {
226:   real_time:35373927.430661 global_time:88, event:`SYSCALL: openat' (state:EXITING_SYSCALL) tid:1987991, ticks:12073
226: x[0]:0x4 x[1]:0xffff88281ae0 x[2]:0x80000 x[3]:0x0 x[4]:0xffffcdb728f7 x[5]:0x0 x[6]:0x0 x[7]:0x362e6f732e636269 x[8]:0x38 x[9]:0x8000000000000100 x[10]:0x100 x[11]:0x1c2 x[12]:0x696c2f343662696c x[13]:0x362e6f732e6362 x[14]:0x6ffffdff x[15]:0x6ffffe3b x[16]:0xffff88285f98 x[17]:0xffff8825aaf0 x[18]:0x1f000 x[19]:0xffff88281ae0 x[20]:0xffff88285000 x[21]:0xffff882872b0 x[22]:0x0 x[23]:0xffffcdb728f7 x[24]:0x0 x[25]:0xffff88286000 x[26]:0xffff88285000 x[27]:0xffff88284000 x[28]:0xffffcdb72908 x[29]:0xffffcdb727b0 x[30]:0xffff8824ac68 sp:0xffffcdb72770 pc:0xffff88262684 pstate:0x80001000
226: }
226: {
226:   real_time:35373927.430916 global_time:89, event:`SYSCALL: read' (state:ENTERING_SYSCALL) tid:1987991, ticks:12077
226: x[0]:0x4 x[1]:0xffffcdb72910 x[2]:0x340 x[3]:0x0 x[4]:0xffffcdb728f7 x[5]:0x0 x[6]:0x0 x[7]:0x362e6f732e636269 x[8]:0x3f x[9]:0x8000000000000100 x[10]:0x100 x[11]:0x1c2 x[12]:0x696c2f343662696c x[13]:0x362e6f732e6362 x[14]:0x6ffffdff x[15]:0x6ffffe3b x[16]:0xffff88285f98 x[17]:0xffff8825aaf0 x[18]:0x1f000 x[19]:0xffff88281ae0 x[20]:0xffff88285000 x[21]:0xffff88287000 x[22]:0x4 x[23]:0xffffcdb728f7 x[24]:0x340 x[25]:0xffff88286000 x[26]:0xffff88285000 x[27]:0xffffcdb72910 x[28]:0xffffcdb72908 x[29]:0xffffcdb727b0 x[30]:0xffff8824ac9c sp:0xffffcdb727a0 pc:0xffff882626ec pstate:0x1000
226: }
226: {
226:   real_time:35373927.431173 global_time:90, event:`SYSCALL: read' (state:EXITING_SYSCALL) tid:1987991, ticks:12077
226: x[0]:0x340 x[1]:0xffffcdb72910 x[2]:0x340 x[3]:0x0 x[4]:0xffffcdb728f7 x[5]:0x0 x[6]:0x0 x[7]:0x362e6f732e636269 x[8]:0x3f x[9]:0x8000000000000100 x[10]:0x100 x[11]:0x1c2 x[12]:0x696c2f343662696c x[13]:0x362e6f732e6362 x[14]:0x6ffffdff x[15]:0x6ffffe3b x[16]:0xffff88285f98 x[17]:0xffff8825aaf0 x[18]:0x1f000 x[19]:0xffff88281ae0 x[20]:0xffff88285000 x[21]:0xffff88287000 x[22]:0x4 x[23]:0xffffcdb728f7 x[24]:0x340 x[25]:0xffff88286000 x[26]:0xffff88285000 x[27]:0xffffcdb72910 x[28]:0xffffcdb72908 x[29]:0xffffcdb727b0 x[30]:0xffff8824ac9c sp:0xffffcdb727a0 pc:0xffff882626ec pstate:0x1000
226:   { tid:1987991, addr:0xffffcdb72910, length:0x340 }
226: }
226: {
226:   real_time:35373927.431430 global_time:91, event:`SYSCALL: fstat' (state:ENTERING_SYSCALL) tid:1987991, ticks:12131
226: x[0]:0x4 x[1]:0xffffcdb727b0 x[2]:0xffff882872b0 x[3]:0x0 x[4]:0xffff88281ae0 x[5]:0xffff882872b0 x[6]:0x1 x[7]:0x0 x[8]:0x50 x[9]:0x8000000000000100 x[10]:0x14 x[11]:0x1c2 x[12]:0x696c2f343662696c x[13]:0x362e6f732e6362 x[14]:0x6ffffdff x[15]:0x6ffffe3b x[16]:0xffff88285f98 x[17]:0xffff8825aaf0 x[18]:0x1f000 x[19]:0x4 x[20]:0x0 x[21]:0xffff88281ae0 x[22]:0x40050d x[23]:0xffffcdb72908 x[24]:0xffff882872b0 x[25]:0x0 x[26]:0xffff88285000 x[27]:0x400480 x[28]:0x1 x[29]:0xffffcdb726c0 x[30]:0xffff8824cba4 sp:0xffffcdb72690 pc:0xffff8826237c pstate:0x1000
226: }
226: {
226:   real_time:35373927.431668 global_time:92, event:`SYSCALL: fstat' (state:EXITING_SYSCALL) tid:1987991, ticks:12131
226: x[0]:0x0 x[1]:0xffffcdb727b0 x[2]:0xffff882872b0 x[3]:0x0 x[4]:0xffff88281ae0 x[5]:0xffff882872b0 x[6]:0x1 x[7]:0x0 x[8]:0x50 x[9]:0x8000000000000100 x[10]:0x14 x[11]:0x1c2 x[12]:0x696c2f343662696c x[13]:0x362e6f732e6362 x[14]:0x6ffffdff x[15]:0x6ffffe3b x[16]:0xffff88285f98 x[17]:0xffff8825aaf0 x[18]:0x1f000 x[19]:0x4 x[20]:0x0 x[21]:0xffff88281ae0 x[22]:0x40050d x[23]:0xffffcdb72908 x[24]:0xffff882872b0 x[25]:0x0 x[26]:0xffff88285000 x[27]:0x400480 x[28]:0x1 x[29]:0xffffcdb726c0 x[30]:0xffff8824cba4 sp:0xffffcdb72690 pc:0xffff8826237c pstate:0x1000
226:   { tid:1987991, addr:0xffffcdb727b0, length:0x80 }
226: }
226: {
226:   real_time:35373927.431915 global_time:93, event:`SYSCALL: mmap' (state:ENTERING_SYSCALL) tid:1987991, ticks:12289
226: x[0]:0x0 x[1]:0x1bdfd0 x[2]:0x5 x[3]:0x802 x[4]:0x4 x[5]:0x0 x[6]:0xffffcdb72910 x[7]:0x1 x[8]:0xde x[9]:0x1 x[10]:0x6 x[11]:0xffffcdb72690 x[12]:0x0 x[13]:0x5 x[14]:0x1b16c8 x[15]:0xfffffffffffff000 x[16]:0x1bdfd0 x[17]:0xfff x[18]:0x1ac000 x[19]:0x4 x[20]:0x0 x[21]:0xffff88281ae0 x[22]:0x40050d x[23]:0x1bdfd0 x[24]:0x2 x[25]:0x0 x[26]:0xffff88281b00 x[27]:0x0 x[28]:0xffffcdb724e0 x[29]:0xffffcdb726c0 x[30]:0xffff8824c97c sp:0xffffcdb724b0 pc:0xffff8826287c pstate:0x40001000
226: }
226: {
226:   real_time:35373927.432299 global_time:94, event:`SYSCALL: mmap' (state:EXITING_SYSCALL) tid:1987991, ticks:12289
226: x[0]:0xffff8803d000 x[1]:0x1bdfd0 x[2]:0x5 x[3]:0x802 x[4]:0x4 x[5]:0x0 x[6]:0xffffcdb72910 x[7]:0x1 x[8]:0xde x[9]:0x1 x[10]:0x6 x[11]:0xffffcdb72690 x[12]:0x0 x[13]:0x5 x[14]:0x1b16c8 x[15]:0xfffffffffffff000 x[16]:0x1bdfd0 x[17]:0xfff x[18]:0x1ac000 x[19]:0x4 x[20]:0x0 x[21]:0xffff88281ae0 x[22]:0x40050d x[23]:0x1bdfd0 x[24]:0x2 x[25]:0x0 x[26]:0xffff88281b00 x[27]:0x0 x[28]:0xffffcdb724e0 x[29]:0xffffcdb726c0 x[30]:0xffff8824c97c sp:0xffffcdb724b0 pc:0xffff8826287c pstate:0x40001000
226:   { map_file:"/usr/lib64/libc.so.6", addr:0xffff8803d000, length:0x1be000, prot_flags:"r-xp", file_offset:0x0, device:64512, inode:34577689, data_file:"/tmp/rr-test-setitimer-WxwgBHNqB/setitimer-WxwgBHNqB-0/mmap_clone_17_libc.so.6", data_offset:0x0, file_size:0x231a28 }
226: }
226: {
226:   real_time:35373927.432598 global_time:95, event:`SYSCALL: mprotect' (state:ENTERING_SYSCALL) tid:1987991, ticks:12294
226: x[0]:0xffff881cb000 x[1]:0x1e000 x[2]:0x0 x[3]:0x1ac000 x[4]:0x4 x[5]:0x0 x[6]:0xffffcdb72910 x[7]:0x1 x[8]:0xe2 x[9]:0x1 x[10]:0x6 x[11]:0xffffcdb72690 x[12]:0xffff8803d000 x[13]:0x5 x[14]:0x1b16c8 x[15]:0xfffffffffffff000 x[16]:0x1bdfd0 x[17]:0xfff x[18]:0x1ac000 x[19]:0x4 x[20]:0x0 x[21]:0xffff88281ae0 x[22]:0x40050d x[23]:0x1bdfd0 x[24]:0x2 x[25]:0x0 x[26]:0xffff88281b00 x[27]:0x0 x[28]:0xffffcdb724e0 x[29]:0xffffcdb726c0 x[30]:0xffff8824c9d8 sp:0xffffcdb724b0 pc:0xffff8826290c pstate:0x1000
226: }
226: {
226:   real_time:35373927.433310 global_time:96, event:`SYSCALL: mprotect' (state:EXITING_SYSCALL) tid:1987991, ticks:12294
226: x[0]:0x0 x[1]:0x1e000 x[2]:0x0 x[3]:0x1ac000 x[4]:0x4 x[5]:0x0 x[6]:0xffffcdb72910 x[7]:0x1 x[8]:0xe2 x[9]:0x1 x[10]:0x6 x[11]:0xffffcdb72690 x[12]:0xffff8803d000 x[13]:0x5 x[14]:0x1b16c8 x[15]:0xfffffffffffff000 x[16]:0x1bdfd0 x[17]:0xfff x[18]:0x1ac000 x[19]:0x4 x[20]:0x0 x[21]:0xffff88281ae0 x[22]:0x40050d x[23]:0x1bdfd0 x[24]:0x2 x[25]:0x0 x[26]:0xffff88281b00 x[27]:0x0 x[28]:0xffffcdb724e0 x[29]:0xffffcdb726c0 x[30]:0xffff8824c9d8 sp:0xffffcdb724b0 pc:0xffff8826290c pstate:0x1000
226: }
226: {
226:   real_time:35373927.433570 global_time:97, event:`SYSCALL: mmap' (state:ENTERING_SYSCALL) tid:1987991, ticks:12304
226: x[0]:0xffff881e9000 x[1]:0x6000 x[2]:0x3 x[3]:0x812 x[4]:0x4 x[5]:0x19c000 x[6]:0xffffcdb72910 x[7]:0xffffcdb72510 x[8]:0xde x[9]:0x1 x[10]:0x6 x[11]:0xffffcdb72690 x[12]:0xffff8803d000 x[13]:0x3 x[14]:0x1b16c8 x[15]:0xfffffffffffff000 x[16]:0x1bdfd0 x[17]:0xfff x[18]:0x1ac000 x[19]:0x4 x[20]:0x0 x[21]:0xffff88281ae0 x[22]:0x40050d x[23]:0x1bdfd0 x[24]:0x2 x[25]:0x0 x[26]:0xffff88281b00 x[27]:0x0 x[28]:0xffffcdb724e0 x[29]:0xffffcdb726c0 x[30]:0xffff8824caec sp:0xffffcdb724b0 pc:0xffff8826287c pstate:0x40001000
226: }
226: {
226:   real_time:35373927.433931 global_time:98, event:`SYSCALL: mmap' (state:EXITING_SYSCALL) tid:1987991, ticks:12304
226: x[0]:0xffff881e9000 x[1]:0x6000 x[2]:0x3 x[3]:0x812 x[4]:0x4 x[5]:0x19c000 x[6]:0xffffcdb72910 x[7]:0xffffcdb72510 x[8]:0xde x[9]:0x1 x[10]:0x6 x[11]:0xffffcdb72690 x[12]:0xffff8803d000 x[13]:0x3 x[14]:0x1b16c8 x[15]:0xfffffffffffff000 x[16]:0x1bdfd0 x[17]:0xfff x[18]:0x1ac000 x[19]:0x4 x[20]:0x0 x[21]:0xffff88281ae0 x[22]:0x40050d x[23]:0x1bdfd0 x[24]:0x2 x[25]:0x0 x[26]:0xffff88281b00 x[27]:0x0 x[28]:0xffffcdb724e0 x[29]:0xffffcdb726c0 x[30]:0xffff8824caec sp:0xffffcdb724b0 pc:0xffff8826287c pstate:0x40001000
226:   { map_file:"/usr/lib64/libc.so.6", addr:0xffff881e9000, length:0x6000, prot_flags:"rw-p", file_offset:0x19c000, device:64512, inode:34577689, data_file:"/tmp/rr-test-setitimer-WxwgBHNqB/setitimer-WxwgBHNqB-0/mmap_clone_18_libc.so.6", data_offset:0x19c000, file_size:0x231a28 }
226: }
226: {
226:   real_time:35373927.434268 global_time:99, event:`SYSCALL: mmap' (state:ENTERING_SYSCALL) tid:1987991, ticks:12354
226: x[0]:0xffff881ef000 x[1]:0xbfd0 x[2]:0x3 x[3]:0x32 x[4]:0xffffffffffffffff x[5]:0x0 x[6]:0xffffcdb72910 x[7]:0xffffcdb72510 x[8]:0xde x[9]:0x1 x[10]:0x6 x[11]:0xffffcdb72690 x[12]:0xffff88285b20 x[13]:0x3 x[14]:0x1b16c8 x[15]:0xfffffffffffff000 x[16]:0x1bdfd0 x[17]:0xfff x[18]:0x1ac000 x[19]:0x4 x[20]:0x0 x[21]:0xffff88281ae0 x[22]:0x40050d x[23]:0x1bdfd0 x[24]:0x2 x[25]:0x0 x[26]:0xffff88281b00 x[27]:0x0 x[28]:0xffffcdb724e0 x[29]:0xffffcdb726c0 x[30]:0xffff8824d3b4 sp:0xffffcdb724b0 pc:0xffff8826287c pstate:0x40001000
226: }
226: {
226:   real_time:35373927.434540 global_time:100, event:`SYSCALL: mmap' (state:EXITING_SYSCALL) tid:1987991, ticks:12354
226: x[0]:0xffff881ef000 x[1]:0xbfd0 x[2]:0x3 x[3]:0x32 x[4]:0xffffffffffffffff x[5]:0x0 x[6]:0xffffcdb72910 x[7]:0xffffcdb72510 x[8]:0xde x[9]:0x1 x[10]:0x6 x[11]:0xffffcdb72690 x[12]:0xffff88285b20 x[13]:0x3 x[14]:0x1b16c8 x[15]:0xfffffffffffff000 x[16]:0x1bdfd0 x[17]:0xfff x[18]:0x1ac000 x[19]:0x4 x[20]:0x0 x[21]:0xffff88281ae0 x[22]:0x40050d x[23]:0x1bdfd0 x[24]:0x2 x[25]:0x0 x[26]:0xffff88281b00 x[27]:0x0 x[28]:0xffffcdb724e0 x[29]:0xffffcdb726c0 x[30]:0xffff8824d3b4 sp:0xffffcdb724b0 pc:0xffff8826287c pstate:0x40001000
226:   { map_file:"<ZERO>", addr:0xffff881ef000, length:0xc000, prot_flags:"rw-p", file_offset:0x0, device:0, inode:0, data_file:"", data_offset:0x0, file_size:0xc000 }
226: }
226: {
226:   real_time:35373927.434831 global_time:101, event:`SYSCALL: close' (state:ENTERING_SYSCALL) tid:1987991, ticks:12486
226: x[0]:0x4 x[1]:0xffff8803d040 x[2]:0x6 x[3]:0xffff8803d040 x[4]:0xffffffff90000000 x[5]:0xffff8803d000 x[6]:0xffffcdb72910 x[7]:0xffffffff90000023 x[8]:0x39 x[9]:0x1 x[10]:0x6 x[11]:0x6fffffff x[12]:0x70000028 x[13]:0x38 x[14]:0x6ffffdff x[15]:0x6ffffe3b x[16]:0x6fffff47 x[17]:0x6ffffeff x[18]:0x1ac000 x[19]:0x4 x[20]:0x0 x[21]:0xffff88281ae0 x[22]:0x40050d x[23]:0x1bdfd0 x[24]:0xffff8803d040 x[25]:0x0 x[26]:0xffff88281b00 x[27]:0x6474e553 x[28]:0xffffcdb724e0 x[29]:0xffffcdb726c0 x[30]:0xffff8824d168 sp:0xffffcdb72690 pc:0xffff8826250c pstate:0x60001000
226: }
226: {
226:   real_time:35373927.435081 global_time:102, event:`SYSCALL: close' (state:EXITING_SYSCALL) tid:1987991, ticks:12486
226: x[0]:0x0 x[1]:0xffff8803d040 x[2]:0x6 x[3]:0xffff8803d040 x[4]:0xffffffff90000000 x[5]:0xffff8803d000 x[6]:0xffffcdb72910 x[7]:0xffffffff90000023 x[8]:0x39 x[9]:0x1 x[10]:0x6 x[11]:0x6fffffff x[12]:0x70000028 x[13]:0x38 x[14]:0x6ffffdff x[15]:0x6ffffe3b x[16]:0x6fffff47 x[17]:0x6ffffeff x[18]:0x1ac000 x[19]:0x4 x[20]:0x0 x[21]:0xffff88281ae0 x[22]:0x40050d x[23]:0x1bdfd0 x[24]:0xffff8803d040 x[25]:0x0 x[26]:0xffff88281b00 x[27]:0x6474e553 x[28]:0xffffcdb724e0 x[29]:0xffffcdb726c0 x[30]:0xffff8824d168 sp:0xffffcdb72690 pc:0xffff8826250c pstate:0x60001000
226: }
226: === Start rr backtrace:
226: rr(_ZN2rr13dump_rr_stackERNS_8ScopedFdE+0x38)[0x5ad86c]
226: rr(_ZN2rr15emergency_debugEPNS_4TaskE+0xe8)[0x4a1da8]
226: rr[0x4a97d4]
226: rr[0x4a9a0c]
226: rr[0x4a9a4c]
226: rr(_ZN2rr12PerfCounters10read_ticksEPNS_4TaskEPNS0_5ErrorE+0x270)[0x4c3fd0]
226: rr[0x4d19d0]
226: rr(_ZN2rr4Task11did_waitpidENS_10WaitStatusE+0x79c)[0x58039c]
226: rr(_ZN2rr9Scheduler10rescheduleENS_10SwitchableE+0xd30)[0x563100]
226: rr(_ZN2rr13RecordSession11record_stepEv+0xb4)[0x4e1864]
226: rr(_ZN2rr13RecordCommand3runERSt6vectorINSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEESaIS7_EE+0x7e4)[0x4d8f24]
226: rr(main+0x16c)[0x430f7c]
226: /lib64/libc.so.6(+0x27300)[0xffff9c464300]
226: /lib64/libc.so.6(__libc_start_main+0x98)[0xffff9c4643d8]
226: rr(_start+0x30)[0x4337f0]
226: === End rr backtrace
226: process 1987982 sent SIGURG
226: ====== /proc/1987982/status
226: Name:      rr
226: Umask:     0022
226: State:     S (sleeping)
226: Tgid:      1987982
226: Ngid:      0
226: Pid:       1987982
226: PPid:      1987981
226: TracerPid: 0
226: Uid:       1000    1000    1000    1000
226: Gid:       1000    1000    1000    1000
226: FDSize:    64
226: Groups:    4 190 1000
226: NStgid:    1987982
226: NSpid:     1987982
226: NSpgid:    1987982
226: NSsid:     1892204
226: VmPeak:      622504 kB
226: VmSize:      586092 kB
226: VmLck:            0 kB
226: VmPin:            0 kB
226: VmHWM:        27080 kB
226: VmRSS:        19712 kB
226: RssAnon:      12972 kB
226: RssFile:       6740 kB
226: RssShmem:         0 kB
226: VmData:       56196 kB
226: VmStk:          132 kB
226: VmExe:         3132 kB
226: VmLib:         6340 kB
226: VmPTE:          140 kB
226: VmSwap:           0 kB
226: HugetlbPages:             0 kB
226: CoreDumping:       0
226: THP_enabled:       1
226: Threads:   2
226: SigQ:      0/93827
226: SigPnd:    0000000000000000
226: ShdPnd:    0000000000000000
226: SigBlk:    0000000000010000
226: SigIgn:    0000000000000035
226: SigCgt:    0000000100006400
226: CapInh:    0000000000000000
226: CapPrm:    0000000000000000
226: CapEff:    0000000000000000
226: CapBnd:    000001ffffffffff
226: CapAmb:    0000000000000000
226: NoNewPrivs:        0
226: Seccomp:   0
226: Seccomp_filters:   0
226: Speculation_Store_Bypass:  thread vulnerable
226: SpeculationIndirectBranch: unknown
226: Cpus_allowed:      8
226: Cpus_allowed_list: 3
226: Mems_allowed:      00000000,00000001
226: Mems_allowed_list: 0
226: voluntary_ctxt_switches:   147
226: nonvoluntary_ctxt_switches:        1
226: ====== /proc/1987982/stack
226: ====== /proc/1987983/status
226: Name:      TraceeAttention
226: Umask:     0022
226: State:     S (sleeping)
226: Tgid:      1987982
226: Ngid:      0
226: Pid:       1987983
226: PPid:      1987981
226: TracerPid: 0
226: Uid:       1000    1000    1000    1000
226: Gid:       1000    1000    1000    1000
226: FDSize:    64
226: Groups:    4 190 1000
226: NStgid:    1987982
226: NSpid:     1987983
226: NSpgid:    1987982
226: NSsid:     1892204
226: VmPeak:      622504 kB
226: VmSize:      586092 kB
226: VmLck:            0 kB
226: VmPin:            0 kB
226: VmHWM:        27080 kB
226: VmRSS:        19712 kB
226: RssAnon:      12972 kB
226: RssFile:       6740 kB
226: RssShmem:         0 kB
226: VmData:       56196 kB
226: VmStk:          132 kB
226: VmExe:         3132 kB
226: VmLib:         6340 kB
226: VmPTE:          140 kB
226: VmSwap:           0 kB
226: HugetlbPages:             0 kB
226: CoreDumping:       0
226: THP_enabled:       1
226: Threads:   2
226: SigQ:      0/93827
226: SigPnd:    0000000000000000
226: ShdPnd:    0000000000000000
226: SigBlk:    fffffffe7ffbfeff
226: SigIgn:    0000000000000035
226: SigCgt:    0000000100006400
226: CapInh:    0000000000000000
226: CapPrm:    0000000000000000
226: CapEff:    0000000000000000
226: CapBnd:    000001ffffffffff
226: CapAmb:    0000000000000000
226: NoNewPrivs:        0
226: Seccomp:   0
226: Seccomp_filters:   0
226: Speculation_Store_Bypass:  thread vulnerable
226: SpeculationIndirectBranch: unknown
226: Cpus_allowed:      f
226: Cpus_allowed_list: 0-3
226: Mems_allowed:      00000000,00000001
226: Mems_allowed_list: 0
226: voluntary_ctxt_switches:   140
226: nonvoluntary_ctxt_switches:        0
226: ====== /proc/1987983/stack
226: ====== /proc/1987991/status
226: Name:      setitimer-WxwgB
226: Umask:     0022
226: State:     t (tracing stop)
226: Tgid:      1987991
226: Ngid:      0
226: Pid:       1987991
226: PPid:      1987982
226: TracerPid: 1987982
226: Uid:       1000    1000    1000    1000
226: Gid:       1000    1000    1000    1000
226: FDSize:    1024
226: Groups:    4 190 1000
226: NStgid:    1987991
226: NSpid:     1987991
226: NSpgid:    1987982
226: NSsid:     1892204
226: VmPeak:        4768 kB
226: VmSize:        4768 kB
226: VmLck:            0 kB
226: VmPin:            0 kB
226: VmHWM:         2548 kB
226: VmRSS:         2548 kB
226: RssAnon:       2236 kB
226: RssFile:        312 kB
226: RssShmem:         0 kB
226: VmData:        2344 kB
226: VmStk:            0 kB
226: VmExe:            8 kB
226: VmLib:         2060 kB
226: VmPTE:           52 kB
226: VmSwap:           0 kB
226: HugetlbPages:             0 kB
226: CoreDumping:       0
226: THP_enabled:       1
226: Threads:   1
226: SigQ:      0/93827
226: SigPnd:    0000000000000000
226: ShdPnd:    0000000000000000
226: SigBlk:    0000000000000000
226: SigIgn:    0000000000000000
226: SigCgt:    0000000000000000
226: CapInh:    0000000000000000
226: CapPrm:    0000000000000000
226: CapEff:    0000000000000000
226: CapBnd:    000001ffffffffff
226: CapAmb:    0000000000000000
226: NoNewPrivs:        1
226: Seccomp:   2
226: Seccomp_filters:   1
226: Speculation_Store_Bypass:  thread vulnerable
226: SpeculationIndirectBranch: unknown
226: Cpus_allowed:      8
226: Cpus_allowed_list: 3
226: Mems_allowed:      00000000,00000001
226: Mems_allowed_list: 0
226: voluntary_ctxt_switches:   136
226: nonvoluntary_ctxt_switches:        0
226: ====== /proc/1987991/stack
226: ====== gdb -p 1987982 -ex 'set confirm off' -ex 'set height 0' -ex 'thread apply all bt' -ex q </dev/null 2>&1
226: GNU gdb (GDB) Red Hat Enterprise Linux 10.2-13.0.1.el9
226: Copyright (C) 2021 Free Software Foundation, Inc.
226: License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
226: This is free software: you are free to change and redistribute it.
226: There is NO WARRANTY, to the extent permitted by law.
226: Type "show copying" and "show warranty" for details.
226: This GDB was configured as "aarch64-redhat-linux-gnu".
226: Type "show configuration" for configuration details.
226: For bug reporting instructions, please see:
226: <https://www.gnu.org/software/gdb/bugs/>.
226: Find the GDB manual and other documentation resources online at:
226:     <http://www.gnu.org/software/gdb/documentation/>.
226:
226: For help, type "help".
226: Type "apropos word" to search for commands related to "word".
226: Attaching to process 1987982
226: [New LWP 1987983]
226: [Thread debugging using libthread_db enabled]
226: Using host libthread_db library "/lib64/libthread_db.so.1".
226: 0x0000ffff9c5293a0 in accept () from /lib64/libc.so.6
226:
226: Thread 2 (Thread 0xffff9c43c0e0 (LWP 1987983) "TraceeAttention"):
226: #0  0x0000ffff9c519910 in read () from /lib64/libc.so.6
226: #1  0x0000000000596ab8 in rr::tracee_attention_set_thread (p=<optimized out>) at /home/opc/rr/src/TraceeAttentionSet.cc:31
226: #2  0x0000ffff9c4bd6b8 in start_thread () from /lib64/libc.so.6
226: #3  0x0000ffff9c527c5c in thread_start () from /lib64/libc.so.6
226:
226: Thread 1 (Thread 0xffff9cb64440 (LWP 1987982) "rr"):
226: #0  0x0000ffff9c5293a0 in accept () from /lib64/libc.so.6
226: #1  0x000000000047a4ec in rr::GdbServerConnection::await_debugger (listen_fd=..., this=<optimized out>) at /home/opc/rr/src/ScopedFd.h:36
226: #2  rr::GdbServerConnection::await_connection (t=<optimized out>, listen_fd=..., features=...) at /home/opc/rr/src/GdbServerConnection.cc:115
226: #3  0x00000000004a1ee8 in rr::emergency_debug (t=0x2ab65530) at /home/opc/rr/src/launch_debugger.cc:404
226: #4  0x00000000004a97d4 in rr::start_emergency_debug (t=0x2ab65530) at /home/opc/rr/src/log.cc:519
226: #5  0x00000000004a9a0c in rr::EmergencyDebugOstream::~EmergencyDebugOstream (this=<optimized out>, this=<optimized out>) at /home/opc/rr/src/log.cc:541
226: #6  0x00000000004a9a4c in rr::EmergencyDebugOstream::~EmergencyDebugOstream (this=<optimized out>, this=<optimized out>) at /home/opc/rr/src/log.cc:536
226: #7  0x00000000004c3fd0 in rr::PerfCounters::read_ticks (this=0x2ab65578, t=0x2ab65530, error=0x0) at /home/opc/rr/src/PerfCounters.cc:1072
226: #8  0x00000000004d19d0 in rr::PerfCounters::stop (this=0x2ab65578, t=<optimized out>, error=<optimized out>) at /home/opc/rr/src/PerfCounters.cc:1005
226: #9  0x000000000058039c in rr::Task::did_waitpid (this=0x2ab65530, status=...) at /home/opc/rr/src/Task.cc:2385
226: #10 0x0000000000563100 in rr::Scheduler::reschedule (this=0x2ab637d0, switchable=<optimized out>) at /home/opc/rr/src/Scheduler.cc:744
226: #11 0x00000000004e1864 in rr::RecordSession::record_step (this=0x2ab63580) at /home/opc/rr/src/RecordSession.h:148
226: #12 0x00000000004d8f24 in rr::record (flags=..., args=...) at /home/opc/rr/src/RecordCommand.cc:721
226: #13 rr::RecordCommand::run (this=<optimized out>, args=...) at /home/opc/rr/src/RecordCommand.cc:884
226: #14 0x0000000000430f7c in main (argc=<optimized out>, argv=<optimized out>) at /home/opc/rr/src/main.cc:278
226: Detaching from program: /home/opc/rr/build/bin/rr, process 1987982
226: [Inferior 1 (process 1987982) detached]
226: [FATAL src/log.cc:520:start_emergency_debug()] Can't resume execution from invalid state
226: 1911' '/tmp/rr-test-setitimer-WxwgBHNqB/setitimer-WxwgBHNqB' -ex 'set confirm off' -ex 'set height 0' -ex 'info registers' -ex 'thread apply all bt' -ex q  </dev/null 2>&1
226: GNU gdb (GDB) Red Hat Enterprise Linux 10.2-13.0.1.el9
226: Copyright (C) 2021 Free Software Foundation, Inc.
226: License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
226: This is free software: you are free to change and redistribute it.
226: There is NO WARRANTY, to the extent permitted by law.
226: Type "show copying" and "show warranty" for details.
226: This GDB was configured as "aarch64-redhat-linux-gnu".
226: Type "show configuration" for configuration details.
226: For bug reporting instructions, please see:
226: <https://www.gnu.org/software/gdb/bugs/>.
226: Find the GDB manual and other documentation resources online at:
226:     <http://www.gnu.org/software/gdb/documentation/>.
226:
226: For help, type "help".
226: Type "apropos word" to search for commands related to "word"...
226: Reading symbols from /tmp/rr-test-setitimer-WxwgBHNqB/setitimer-WxwgBHNqB...
226: Remote debugging using 127.0.0.1:21911
226: warning: Could not load shared library symbols for linux-vdso.so.1.
226: Do you need "set solib-search-path" or "set sysroot"?
226: Reading symbols from /home/opc/rr/build/lib/rr/librrpreload.so...
226: Reading symbols from /lib64/libdl.so.2...
226: Reading symbols from .gnu_debugdata for /lib64/libdl.so.2...
226: (No debugging symbols found in .gnu_debugdata for /lib64/libdl.so.2)
226: Reading symbols from /lib64/libc.so.6...
226: (No debugging symbols found in /lib64/libc.so.6)
226: Reading symbols from /lib/ld-linux-aarch64.so.1...
226: __mmap64 (offset=0, fd=-1, flags=34, prot=3, len=8192, addr=<optimized out>)
226:     at ../sysdeps/unix/sysv/linux/mmap64.c:59
226: 59 ../sysdeps/unix/sysv/linux/mmap64.c: No such file or directory.
226: x0             0x0                 0
226: x1             0x2000              8192
226: x2             0x3                 3
226: x3             0x22                34
226: x4             0xffffffffffffffff  -1
226: x5             0x0                 0
226: x6             0x0                 0
226: x7             0x0                 0
226: x8             0xde                222
226: x9             0x0                 0
226: x10            0x90                144
226: x11            0x0                 0
226: x12            0xffff882824e8      281472966075624
226: x13            0x40                64
226: x14            0xffff88286018      281472966090776
226: x15            0x0                 0
226: x16            0x1                 1
226: x17            0x1                 1
226: x18            0x1ac000            1753088
226: x19            0xffff88287000      281472966094848
226: x20            0xf08               3848
226: x21            0x2000              8192
226: x22            0x20                32
226: x23            0xffff882871a0      281472966095264
226: x24            0xffffcdb734c0      281474133079232
226: x25            0xffffcdb734a8      281474133079208
226: x26            0x400040            4194368
226: x27            0xffff88285000      281472966086656
226: x28            0x0                 0
226: x29            0xffffcdb732d0      281474133078736
226: x30            0xffff8825b7e0      281472965916640
226: sp             0xffffcdb732d0      0xffffcdb732d0
226: pc             0xffff8826287c      0xffff8826287c <__mmap64+28>
226: cpsr           0x40001000          [ EL=0 SSBS Z ]
226: fpsr           0x0                 0
226: fpcr           0x0                 0
226:
226: Thread 1 (Thread 1987991.1987991 (setitimer-WxwgB)):
226: #0  __mmap64 (offset=0, fd=-1, flags=34, prot=3, len=8192, addr=<optimized out>) at ../sysdeps/unix/sysv/linux/mmap64.c:59
226: #1  __mmap64 (addr=<optimized out>, len=8192, prot=3, flags=34, fd=-1, offset=0) at ../sysdeps/unix/sysv/linux/mmap64.c:47
226: #2  0x0000ffff8825b7e0 in rtld_malloc (n=3848) at dl-minimal.c:152
226: #3  0x0000ffff882563a8 in malloc (size=3848) at ../include/rtld-malloc.h:56
226: #4  _dl_allocate_tls_storage () at dl-tls.c:465
226: #5  0x0000ffff8825d240 in init_tls (naudit=naudit@entry=0) at rtld.c:799
226: #6  0x0000ffff88260144 in dl_main (phdr=<optimized out>, phnum=<optimized out>, user_entry=<optimized out>, auxv=<optimized out>) at rtld.c:2062
226: #7  0x0000ffff8825c2d4 in _dl_sysdep_start (start_argptr=start_argptr@entry=0xffffcdb7403d, dl_main=dl_main@entry=0xffff8825dfd0 <dl_main>) at ../sysdeps/unix/sysv/linux/dl-sysdep.c:140
226: #8  0x0000ffff8825d810 in _dl_start_final (arg=0xffffcdb7403d) at rtld.c:502
226: #9  _dl_start (arg=<optimized out>) at rtld.c:587
226: #10 0x0000ffff8825cc3c in _start () from /lib/ld-linux-aarch64.so.1
226: Backtrace stopped: previous frame identical to this frame (corrupt stack?)
226: Detaching from program: /tmp/rr-test-setitimer-WxwgBHNqB/setitimer-WxwgBHNqB, process 1987991
226: [Inferior 1 (process 1987991) detached]
226: --------------------------------------------------
226: record.out:
226: --------------------------------------------------
226: --------------------------------------------------
226: Test setitimer failed, leaving behind /tmp/rr-test-setitimer-WxwgBHNqB
226: To replay the failed test, run
226:   _RR_TRACE_DIR=/tmp/rr-test-setitimer-WxwgBHNqB rr replay
1/3 Test #226: setitimer-no-syscallbuf ..........***Failed  Error regular expression found in output. Regex=[FAILED]  9.26 sec
test 804
    Start 804: timer-no-syscallbuf

804: Test command: /usr/bin/bash "source_dir/src/test/basic_test.run" "timer" "-n" "bin_dir" "120"
804: Working Directory: /home/opc/rr/build
804: Test timeout computed to be: 10000000
804: source_dir/src/test/util.sh: line 280: 1988034 Aborted                 (core dumped) _RR_TRACE_DIR="$workdir" test-monitor $TIMEOUT record.err $RR_EXE $GLOBAL_OPTIONS record $LIB_ARG $RECORD_ARGS "$exe" $exeargs > record.out 2> record.err
804: Test 'timer' FAILED: : error during recording:
804: --------------------------------------------------
804: [FATAL src/PerfCounters.cc:1072:read_ticks()]
804:  (task 1988044 (rec:1988044) at time 103)
804:  -> Assertion `false' failed to hold. 1 (speculatively) executed strex instructions detected.
804: On aarch64, rr only supports applications making use of LSE
804: atomics rather than legacy LL/SC-based atomics.
804: Aborting. Retry with -F to override, but replaying such
804: a recording will probably fail.
804: Tail of trace dump:
804: {
804:   real_time:35373936.683676 global_time:83, event:`SYSCALL: faccessat' (state:ENTERING_SYSCALL) tid:1988044, ticks:11476
804: x[0]:0xffffffffffffff9c x[1]:0xffffb62df528 x[2]:0x4 x[3]:0x0 x[4]:0x4 x[5]:0xffffb62cce40 x[6]:0x3 x[7]:0xffffffff90000023 x[8]:0x30 x[9]:0x1 x[10]:0x6ad1d x[11]:0x6fffffff x[12]:0x1050 x[13]:0x38 x[14]:0x6ffffdff x[15]:0x6ffffe3b x[16]:0xffffb62cce40 x[17]:0x6ffffeff x[18]:0x1f000 x[19]:0x1 x[20]:0x2 x[21]:0xffffb62fd2b0 x[22]:0xffffb62df000 x[23]:0xffffb62df528 x[24]:0xffffe52af6b0 x[25]:0xffffe52af698 x[26]:0x400040 x[27]:0xffffb62fb000 x[28]:0x0 x[29]:0xffffe52af580 x[30]:0xffffb62d5960 sp:0xffffe52af570 pc:0xffffb62d84d4 pstate:0x20001000
804: }
804: {
804:   real_time:35373936.683913 global_time:84, event:`SYSCALL: faccessat' (state:EXITING_SYSCALL) tid:1988044, ticks:11476
804: x[0]:0xfffffffffffffffe x[1]:0xffffb62df528 x[2]:0x4 x[3]:0x0 x[4]:0x4 x[5]:0xffffb62cce40 x[6]:0x3 x[7]:0xffffffff90000023 x[8]:0x30 x[9]:0x1 x[10]:0x6ad1d x[11]:0x6fffffff x[12]:0x1050 x[13]:0x38 x[14]:0x6ffffdff x[15]:0x6ffffe3b x[16]:0xffffb62cce40 x[17]:0x6ffffeff x[18]:0x1f000 x[19]:0x1 x[20]:0x2 x[21]:0xffffb62fd2b0 x[22]:0xffffb62df000 x[23]:0xffffb62df528 x[24]:0xffffe52af6b0 x[25]:0xffffe52af698 x[26]:0x400040 x[27]:0xffffb62fb000 x[28]:0x0 x[29]:0xffffe52af580 x[30]:0xffffb62d5960 sp:0xffffe52af570 pc:0xffffb62d84d4 pstate:0x20001000
804: }
804: {
804:   real_time:35373936.684191 global_time:85, event:`SYSCALL: openat' (state:ENTERING_SYSCALL) tid:1988044, ticks:11749
804: x[0]:0xffffffffffffff9c x[1]:0xffffe52ae890 x[2]:0x80000 x[3]:0x0 x[4]:0xffffe52aeae7 x[5]:0x0 x[6]:0x0 x[7]:0x362e6f732e6362 x[8]:0x38 x[9]:0x1d x[10]:0xffffb5e70d83 x[11]:0x6fffffff x[12]:0x1050 x[13]:0x38 x[14]:0x6ffffdff x[15]:0x6ffffe3b x[16]:0xffffb62fbf98 x[17]:0xffffb62d0af0 x[18]:0x1f000 x[19]:0xffffe52ae890 x[20]:0xffffb62fb000 x[21]:0xffffb62fd2b0 x[22]:0x19 x[23]:0xffffe52aeae7 x[24]:0xffffe52ae89f x[25]:0x8 x[26]:0xffffb62fad48 x[27]:0xffffb62f7024 x[28]:0xffffe52aeaf8 x[29]:0xffffe52ae800 x[30]:0xffffb62c0c68 sp:0xffffe52ae7c0 pc:0xffffb62d8684 pstate:0x80001000
804: }
804: {
804:   real_time:35373936.684433 global_time:86, event:`SYSCALL: openat' (state:EXITING_SYSCALL) tid:1988044, ticks:11749
804: x[0]:0xfffffffffffffffe x[1]:0xffffe52ae890 x[2]:0x80000 x[3]:0x0 x[4]:0xffffe52aeae7 x[5]:0x0 x[6]:0x0 x[7]:0x362e6f732e6362 x[8]:0x38 x[9]:0x1d x[10]:0xffffb5e70d83 x[11]:0x6fffffff x[12]:0x1050 x[13]:0x38 x[14]:0x6ffffdff x[15]:0x6ffffe3b x[16]:0xffffb62fbf98 x[17]:0xffffb62d0af0 x[18]:0x1f000 x[19]:0xffffe52ae890 x[20]:0xffffb62fb000 x[21]:0xffffb62fd2b0 x[22]:0x19 x[23]:0xffffe52aeae7 x[24]:0xffffe52ae89f x[25]:0x8 x[26]:0xffffb62fad48 x[27]:0xffffb62f7024 x[28]:0xffffe52aeaf8 x[29]:0xffffe52ae800 x[30]:0xffffb62c0c68 sp:0xffffe52ae7c0 pc:0xffffb62d8684 pstate:0x80001000
804: }
804: {
804:   real_time:35373936.685111 global_time:87, event:`SYSCALL: openat' (state:ENTERING_SYSCALL) tid:1988044, ticks:12040
804: x[0]:0xffffffffffffff9c x[1]:0xffffb62f7ae0 x[2]:0x80000 x[3]:0x0 x[4]:0xffffe52aeae7 x[5]:0x0 x[6]:0x0 x[7]:0x362e6f732e636269 x[8]:0x38 x[9]:0x8000000000000100 x[10]:0x100 x[11]:0x1c2 x[12]:0x696c2f343662696c x[13]:0x362e6f732e6362 x[14]:0x6ffffdff x[15]:0x6ffffe3b x[16]:0xffffb62fbf98 x[17]:0xffffb62d0af0 x[18]:0x1f000 x[19]:0xffffb62f7ae0 x[20]:0xffffb62fb000 x[21]:0xffffb62fd2b0 x[22]:0x0 x[23]:0xffffe52aeae7 x[24]:0x0 x[25]:0xffffb62fc000 x[26]:0xffffb62fb000 x[27]:0xffffb62fa000 x[28]:0xffffe52aeaf8 x[29]:0xffffe52ae9a0 x[30]:0xffffb62c0c68 sp:0xffffe52ae960 pc:0xffffb62d8684 pstate:0x80001000
804: }
804: {
804:   real_time:35373936.685426 global_time:88, event:`SYSCALL: openat' (state:EXITING_SYSCALL) tid:1988044, ticks:12040
804: x[0]:0x4 x[1]:0xffffb62f7ae0 x[2]:0x80000 x[3]:0x0 x[4]:0xffffe52aeae7 x[5]:0x0 x[6]:0x0 x[7]:0x362e6f732e636269 x[8]:0x38 x[9]:0x8000000000000100 x[10]:0x100 x[11]:0x1c2 x[12]:0x696c2f343662696c x[13]:0x362e6f732e6362 x[14]:0x6ffffdff x[15]:0x6ffffe3b x[16]:0xffffb62fbf98 x[17]:0xffffb62d0af0 x[18]:0x1f000 x[19]:0xffffb62f7ae0 x[20]:0xffffb62fb000 x[21]:0xffffb62fd2b0 x[22]:0x0 x[23]:0xffffe52aeae7 x[24]:0x0 x[25]:0xffffb62fc000 x[26]:0xffffb62fb000 x[27]:0xffffb62fa000 x[28]:0xffffe52aeaf8 x[29]:0xffffe52ae9a0 x[30]:0xffffb62c0c68 sp:0xffffe52ae960 pc:0xffffb62d8684 pstate:0x80001000
804: }
804: {
804:   real_time:35373936.685687 global_time:89, event:`SYSCALL: read' (state:ENTERING_SYSCALL) tid:1988044, ticks:12044
804: x[0]:0x4 x[1]:0xffffe52aeb00 x[2]:0x340 x[3]:0x0 x[4]:0xffffe52aeae7 x[5]:0x0 x[6]:0x0 x[7]:0x362e6f732e636269 x[8]:0x3f x[9]:0x8000000000000100 x[10]:0x100 x[11]:0x1c2 x[12]:0x696c2f343662696c x[13]:0x362e6f732e6362 x[14]:0x6ffffdff x[15]:0x6ffffe3b x[16]:0xffffb62fbf98 x[17]:0xffffb62d0af0 x[18]:0x1f000 x[19]:0xffffb62f7ae0 x[20]:0xffffb62fb000 x[21]:0xffffb62fd000 x[22]:0x4 x[23]:0xffffe52aeae7 x[24]:0x340 x[25]:0xffffb62fc000 x[26]:0xffffb62fb000 x[27]:0xffffe52aeb00 x[28]:0xffffe52aeaf8 x[29]:0xffffe52ae9a0 x[30]:0xffffb62c0c9c sp:0xffffe52ae990 pc:0xffffb62d86ec pstate:0x1000
804: }
804: {
804:   real_time:35373936.685936 global_time:90, event:`SYSCALL: read' (state:EXITING_SYSCALL) tid:1988044, ticks:12044
804: x[0]:0x340 x[1]:0xffffe52aeb00 x[2]:0x340 x[3]:0x0 x[4]:0xffffe52aeae7 x[5]:0x0 x[6]:0x0 x[7]:0x362e6f732e636269 x[8]:0x3f x[9]:0x8000000000000100 x[10]:0x100 x[11]:0x1c2 x[12]:0x696c2f343662696c x[13]:0x362e6f732e6362 x[14]:0x6ffffdff x[15]:0x6ffffe3b x[16]:0xffffb62fbf98 x[17]:0xffffb62d0af0 x[18]:0x1f000 x[19]:0xffffb62f7ae0 x[20]:0xffffb62fb000 x[21]:0xffffb62fd000 x[22]:0x4 x[23]:0xffffe52aeae7 x[24]:0x340 x[25]:0xffffb62fc000 x[26]:0xffffb62fb000 x[27]:0xffffe52aeb00 x[28]:0xffffe52aeaf8 x[29]:0xffffe52ae9a0 x[30]:0xffffb62c0c9c sp:0xffffe52ae990 pc:0xffffb62d86ec pstate:0x1000
804:   { tid:1988044, addr:0xffffe52aeb00, length:0x340 }
804: }
804: {
804:   real_time:35373936.686256 global_time:91, event:`SYSCALL: fstat' (state:ENTERING_SYSCALL) tid:1988044, ticks:12098
804: x[0]:0x4 x[1]:0xffffe52ae9a0 x[2]:0xffffb62fd2b0 x[3]:0x0 x[4]:0xffffb62f7ae0 x[5]:0xffffb62fd2b0 x[6]:0x1 x[7]:0x0 x[8]:0x50 x[9]:0x8000000000000100 x[10]:0x14 x[11]:0x1c2 x[12]:0x696c2f343662696c x[13]:0x362e6f732e6362 x[14]:0x6ffffdff x[15]:0x6ffffe3b x[16]:0xffffb62fbf98 x[17]:0xffffb62d0af0 x[18]:0x1f000 x[19]:0x4 x[20]:0x0 x[21]:0xffffb62f7ae0 x[22]:0x400610 x[23]:0xffffe52aeaf8 x[24]:0xffffb62fd2b0 x[25]:0x0 x[26]:0xffffb62fb000 x[27]:0x400528 x[28]:0x1 x[29]:0xffffe52ae8b0 x[30]:0xffffb62c2ba4 sp:0xffffe52ae880 pc:0xffffb62d837c pstate:0x1000
804: }
804: {
804:   real_time:35373936.686505 global_time:92, event:`SYSCALL: fstat' (state:EXITING_SYSCALL) tid:1988044, ticks:12098
804: x[0]:0x0 x[1]:0xffffe52ae9a0 x[2]:0xffffb62fd2b0 x[3]:0x0 x[4]:0xffffb62f7ae0 x[5]:0xffffb62fd2b0 x[6]:0x1 x[7]:0x0 x[8]:0x50 x[9]:0x8000000000000100 x[10]:0x14 x[11]:0x1c2 x[12]:0x696c2f343662696c x[13]:0x362e6f732e6362 x[14]:0x6ffffdff x[15]:0x6ffffe3b x[16]:0xffffb62fbf98 x[17]:0xffffb62d0af0 x[18]:0x1f000 x[19]:0x4 x[20]:0x0 x[21]:0xffffb62f7ae0 x[22]:0x400610 x[23]:0xffffe52aeaf8 x[24]:0xffffb62fd2b0 x[25]:0x0 x[26]:0xffffb62fb000 x[27]:0x400528 x[28]:0x1 x[29]:0xffffe52ae8b0 x[30]:0xffffb62c2ba4 sp:0xffffe52ae880 pc:0xffffb62d837c pstate:0x1000
804:   { tid:1988044, addr:0xffffe52ae9a0, length:0x80 }
804: }
804: {
804:   real_time:35373936.686751 global_time:93, event:`SYSCALL: mmap' (state:ENTERING_SYSCALL) tid:1988044, ticks:12255
804: x[0]:0x0 x[1]:0x1bdfd0 x[2]:0x5 x[3]:0x802 x[4]:0x4 x[5]:0x0 x[6]:0xffffe52aeb00 x[7]:0x1 x[8]:0xde x[9]:0x1 x[10]:0x6 x[11]:0xffffe52ae880 x[12]:0x0 x[13]:0x5 x[14]:0x1b16c8 x[15]:0xfffffffffffff000 x[16]:0x1bdfd0 x[17]:0xfff x[18]:0x1ac000 x[19]:0x4 x[20]:0x0 x[21]:0xffffb62f7ae0 x[22]:0x400610 x[23]:0x1bdfd0 x[24]:0x2 x[25]:0x0 x[26]:0xffffb62f7b00 x[27]:0x0 x[28]:0xffffe52ae6d0 x[29]:0xffffe52ae8b0 x[30]:0xffffb62c297c sp:0xffffe52ae6a0 pc:0xffffb62d887c pstate:0x40001000
804: }
804: {
804:   real_time:35373936.687087 global_time:94, event:`SYSCALL: mmap' (state:EXITING_SYSCALL) tid:1988044, ticks:12255
804: x[0]:0xffffb60b3000 x[1]:0x1bdfd0 x[2]:0x5 x[3]:0x802 x[4]:0x4 x[5]:0x0 x[6]:0xffffe52aeb00 x[7]:0x1 x[8]:0xde x[9]:0x1 x[10]:0x6 x[11]:0xffffe52ae880 x[12]:0x0 x[13]:0x5 x[14]:0x1b16c8 x[15]:0xfffffffffffff000 x[16]:0x1bdfd0 x[17]:0xfff x[18]:0x1ac000 x[19]:0x4 x[20]:0x0 x[21]:0xffffb62f7ae0 x[22]:0x400610 x[23]:0x1bdfd0 x[24]:0x2 x[25]:0x0 x[26]:0xffffb62f7b00 x[27]:0x0 x[28]:0xffffe52ae6d0 x[29]:0xffffe52ae8b0 x[30]:0xffffb62c297c sp:0xffffe52ae6a0 pc:0xffffb62d887c pstate:0x40001000
804:   { map_file:"/usr/lib64/libc.so.6", addr:0xffffb60b3000, length:0x1be000, prot_flags:"r-xp", file_offset:0x0, device:64512, inode:34577689, data_file:"/tmp/rr-test-timer-NskPj8RoR/timer-NskPj8RoR-0/mmap_clone_17_libc.so.6", data_offset:0x0, file_size:0x231a28 }
804: }
804: {
804:   real_time:35373936.687387 global_time:95, event:`SYSCALL: mprotect' (state:ENTERING_SYSCALL) tid:1988044, ticks:12260
804: x[0]:0xffffb6241000 x[1]:0x1e000 x[2]:0x0 x[3]:0x1ac000 x[4]:0x4 x[5]:0x0 x[6]:0xffffe52aeb00 x[7]:0x1 x[8]:0xe2 x[9]:0x1 x[10]:0x6 x[11]:0xffffe52ae880 x[12]:0xffffb60b3000 x[13]:0x5 x[14]:0x1b16c8 x[15]:0xfffffffffffff000 x[16]:0x1bdfd0 x[17]:0xfff x[18]:0x1ac000 x[19]:0x4 x[20]:0x0 x[21]:0xffffb62f7ae0 x[22]:0x400610 x[23]:0x1bdfd0 x[24]:0x2 x[25]:0x0 x[26]:0xffffb62f7b00 x[27]:0x0 x[28]:0xffffe52ae6d0 x[29]:0xffffe52ae8b0 x[30]:0xffffb62c29d8 sp:0xffffe52ae6a0 pc:0xffffb62d890c pstate:0x1000
804: }
804: {
804:   real_time:35373936.687647 global_time:96, event:`SYSCALL: mprotect' (state:EXITING_SYSCALL) tid:1988044, ticks:12260
804: x[0]:0x0 x[1]:0x1e000 x[2]:0x0 x[3]:0x1ac000 x[4]:0x4 x[5]:0x0 x[6]:0xffffe52aeb00 x[7]:0x1 x[8]:0xe2 x[9]:0x1 x[10]:0x6 x[11]:0xffffe52ae880 x[12]:0xffffb60b3000 x[13]:0x5 x[14]:0x1b16c8 x[15]:0xfffffffffffff000 x[16]:0x1bdfd0 x[17]:0xfff x[18]:0x1ac000 x[19]:0x4 x[20]:0x0 x[21]:0xffffb62f7ae0 x[22]:0x400610 x[23]:0x1bdfd0 x[24]:0x2 x[25]:0x0 x[26]:0xffffb62f7b00 x[27]:0x0 x[28]:0xffffe52ae6d0 x[29]:0xffffe52ae8b0 x[30]:0xffffb62c29d8 sp:0xffffe52ae6a0 pc:0xffffb62d890c pstate:0x1000
804: }
804: {
804:   real_time:35373936.687887 global_time:97, event:`SYSCALL: mmap' (state:ENTERING_SYSCALL) tid:1988044, ticks:12270
804: x[0]:0xffffb625f000 x[1]:0x6000 x[2]:0x3 x[3]:0x812 x[4]:0x4 x[5]:0x19c000 x[6]:0xffffe52aeb00 x[7]:0xffffe52ae700 x[8]:0xde x[9]:0x1 x[10]:0x6 x[11]:0xffffe52ae880 x[12]:0xffffb60b3000 x[13]:0x3 x[14]:0x1b16c8 x[15]:0xfffffffffffff000 x[16]:0x1bdfd0 x[17]:0xfff x[18]:0x1ac000 x[19]:0x4 x[20]:0x0 x[21]:0xffffb62f7ae0 x[22]:0x400610 x[23]:0x1bdfd0 x[24]:0x2 x[25]:0x0 x[26]:0xffffb62f7b00 x[27]:0x0 x[28]:0xffffe52ae6d0 x[29]:0xffffe52ae8b0 x[30]:0xffffb62c2aec sp:0xffffe52ae6a0 pc:0xffffb62d887c pstate:0x40001000
804: }
804: {
804:   real_time:35373936.688265 global_time:98, event:`SYSCALL: mmap' (state:EXITING_SYSCALL) tid:1988044, ticks:12270
804: x[0]:0xffffb625f000 x[1]:0x6000 x[2]:0x3 x[3]:0x812 x[4]:0x4 x[5]:0x19c000 x[6]:0xffffe52aeb00 x[7]:0xffffe52ae700 x[8]:0xde x[9]:0x1 x[10]:0x6 x[11]:0xffffe52ae880 x[12]:0xffffb60b3000 x[13]:0x3 x[14]:0x1b16c8 x[15]:0xfffffffffffff000 x[16]:0x1bdfd0 x[17]:0xfff x[18]:0x1ac000 x[19]:0x4 x[20]:0x0 x[21]:0xffffb62f7ae0 x[22]:0x400610 x[23]:0x1bdfd0 x[24]:0x2 x[25]:0x0 x[26]:0xffffb62f7b00 x[27]:0x0 x[28]:0xffffe52ae6d0 x[29]:0xffffe52ae8b0 x[30]:0xffffb62c2aec sp:0xffffe52ae6a0 pc:0xffffb62d887c pstate:0x40001000
804:   { map_file:"/usr/lib64/libc.so.6", addr:0xffffb625f000, length:0x6000, prot_flags:"rw-p", file_offset:0x19c000, device:64512, inode:34577689, data_file:"/tmp/rr-test-timer-NskPj8RoR/timer-NskPj8RoR-0/mmap_clone_18_libc.so.6", data_offset:0x19c000, file_size:0x231a28 }
804: }
804: {
804:   real_time:35373936.688592 global_time:99, event:`SYSCALL: mmap' (state:ENTERING_SYSCALL) tid:1988044, ticks:12320
804: x[0]:0xffffb6265000 x[1]:0xbfd0 x[2]:0x3 x[3]:0x32 x[4]:0xffffffffffffffff x[5]:0x0 x[6]:0xffffe52aeb00 x[7]:0xffffe52ae700 x[8]:0xde x[9]:0x1 x[10]:0x6 x[11]:0xffffe52ae880 x[12]:0xffffb62fbb20 x[13]:0x3 x[14]:0x1b16c8 x[15]:0xfffffffffffff000 x[16]:0x1bdfd0 x[17]:0xfff x[18]:0x1ac000 x[19]:0x4 x[20]:0x0 x[21]:0xffffb62f7ae0 x[22]:0x400610 x[23]:0x1bdfd0 x[24]:0x2 x[25]:0x0 x[26]:0xffffb62f7b00 x[27]:0x0 x[28]:0xffffe52ae6d0 x[29]:0xffffe52ae8b0 x[30]:0xffffb62c33b4 sp:0xffffe52ae6a0 pc:0xffffb62d887c pstate:0x40001000
804: }
804: {
804:   real_time:35373936.688896 global_time:100, event:`SYSCALL: mmap' (state:EXITING_SYSCALL) tid:1988044, ticks:12320
804: x[0]:0xffffb6265000 x[1]:0xbfd0 x[2]:0x3 x[3]:0x32 x[4]:0xffffffffffffffff x[5]:0x0 x[6]:0xffffe52aeb00 x[7]:0xffffe52ae700 x[8]:0xde x[9]:0x1 x[10]:0x6 x[11]:0xffffe52ae880 x[12]:0xffffb62fbb20 x[13]:0x3 x[14]:0x1b16c8 x[15]:0xfffffffffffff000 x[16]:0x1bdfd0 x[17]:0xfff x[18]:0x1ac000 x[19]:0x4 x[20]:0x0 x[21]:0xffffb62f7ae0 x[22]:0x400610 x[23]:0x1bdfd0 x[24]:0x2 x[25]:0x0 x[26]:0xffffb62f7b00 x[27]:0x0 x[28]:0xffffe52ae6d0 x[29]:0xffffe52ae8b0 x[30]:0xffffb62c33b4 sp:0xffffe52ae6a0 pc:0xffffb62d887c pstate:0x40001000
804:   { map_file:"<ZERO>", addr:0xffffb6265000, length:0xc000, prot_flags:"rw-p", file_offset:0x0, device:0, inode:0, data_file:"", data_offset:0x0, file_size:0xc000 }
804: }
804: {
804:   real_time:35373936.689183 global_time:101, event:`SYSCALL: close' (state:ENTERING_SYSCALL) tid:1988044, ticks:12452
804: x[0]:0x4 x[1]:0xffffb60b3040 x[2]:0x6 x[3]:0xffffb60b3040 x[4]:0xffffffff90000000 x[5]:0xffffb60b3000 x[6]:0xffffe52aeb00 x[7]:0xffffffff90000023 x[8]:0x39 x[9]:0x1 x[10]:0x6 x[11]:0x6fffffff x[12]:0x70000028 x[13]:0x38 x[14]:0x6ffffdff x[15]:0x6ffffe3b x[16]:0x6fffff47 x[17]:0x6ffffeff x[18]:0x1ac000 x[19]:0x4 x[20]:0x0 x[21]:0xffffb62f7ae0 x[22]:0x400610 x[23]:0x1bdfd0 x[24]:0xffffb60b3040 x[25]:0x0 x[26]:0xffffb62f7b00 x[27]:0x6474e553 x[28]:0xffffe52ae6d0 x[29]:0xffffe52ae8b0 x[30]:0xffffb62c3168 sp:0xffffe52ae880 pc:0xffffb62d850c pstate:0x60001000
804: }
804: {
804:   real_time:35373936.689432 global_time:102, event:`SYSCALL: close' (state:EXITING_SYSCALL) tid:1988044, ticks:12452
804: x[0]:0x0 x[1]:0xffffb60b3040 x[2]:0x6 x[3]:0xffffb60b3040 x[4]:0xffffffff90000000 x[5]:0xffffb60b3000 x[6]:0xffffe52aeb00 x[7]:0xffffffff90000023 x[8]:0x39 x[9]:0x1 x[10]:0x6 x[11]:0x6fffffff x[12]:0x70000028 x[13]:0x38 x[14]:0x6ffffdff x[15]:0x6ffffe3b x[16]:0x6fffff47 x[17]:0x6ffffeff x[18]:0x1ac000 x[19]:0x4 x[20]:0x0 x[21]:0xffffb62f7ae0 x[22]:0x400610 x[23]:0x1bdfd0 x[24]:0xffffb60b3040 x[25]:0x0 x[26]:0xffffb62f7b00 x[27]:0x6474e553 x[28]:0xffffe52ae6d0 x[29]:0xffffe52ae8b0 x[30]:0xffffb62c3168 sp:0xffffe52ae880 pc:0xffffb62d850c pstate:0x60001000
804: }
804: === Start rr backtrace:
804: rr(_ZN2rr13dump_rr_stackERNS_8ScopedFdE+0x38)[0x5ad86c]
804: rr(_ZN2rr15emergency_debugEPNS_4TaskE+0xe8)[0x4a1da8]
804: rr[0x4a97d4]
804: rr[0x4a9a0c]
804: rr[0x4a9a4c]
804: rr(_ZN2rr12PerfCounters10read_ticksEPNS_4TaskEPNS0_5ErrorE+0x270)[0x4c3fd0]
804: rr[0x4d19d0]
804: rr(_ZN2rr4Task11did_waitpidENS_10WaitStatusE+0x79c)[0x58039c]
804: rr(_ZN2rr9Scheduler10rescheduleENS_10SwitchableE+0xd30)[0x563100]
804: rr(_ZN2rr13RecordSession11record_stepEv+0xb4)[0x4e1864]
804: rr(_ZN2rr13RecordCommand3runERSt6vectorINSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEESaIS7_EE+0x7e4)[0x4d8f24]
804: rr(main+0x16c)[0x430f7c]
804: /lib64/libc.so.6(+0x27300)[0xffff9e454300]
804: /lib64/libc.so.6(__libc_start_main+0x98)[0xffff9e4543d8]
804: rr(_start+0x30)[0x4337f0]
804: === End rr backtrace
804: process 1988035 sent SIGURG
804: ====== /proc/1988035/status
804: Name:      rr
804: Umask:     0022
804: State:     S (sleeping)
804: Tgid:      1988035
804: Ngid:      0
804: Pid:       1988035
804: PPid:      1988034
804: TracerPid: 0
804: Uid:       1000    1000    1000    1000
804: Gid:       1000    1000    1000    1000
804: FDSize:    64
804: Groups:    4 190 1000
804: NStgid:    1988035
804: NSpid:     1988035
804: NSpgid:    1988035
804: NSsid:     1892204
804: VmPeak:      621376 kB
804: VmSize:      586092 kB
804: VmLck:            0 kB
804: VmPin:            0 kB
804: VmHWM:        25092 kB
804: VmRSS:        19616 kB
804: RssAnon:      12832 kB
804: RssFile:       6784 kB
804: RssShmem:         0 kB
804: VmData:       56196 kB
804: VmStk:          132 kB
804: VmExe:         3132 kB
804: VmLib:         6340 kB
804: VmPTE:          140 kB
804: VmSwap:           0 kB
804: HugetlbPages:             0 kB
804: CoreDumping:       0
804: THP_enabled:       1
804: Threads:   2
804: SigQ:      0/93827
804: SigPnd:    0000000000000000
804: ShdPnd:    0000000000000000
804: SigBlk:    0000000000010000
804: SigIgn:    0000000000000035
804: SigCgt:    0000000100006400
804: CapInh:    0000000000000000
804: CapPrm:    0000000000000000
804: CapEff:    0000000000000000
804: CapBnd:    000001ffffffffff
804: CapAmb:    0000000000000000
804: NoNewPrivs:        0
804: Seccomp:   0
804: Seccomp_filters:   0
804: Speculation_Store_Bypass:  thread vulnerable
804: SpeculationIndirectBranch: unknown
804: Cpus_allowed:      4
804: Cpus_allowed_list: 2
804: Mems_allowed:      00000000,00000001
804: Mems_allowed_list: 0
804: voluntary_ctxt_switches:   161
804: nonvoluntary_ctxt_switches:        2
804: ====== /proc/1988035/stack
804: ====== /proc/1988036/status
804: Name:      TraceeAttention
804: Umask:     0022
804: State:     S (sleeping)
804: Tgid:      1988035
804: Ngid:      0
804: Pid:       1988036
804: PPid:      1988034
804: TracerPid: 0
804: Uid:       1000    1000    1000    1000
804: Gid:       1000    1000    1000    1000
804: FDSize:    64
804: Groups:    4 190 1000
804: NStgid:    1988035
804: NSpid:     1988036
804: NSpgid:    1988035
804: NSsid:     1892204
804: VmPeak:      621376 kB
804: VmSize:      586092 kB
804: VmLck:            0 kB
804: VmPin:            0 kB
804: VmHWM:        25092 kB
804: VmRSS:        19616 kB
804: RssAnon:      12832 kB
804: RssFile:       6784 kB
804: RssShmem:         0 kB
804: VmData:       56196 kB
804: VmStk:          132 kB
804: VmExe:         3132 kB
804: VmLib:         6340 kB
804: VmPTE:          140 kB
804: VmSwap:           0 kB
804: HugetlbPages:             0 kB
804: CoreDumping:       0
804: THP_enabled:       1
804: Threads:   2
804: SigQ:      0/93827
804: SigPnd:    0000000000000000
804: ShdPnd:    0000000000000000
804: SigBlk:    fffffffe7ffbfeff
804: SigIgn:    0000000000000035
804: SigCgt:    0000000100006400
804: CapInh:    0000000000000000
804: CapPrm:    0000000000000000
804: CapEff:    0000000000000000
804: CapBnd:    000001ffffffffff
804: CapAmb:    0000000000000000
804: NoNewPrivs:        0
804: Seccomp:   0
804: Seccomp_filters:   0
804: Speculation_Store_Bypass:  thread vulnerable
804: SpeculationIndirectBranch: unknown
804: Cpus_allowed:      f
804: Cpus_allowed_list: 0-3
804: Mems_allowed:      00000000,00000001
804: Mems_allowed_list: 0
804: voluntary_ctxt_switches:   137
804: nonvoluntary_ctxt_switches:        0
804: ====== /proc/1988036/stack
804: ====== /proc/1988044/status
804: Name:      timer-NskPj8RoR
804: Umask:     0022
804: State:     t (tracing stop)
804: Tgid:      1988044
804: Ngid:      0
804: Pid:       1988044
804: PPid:      1988035
804: TracerPid: 1988035
804: Uid:       1000    1000    1000    1000
804: Gid:       1000    1000    1000    1000
804: FDSize:    1024
804: Groups:    4 190 1000
804: NStgid:    1988044
804: NSpid:     1988044
804: NSpgid:    1988035
804: NSsid:     1892204
804: VmPeak:        4772 kB
804: VmSize:        4772 kB
804: VmLck:            0 kB
804: VmPin:            0 kB
804: VmHWM:         2532 kB
804: VmRSS:         2532 kB
804: RssAnon:       2236 kB
804: RssFile:        296 kB
804: RssShmem:         0 kB
804: VmData:        2344 kB
804: VmStk:            0 kB
804: VmExe:           12 kB
804: VmLib:         2060 kB
804: VmPTE:           52 kB
804: VmSwap:           0 kB
804: HugetlbPages:             0 kB
804: CoreDumping:       0
804: THP_enabled:       1
804: Threads:   1
804: SigQ:      0/93827
804: SigPnd:    0000000000000000
804: ShdPnd:    0000000000000000
804: SigBlk:    0000000000000000
804: SigIgn:    0000000000000000
804: SigCgt:    0000000000000000
804: CapInh:    0000000000000000
804: CapPrm:    0000000000000000
804: CapEff:    0000000000000000
804: CapBnd:    000001ffffffffff
804: CapAmb:    0000000000000000
804: NoNewPrivs:        1
804: Seccomp:   2
804: Seccomp_filters:   1
804: Speculation_Store_Bypass:  thread vulnerable
804: SpeculationIndirectBranch: unknown
804: Cpus_allowed:      4
804: Cpus_allowed_list: 2
804: Mems_allowed:      00000000,00000001
804: Mems_allowed_list: 0
804: voluntary_ctxt_switches:   136
804: nonvoluntary_ctxt_switches:        0
804: ====== /proc/1988044/stack
804: ====== gdb -p 1988035 -ex 'set confirm off' -ex 'set height 0' -ex 'thread apply all bt' -ex q </dev/null 2>&1
804: GNU gdb (GDB) Red Hat Enterprise Linux 10.2-13.0.1.el9
804: Copyright (C) 2021 Free Software Foundation, Inc.
804: License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
804: This is free software: you are free to change and redistribute it.
804: There is NO WARRANTY, to the extent permitted by law.
804: Type "show copying" and "show warranty" for details.
804: This GDB was configured as "aarch64-redhat-linux-gnu".
804: Type "show configuration" for configuration details.
804: For bug reporting instructions, please see:
804: <https://www.gnu.org/software/gdb/bugs/>.
804: Find the GDB manual and other documentation resources online at:
804:     <http://www.gnu.org/software/gdb/documentation/>.
804:
804: For help, type "help".
804: Type "apropos word" to search for commands related to "word".
804: Attaching to process 1988035
804: [New LWP 1988036]
804: [Thread debugging using libthread_db enabled]
804: Using host libthread_db library "/lib64/libthread_db.so.1".
804: 0x0000ffff9e5193a0 in accept () from /lib64/libc.so.6
804:
804: Thread 2 (Thread 0xffff9e42c0e0 (LWP 1988036) "TraceeAttention"):
804: #0  0x0000ffff9e509910 in read () from /lib64/libc.so.6
804: #1  0x0000000000596ab8 in rr::tracee_attention_set_thread (p=<optimized out>) at /home/opc/rr/src/TraceeAttentionSet.cc:31
804: #2  0x0000ffff9e4ad6b8 in start_thread () from /lib64/libc.so.6
804: #3  0x0000ffff9e517c5c in thread_start () from /lib64/libc.so.6
804:
804: Thread 1 (Thread 0xffff9eb54440 (LWP 1988035) "rr"):
804: #0  0x0000ffff9e5193a0 in accept () from /lib64/libc.so.6
804: #1  0x000000000047a4ec in rr::GdbServerConnection::await_debugger (listen_fd=..., this=<optimized out>) at /home/opc/rr/src/ScopedFd.h:36
804: #2  rr::GdbServerConnection::await_connection (t=<optimized out>, listen_fd=..., features=...) at /home/opc/rr/src/GdbServerConnection.cc:115
804: #3  0x00000000004a1ee8 in rr::emergency_debug (t=0x2743b640) at /home/opc/rr/src/launch_debugger.cc:404
804: #4  0x00000000004a97d4 in rr::start_emergency_debug (t=0x2743b640) at /home/opc/rr/src/log.cc:519
804: #5  0x00000000004a9a0c in rr::EmergencyDebugOstream::~EmergencyDebugOstream (this=<optimized out>, this=<optimized out>) at /home/opc/rr/src/log.cc:541
804: #6  0x00000000004a9a4c in rr::EmergencyDebugOstream::~EmergencyDebugOstream (this=<optimized out>, this=<optimized out>) at /home/opc/rr/src/log.cc:536
804: #7  0x00000000004c3fd0 in rr::PerfCounters::read_ticks (this=0x2743b688, t=0x2743b640, error=0x0) at /home/opc/rr/src/PerfCounters.cc:1072
804: #8  0x00000000004d19d0 in rr::PerfCounters::stop (this=0x2743b688, t=<optimized out>, error=<optimized out>) at /home/opc/rr/src/PerfCounters.cc:1005
804: #9  0x000000000058039c in rr::Task::did_waitpid (this=0x2743b640, status=...) at /home/opc/rr/src/Task.cc:2385
804: #10 0x0000000000563100 in rr::Scheduler::reschedule (this=0x274398e0, switchable=<optimized out>) at /home/opc/rr/src/Scheduler.cc:744
804: #11 0x00000000004e1864 in rr::RecordSession::record_step (this=0x27439690) at /home/opc/rr/src/RecordSession.h:148
804: #12 0x00000000004d8f24 in rr::record (flags=..., args=...) at /home/opc/rr/src/RecordCommand.cc:721
804: #13 rr::RecordCommand::run (this=<optimized out>, args=...) at /home/opc/rr/src/RecordCommand.cc:884
804: #14 0x0000000000430f7c in main (argc=<optimized out>, argv=<optimized out>) at /home/opc/rr/src/main.cc:278
804: Detaching from program: /home/opc/rr/build/bin/rr, process 1988035
804: [Inferior 1 (process 1988035) detached]
804: [FATAL src/log.cc:520:start_emergency_debug()] Can't resume execution from invalid state
804: 1964' '/tmp/rr-test-timer-NskPj8RoR/timer-NskPj8RoR' -ex 'set confirm off' -ex 'set height 0' -ex 'info registers' -ex 'thread apply all bt' -ex q  </dev/null 2>&1
804: GNU gdb (GDB) Red Hat Enterprise Linux 10.2-13.0.1.el9
804: Copyright (C) 2021 Free Software Foundation, Inc.
804: License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
804: This is free software: you are free to change and redistribute it.
804: There is NO WARRANTY, to the extent permitted by law.
804: Type "show copying" and "show warranty" for details.
804: This GDB was configured as "aarch64-redhat-linux-gnu".
804: Type "show configuration" for configuration details.
804: For bug reporting instructions, please see:
804: <https://www.gnu.org/software/gdb/bugs/>.
804: Find the GDB manual and other documentation resources online at:
804:     <http://www.gnu.org/software/gdb/documentation/>.
804:
804: For help, type "help".
804: Type "apropos word" to search for commands related to "word"...
804: Reading symbols from /tmp/rr-test-timer-NskPj8RoR/timer-NskPj8RoR...
804: Remote debugging using 127.0.0.1:21964
804: warning: Could not load shared library symbols for linux-vdso.so.1.
804: Do you need "set solib-search-path" or "set sysroot"?
804: Reading symbols from /home/opc/rr/build/lib/rr/librrpreload.so...
804: Reading symbols from /lib64/libdl.so.2...
804: Reading symbols from .gnu_debugdata for /lib64/libdl.so.2...
804: (No debugging symbols found in .gnu_debugdata for /lib64/libdl.so.2)
804: Reading symbols from /lib64/libc.so.6...
804: (No debugging symbols found in /lib64/libc.so.6)
804: Reading symbols from /lib/ld-linux-aarch64.so.1...
804: __mmap64 (offset=0, fd=-1, flags=34, prot=3, len=8192, addr=<optimized out>)
804:     at ../sysdeps/unix/sysv/linux/mmap64.c:59
804: 59 ../sysdeps/unix/sysv/linux/mmap64.c: No such file or directory.
804: x0             0x0                 0
804: x1             0x2000              8192
804: x2             0x3                 3
804: x3             0x22                34
804: x4             0xffffffffffffffff  -1
804: x5             0x0                 0
804: x6             0x0                 0
804: x7             0x0                 0
804: x8             0xde                222
804: x9             0x0                 0
804: x10            0x90                144
804: x11            0x0                 0
804: x12            0xffffb62f84e8      281473738310888
804: x13            0x40                64
804: x14            0xffffb62fc018      281473738326040
804: x15            0x0                 0
804: x16            0x1                 1
804: x17            0x1                 1
804: x18            0x1ac000            1753088
804: x19            0xffffb62fd000      281473738330112
804: x20            0xf08               3848
804: x21            0x2000              8192
804: x22            0x20                32
804: x23            0xffffb62fd1a0      281473738330528
804: x24            0xffffe52af6b0      281474526541488
804: x25            0xffffe52af698      281474526541464
804: x26            0x400040            4194368
804: x27            0xffffb62fb000      281473738321920
804: x28            0x0                 0
804: x29            0xffffe52af4c0      281474526540992
804: x30            0xffffb62d17e0      281473738151904
804: sp             0xffffe52af4c0      0xffffe52af4c0
804: pc             0xffffb62d887c      0xffffb62d887c <__mmap64+28>
804: cpsr           0x40001000          [ EL=0 SSBS Z ]
804: fpsr           0x0                 0
804: fpcr           0x0                 0
804:
804: Thread 1 (Thread 1988044.1988044 (timer-NskPj8RoR)):
804: #0  __mmap64 (offset=0, fd=-1, flags=34, prot=3, len=8192, addr=<optimized out>) at ../sysdeps/unix/sysv/linux/mmap64.c:59
804: #1  __mmap64 (addr=<optimized out>, len=8192, prot=3, flags=34, fd=-1, offset=0) at ../sysdeps/unix/sysv/linux/mmap64.c:47
804: #2  0x0000ffffb62d17e0 in rtld_malloc (n=3848) at dl-minimal.c:152
804: #3  0x0000ffffb62cc3a8 in malloc (size=3848) at ../include/rtld-malloc.h:56
804: #4  _dl_allocate_tls_storage () at dl-tls.c:465
804: #5  0x0000ffffb62d3240 in init_tls (naudit=naudit@entry=0) at rtld.c:799
804: #6  0x0000ffffb62d6144 in dl_main (phdr=<optimized out>, phnum=<optimized out>, user_entry=<optimized out>, auxv=<optimized out>) at rtld.c:2062
804: #7  0x0000ffffb62d22d4 in _dl_sysdep_start (start_argptr=start_argptr@entry=0xffffe52b0041, dl_main=dl_main@entry=0xffffb62d3fd0 <dl_main>) at ../sysdeps/unix/sysv/linux/dl-sysdep.c:140
804: #8  0x0000ffffb62d3810 in _dl_start_final (arg=0xffffe52b0041) at rtld.c:502
804: #9  _dl_start (arg=<optimized out>) at rtld.c:587
804: #10 0x0000ffffb62d2c3c in _start () from /lib/ld-linux-aarch64.so.1
804: Backtrace stopped: previous frame identical to this frame (corrupt stack?)
804: Detaching from program: /tmp/rr-test-timer-NskPj8RoR/timer-NskPj8RoR, process 1988044
804: [Inferior 1 (process 1988044) detached]
804: --------------------------------------------------
804: record.out:
804: --------------------------------------------------
804: --------------------------------------------------
804: Test timer failed, leaving behind /tmp/rr-test-timer-NskPj8RoR
804: To replay the failed test, run
804:   _RR_TRACE_DIR=/tmp/rr-test-timer-NskPj8RoR rr replay
2/3 Test #804: timer-no-syscallbuf ..............***Failed  Error regular expression found in output. Regex=[FAILED]  9.25 sec
test 882
    Start 882: arm/arch_timer-no-syscallbuf

882: Test command: /usr/bin/bash "source_dir/src/test/arm/arch_timer.run" "arch_timer" "-n" "bin_dir" "120"
882: Working Directory: /home/opc/rr/build
882: Test timeout computed to be: 10000000
3/3 Test #882: arm/arch_timer-no-syscallbuf .....***Skipped   0.02 sec

The following tests passed:
        arm/arch_timer-no-syscallbuf

33% tests passed, 2 tests failed out of 3

Total Test time (real) =  18.56 sec

The following tests did not run:
        882 - arm/arch_timer-no-syscallbuf (Skipped)

The following tests FAILED:
        226 - setitimer-no-syscallbuf (Failed)
        804 - timer-no-syscallbuf (Failed)
Errors while running CTest

on CPU: 3.0 GHz Ampere® Altra™

CPU implementer : 0x41
CPU architecture: 8
CPU variant     : 0x3
CPU part        : 0xd0c
CPU revision    : 1

Architecture:           aarch64
  CPU op-mode(s):       32-bit, 64-bit
  Byte Order:           Little Endian
CPU(s):                 4
  On-line CPU(s) list:  0-3
Vendor ID:              ARM
  Model name:           Neoverse-N1
    Model:              1
    Thread(s) per core: 1
    Core(s) per socket: 4
    Socket(s):          1
    Stepping:           r3p1
    BogoMIPS:           50.00
    Flags:              fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm lrcpc dcpop asimddp ssbs
NUMA:
  NUMA node(s):         1
  NUMA node0 CPU(s):    0-3
Vulnerabilities:
  Itlb multihit:        Not affected
  L1tf:                 Not affected
  Mds:                  Not affected
  Meltdown:             Not affected
  Mmio stale data:      Not affected
  Retbleed:             Mitigation; CSV2, BHB
  Spec store bypass:    Mitigation; Speculative Store Bypass disabled via prctl
  Spectre v1:           Mitigation; __user pointer sanitization
  Spectre v2:           Mitigation; CSV2, BHB
  Srbds:                Not affected
  Tsx async abort:      Not affected

with RHEL9 (GCC) 11.4.1 20231218 (Red Hat 11.4.1-3.0.1), binutils 2.35.2

Is there any more useful output to provide?

Note: This exact CPU can be used on Oracle Cloud free of charge (only some cpu-hours per month, but plenty enough to possibly debug whatever you like),

rocallahan commented 3 weeks ago

Can you try it with Ubuntu 24.04?

The key here will be tracking down the execution of this STREX instruction. You could try using objdump to disassemble every single binary in the trace and search for STREX.

IamHuskar commented 1 week ago

and you can also add compile option add_compile_options(-march=armv8.3-a) add_compile_options(-moutline-atomics)