search

checkpoint-restore / criu

Checkpoint/Restore tool
criu.org
Other
2.76k stars 560 forks source link

Restore fails on remote node (bad build-ID) #2367

Closed fornacis-202 closed 3 months ago

fornacis-202 commented 3 months ago

Description

when I restore on the same node, it works while on another node, it fails with this error:

sudo criu restore --shell-job --images-dir ./
4715: Error (criu/files-reg.c:2153): File usr/lib/x86_64-linux-gnu/libc-2.31.so has bad build-ID
4715: Error (criu/mem.c:1368): `- Can't open vma
Error (criu/cr-restore.c:2557): Restoring FAILED.
Error (criu/cr-restore.c:1517): 4715 killed by signal 9: Killed
Error (criu/cgroup.c:1970): cg: cgroupd: recv req error: No such file or directory

I am using the same image (ubuntu 20.04.6) on the both nodes.

Output of `criu --version`:

``` Version: 3.18 GitID: v3.18-189-g61224f2b5 ```

Output of `criu check --all`:

``` Looks good. ```

adrianreber commented 3 months ago

All open files on the destination host have to be exactly the same. Looks like your glibc is different.

fornacis-202 commented 3 months ago

they have the same glibc version: 

ldd --version
ldd (Ubuntu GLIBC 2.31-0ubuntu9.14) 2.31
Copyright (C) 2020 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.  There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
Written by Roland McGrath and Ulrich Drepper.

besides they are basically the same image. Am I missing something here?

adrianreber commented 3 months ago

The files need to be identical. They are not, that is why CRIU complains.

avagin commented 3 months ago

Could you show output of next two commands from both hosts:

readelf -n /lib/x86_64-linux-gnu/libc-2.31.so
dpkg -l `dpkg  -S  /lib/x86_64-linux-gnu/libc-2.31.so | sed 's/:\s.*//'`
fornacis-202 commented 3 months ago

sure output of readelf -n /lib/x86_64-linux-gnu/libc-2.31.so

host1:

``` Displaying notes found in: .note.gnu.property Owner Data size Description GNU 0x00000010 NT_GNU_PROPERTY_TYPE_0 Properties: x86 feature: IBT, SHSTK Displaying notes found in: .note.gnu.build-id Owner Data size Description GNU 0x00000014 NT_GNU_BUILD_ID (unique build ID bitstring) Build ID: eebe5d5f4b608b8a53ec446b63981bba373ca0ca Displaying notes found in: .note.ABI-tag Owner Data size Description GNU 0x00000010 NT_GNU_ABI_TAG (ABI version tag) OS: Linux, ABI: 3.2.0 Displaying notes found in: .note.stapsdt Owner Data size Description stapsdt 0x0000003a NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: setjmp Location: 0x0000000000042bf5, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rdi -4@%esi 8@%rax stapsdt 0x0000003b NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: longjmp Location: 0x0000000000042da1, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rdi -4@%esi 8@%rdx stapsdt 0x00000042 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: longjmp_target Location: 0x0000000000042dbd, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rdi -4@%eax 8@%rdx stapsdt 0x0000003b NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: longjmp Location: 0x0000000000042e37, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rdi -4@%esi 8@%rdx stapsdt 0x00000042 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: longjmp_target Location: 0x0000000000042e53, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rdi -4@%eax 8@%rdx stapsdt 0x0000003a NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: lll_lock_wait_private Location: 0x00000000000945b6, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rdi stapsdt 0x0000004c NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_mallopt_arena_max Location: 0x0000000000094e27, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rax 8@32+mp_(%rip) stapsdt 0x0000004d NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_mallopt_arena_test Location: 0x0000000000094e37, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rax 8@24+mp_(%rip) stapsdt 0x00000053 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_tunable_tcache_max_bytes Location: 0x0000000000094e50, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rax 8@88+mp_(%rip) stapsdt 0x0000004f NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_tunable_tcache_count Location: 0x0000000000094e90, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rax 8@96+mp_(%rip) stapsdt 0x00000059 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_tunable_tcache_unsorted_limit Location: 0x0000000000094ea7, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rax 8@104+mp_(%rip) stapsdt 0x0000005e NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_mallopt_trim_threshold Location: 0x00000000000951b7, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rax 8@mp_(%rip) -4@52+mp_(%rip) stapsdt 0x00000059 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_mallopt_top_pad Location: 0x00000000000951d7, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rax 8@8+mp_(%rip) -4@52+mp_(%rip) stapsdt 0x00000061 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_mallopt_mmap_threshold Location: 0x0000000000095200, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rax 8@16+mp_(%rip) -4@52+mp_(%rip) stapsdt 0x0000005d NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_mallopt_mmap_max Location: 0x0000000000095227, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: -4@%eax -4@44+mp_(%rip) -4@52+mp_(%rip) stapsdt 0x00000052 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_mallopt_perturb Location: 0x0000000000095247, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: -4@%eax -4@perturb_byte(%rip) stapsdt 0x00000052 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_mallopt_mxfast Location: 0x0000000000095260, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rax 8@global_max_fast(%rip) stapsdt 0x0000003b NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_heap_new Location: 0x0000000000095411, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%r12 8@%rbx stapsdt 0x00000041 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_arena_reuse_free_list Location: 0x00000000000957b7, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%r12 stapsdt 0x0000003e NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_arena_reuse Location: 0x0000000000095c2c, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%r12 8@%rbx stapsdt 0x0000004a NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_arena_reuse_wait Location: 0x0000000000095c8d, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rdx 8@%rdx 8@%rbx stapsdt 0x0000003c NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_arena_new Location: 0x0000000000095e6c, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%r12 8@%rbp stapsdt 0x0000003e NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_arena_retry Location: 0x0000000000096085, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rsi 8@%rdi stapsdt 0x0000003d NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_sbrk_less Location: 0x00000000000967ff, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rax -8@%r12 stapsdt 0x0000003c NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_heap_free Location: 0x0000000000096d21, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rdi 8@%rax stapsdt 0x0000003c NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_heap_less Location: 0x0000000000096f1a, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%r14 8@%r13 stapsdt 0x00000045 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_tcache_double_free Location: 0x0000000000096f38, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rsi 8@%rax stapsdt 0x0000003b NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_heap_more Location: 0x00000000000972fe, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%r8 8@%rcx stapsdt 0x0000003d NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_sbrk_more Location: 0x0000000000097578, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rax -8@%r13 stapsdt 0x00000038 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_malloc_retry Location: 0x0000000000099dd0, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rbp stapsdt 0x00000038 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_malloc_retry Location: 0x000000000009a370, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rbp stapsdt 0x00000041 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_memalign_retry Location: 0x000000000009a650, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%r13 8@%r12 stapsdt 0x0000004e NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_mallopt_free_dyn_thresholds Location: 0x000000000009a7a0, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rax 8@%rdx stapsdt 0x0000004e NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_mallopt_free_dyn_thresholds Location: 0x000000000009a980, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rax 8@%rdx stapsdt 0x00000040 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_realloc_retry Location: 0x000000000009adf0, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%r12 8@%rbp stapsdt 0x00000040 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_realloc_retry Location: 0x000000000009b1c0, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%r12 8@%rbp stapsdt 0x00000041 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_memalign_retry Location: 0x000000000009b490, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%r12 8@%rbp stapsdt 0x00000041 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_memalign_retry Location: 0x000000000009b770, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%r12 8@%rbp stapsdt 0x00000041 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_memalign_retry Location: 0x000000000009ba50, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rbx 8@%rbp stapsdt 0x00000038 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_calloc_retry Location: 0x000000000009bd1e, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%r12 stapsdt 0x0000003c NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_mallopt Location: 0x000000000009c645, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: -4@%ebp -4@%ebx stapsdt 0x0000005d NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_mallopt_mmap_max Location: 0x000000000009c6c0, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: -4@%ebx -4@44+mp_(%rip) -4@52+mp_(%rip) stapsdt 0x00000061 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_mallopt_mmap_threshold Location: 0x000000000009c6ec, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rbx 8@16+mp_(%rip) -4@52+mp_(%rip) stapsdt 0x00000059 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_mallopt_top_pad Location: 0x000000000009c710, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rbx 8@8+mp_(%rip) -4@52+mp_(%rip) stapsdt 0x0000005e NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_mallopt_trim_threshold Location: 0x000000000009c730, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rbx 8@mp_(%rip) -4@52+mp_(%rip) stapsdt 0x0000004d NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_mallopt_arena_test Location: 0x000000000009c75e, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rbx 8@24+mp_(%rip) stapsdt 0x00000052 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_mallopt_perturb Location: 0x000000000009c770, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: -4@%ebx -4@perturb_byte(%rip) stapsdt 0x0000004c NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_mallopt_arena_max Location: 0x000000000009c796, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rbx 8@32+mp_(%rip) stapsdt 0x00000052 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_mallopt_mxfast Location: 0x000000000009c808, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rbx 8@global_max_fast(%rip) stapsdt 0x00000041 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_memalign_retry Location: 0x000000000009ca8f, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%r12 8@%rbp stapsdt 0x0000003b NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: longjmp Location: 0x000000000012fbe1, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rdi -4@%esi 8@%rdx stapsdt 0x00000042 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: longjmp_target Location: 0x000000000012fbfd, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rdi -4@%eax 8@%rdx ```

host2:

``` Displaying notes found in: .note.gnu.property Owner Data size Description GNU 0x00000010 NT_GNU_PROPERTY_TYPE_0 Properties: x86 feature: IBT, SHSTK Displaying notes found in: .note.gnu.build-id Owner Data size Description GNU 0x00000014 NT_GNU_BUILD_ID (unique build ID bitstring) Build ID: 1878e6b475720c7c51969e69ab2d276fae6d1dee Displaying notes found in: .note.ABI-tag Owner Data size Description GNU 0x00000010 NT_GNU_ABI_TAG (ABI version tag) OS: Linux, ABI: 3.2.0 Displaying notes found in: .note.stapsdt Owner Data size Description stapsdt 0x0000003a NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: setjmp Location: 0x0000000000042bf5, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rdi -4@%esi 8@%rax stapsdt 0x0000003b NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: longjmp Location: 0x0000000000042da1, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rdi -4@%esi 8@%rdx stapsdt 0x00000042 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: longjmp_target Location: 0x0000000000042dbd, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rdi -4@%eax 8@%rdx stapsdt 0x0000003b NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: longjmp Location: 0x0000000000042e37, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rdi -4@%esi 8@%rdx stapsdt 0x00000042 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: longjmp_target Location: 0x0000000000042e53, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rdi -4@%eax 8@%rdx stapsdt 0x0000003a NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: lll_lock_wait_private Location: 0x00000000000945b6, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rdi stapsdt 0x0000004c NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_mallopt_arena_max Location: 0x0000000000094e27, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rax 8@32+mp_(%rip) stapsdt 0x0000004d NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_mallopt_arena_test Location: 0x0000000000094e37, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rax 8@24+mp_(%rip) stapsdt 0x00000053 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_tunable_tcache_max_bytes Location: 0x0000000000094e50, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rax 8@88+mp_(%rip) stapsdt 0x0000004f NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_tunable_tcache_count Location: 0x0000000000094e90, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rax 8@96+mp_(%rip) stapsdt 0x00000059 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_tunable_tcache_unsorted_limit Location: 0x0000000000094ea7, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rax 8@104+mp_(%rip) stapsdt 0x0000005e NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_mallopt_trim_threshold Location: 0x00000000000951b7, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rax 8@mp_(%rip) -4@52+mp_(%rip) stapsdt 0x00000059 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_mallopt_top_pad Location: 0x00000000000951d7, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rax 8@8+mp_(%rip) -4@52+mp_(%rip) stapsdt 0x00000061 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_mallopt_mmap_threshold Location: 0x0000000000095200, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rax 8@16+mp_(%rip) -4@52+mp_(%rip) stapsdt 0x0000005d NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_mallopt_mmap_max Location: 0x0000000000095227, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: -4@%eax -4@44+mp_(%rip) -4@52+mp_(%rip) stapsdt 0x00000052 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_mallopt_perturb Location: 0x0000000000095247, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: -4@%eax -4@perturb_byte(%rip) stapsdt 0x00000052 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_mallopt_mxfast Location: 0x0000000000095260, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rax 8@global_max_fast(%rip) stapsdt 0x0000003b NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_heap_new Location: 0x0000000000095411, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%r12 8@%rbx stapsdt 0x00000041 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_arena_reuse_free_list Location: 0x00000000000957b7, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%r12 stapsdt 0x0000003e NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_arena_reuse Location: 0x0000000000095c2c, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%r12 8@%rbx stapsdt 0x0000004a NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_arena_reuse_wait Location: 0x0000000000095c8d, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rdx 8@%rdx 8@%rbx stapsdt 0x0000003c NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_arena_new Location: 0x0000000000095e6c, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%r12 8@%rbp stapsdt 0x0000003e NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_arena_retry Location: 0x0000000000096085, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rsi 8@%rdi stapsdt 0x0000003d NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_sbrk_less Location: 0x00000000000967ff, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rax -8@%r12 stapsdt 0x0000003c NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_heap_free Location: 0x0000000000096d21, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rdi 8@%rax stapsdt 0x0000003c NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_heap_less Location: 0x0000000000096f1a, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%r14 8@%r13 stapsdt 0x00000045 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_tcache_double_free Location: 0x0000000000096f38, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rsi 8@%rax stapsdt 0x0000003b NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_heap_more Location: 0x00000000000972fe, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%r8 8@%rcx stapsdt 0x0000003d NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_sbrk_more Location: 0x0000000000097578, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rax -8@%r13 stapsdt 0x00000038 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_malloc_retry Location: 0x0000000000099dd0, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rbp stapsdt 0x00000038 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_malloc_retry Location: 0x000000000009a370, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rbp stapsdt 0x00000041 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_memalign_retry Location: 0x000000000009a650, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%r13 8@%r12 stapsdt 0x0000004e NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_mallopt_free_dyn_thresholds Location: 0x000000000009a7a0, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rax 8@%rdx stapsdt 0x0000004e NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_mallopt_free_dyn_thresholds Location: 0x000000000009a980, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rax 8@%rdx stapsdt 0x00000040 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_realloc_retry Location: 0x000000000009adf0, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%r12 8@%rbp stapsdt 0x00000040 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_realloc_retry Location: 0x000000000009b1c0, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%r12 8@%rbp stapsdt 0x00000041 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_memalign_retry Location: 0x000000000009b490, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%r12 8@%rbp stapsdt 0x00000041 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_memalign_retry Location: 0x000000000009b770, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%r12 8@%rbp stapsdt 0x00000041 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_memalign_retry Location: 0x000000000009ba50, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rbx 8@%rbp stapsdt 0x00000038 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_calloc_retry Location: 0x000000000009bd1e, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%r12 stapsdt 0x0000003c NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_mallopt Location: 0x000000000009c645, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: -4@%ebp -4@%ebx stapsdt 0x0000005d NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_mallopt_mmap_max Location: 0x000000000009c6c0, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: -4@%ebx -4@44+mp_(%rip) -4@52+mp_(%rip) stapsdt 0x00000061 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_mallopt_mmap_threshold Location: 0x000000000009c6ec, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rbx 8@16+mp_(%rip) -4@52+mp_(%rip) stapsdt 0x00000059 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_mallopt_top_pad Location: 0x000000000009c710, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rbx 8@8+mp_(%rip) -4@52+mp_(%rip) stapsdt 0x0000005e NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_mallopt_trim_threshold Location: 0x000000000009c730, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rbx 8@mp_(%rip) -4@52+mp_(%rip) stapsdt 0x0000004d NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_mallopt_arena_test Location: 0x000000000009c75e, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rbx 8@24+mp_(%rip) stapsdt 0x00000052 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_mallopt_perturb Location: 0x000000000009c770, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: -4@%ebx -4@perturb_byte(%rip) stapsdt 0x0000004c NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_mallopt_arena_max Location: 0x000000000009c796, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rbx 8@32+mp_(%rip) stapsdt 0x00000052 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_mallopt_mxfast Location: 0x000000000009c808, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rbx 8@global_max_fast(%rip) stapsdt 0x00000041 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: memory_memalign_retry Location: 0x000000000009ca8f, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%r12 8@%rbp stapsdt 0x0000003b NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: longjmp Location: 0x000000000012f9c1, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rdi -4@%esi 8@%rdx stapsdt 0x00000042 NT_STAPSDT (SystemTap probe descriptors) Provider: libc Name: longjmp_target Location: 0x000000000012f9dd, Base: 0x00000000001be698, Semaphore: 0x0000000000000000 Arguments: 8@%rdi -4@%eax 8@%rdx ```

output of dpkg -l `dpkg -S /lib/x86_64-linux-gnu/libc-2.31.so | sed 's/:\s.*//'`

host1:

``` Desired=Unknown/Install/Remove/Purge/Hold | Status=Not/Inst/Conf-files/Unpacked/halF-conf/Half-inst/trig-aWait/Trig-pend |/ Err?=(none)/Reinst-required (Status,Err: uppercase=bad) ||/ Name Version Architecture Description +++-==============-================-============-=============================> ii libc6:amd64 2.31-0ubuntu9.14 amd64 GNU C Library: Shared libraries> ```

host2:

``` Desired=Unknown/Install/Remove/Purge/Hold | Status=Not/Inst/Conf-files/Unpacked/halF-conf/Half-inst/trig-aWait/Trig-pend |/ Err?=(none)/Reinst-required (Status,Err: uppercase=bad) ||/ Name Version Architecture Description +++-==============-===============-============-==============================> ii libc6:amd64 2.31-0ubuntu9.9 amd64 GNU C Library: Shared libraries ```

avagin commented 3 months ago

ii libc6:amd64 2.31-0ubuntu9.14 amd64 GNU C Library: Shared libraries> ii libc6:amd64 2.31-0ubuntu9.9 amd64 GNU C Library: Shared libraries

Only the major versions are the same, but minor versions are different. This is the root cause of this issue.

fornacis-202 commented 3 months ago

Thanks