checkpoint-restore / criu

Checkpoint/Restore tool
criu.org
Other
2.93k stars 585 forks source link

Segmentation fault in libnl-3.so when dumping a process #169

Closed kikosha closed 8 years ago

kikosha commented 8 years ago

Produced in criu 2.2, trying to dump a process that runs inside of a container. Here is the log (v4) and the backtrace at the segfault: ' (00.000014) Probing sock diag modules (00.000073) Done probing Detaching after fork from child process 13294. Detaching after fork from child process 13295. (00.004839) ======================================== (00.004850) Dumping processes (pid: 4960) (00.004854) ======================================== (00.004862) Running pre-dump scripts (00.004907) Pagemap is fully functional (00.004951) Found anon-shmem device at 5 (00.004960) Reset 13293's dirty tracking (00.005026) ... done (00.005059) Dirty track supported on kernel (00.005131) Found task size of 7ffffffff000 (00.005171) irmap: Searching irmap cache in work dir (00.005185) No irmap-cache image (00.005192) irmap: Searching irmap cache in parent (00.005199) irmap: No irmap cache (00.005213) cpu: fpu:1 fxsr:1 xsave:1 (00.005393) vdso: Parsing at 7ffff7ffa000 7ffff7ffc000 (00.005400) vdso: PT_LOAD p_vaddr: 0 (00.005406) vdso: DT_HASH: 120 (00.005411) vdso: DT_STRTAB: 2b0 (00.005415) vdso: DT_SYMTAB: 1a8 (00.005420) vdso: DT_STRSZ: 5e (00.005424) vdso: DT_SYMENT: 18 (00.005428) vdso: nbucket 3 nchain b bucket 7ffff7ffa128 chain 7ffff7ffa134 (00.005443) vdso: rt [vdso] 7ffff7ffa000-7ffff7ffc000 [vvar] 7ffff7ff8000-7ffff7ffa000 (00.005526) Perparing image inventory (version 1) (00.005551) Add pid ns 1 pid 13293 (00.005564) Add net ns 2 pid 13293 (00.005575) Add ipc ns 3 pid 13293 (00.005587) Add uts ns 4 pid 13293 (00.005599) Add mnt ns 5 pid 13293 (00.005610) Add user ns 6 pid 13293 (00.005622) Add cgroup ns 7 pid 13293 (00.005628) cg: Dumping cgroups for 13293 (00.005675) cg: - New css ID 1 (00.005681) cg:- [blkio] -> [/] 0 cg: - [cpu,cpuacct] -> [/] [0] (00.005691) cg:- [cpuset] -> [/] 0 cg: - [devices] -> [/user.slice] [0] (00.005700) cg:- [freezer] -> [/] 0 cg: - [hugetlb] -> [/] [0] (00.005709) cg:- [memory] -> [/] 0 cg: - [name=systemd] -> [/user.slice/user-1000.slice/session-c4.scope] [0] (00.005718) cg:- [net_cls,net_prio] -> [/] 0 cg: - [perf_event] -> [/] [0] (00.005728) cg:- [pids] -> [/user.slice/user-1000.slice/session-c4.scope] 0 cg: Set 1 is criu one (00.005921) Seized task 4960, state 1 (00.005953) Collected (4 attempts, 0 in_progress) (00.005979) Seized task 4966, state 0 (00.006171) Seizing 4966's 4967 thread (00.006342) Seizing 4966's 4968 thread (00.006492) Seizing 4966's 4969 thread (00.006637) Seizing 4966's 4970 thread (00.006765) Seizing 4966's 4971 thread (00.006883) Seizing 4966's 4972 thread (00.007055) Seizing 4966's 4973 thread (00.007234) Seizing 4966's 4974 thread (00.007377) Seizing 4966's 4975 thread (00.007521) Seizing 4966's 4976 thread (00.007691) Seizing 4966's 4977 thread (00.007833) Seizing 4966's 4978 thread (00.008011) Seizing 4966's 4979 thread (00.008144) Seizing 4966's 4980 thread (00.008273) Seizing 4966's 4981 thread (00.008384) Seizing 4966's 4982 thread (00.008495) Seizing 4966's 4983 thread (00.008612) Seizing 4966's 4984 thread (00.008721) Seizing 4966's 4985 thread (00.008826) Seizing 4966's 4986 thread (00.008918) Seizing 4966's 4987 thread (00.009006) Seizing 4966's 4988 thread (00.009094) Seizing 4966's 4989 thread (00.009182) Seizing 4966's 4999 thread (00.009314) Collected (3 attempts, 0 in_progress) (00.009463) Collected (4 attempts, 0 in_progress) (00.009512) Collected 4966 in 1 state (00.009540) Collected (3 attempts, 0 in_progress) (00.009548) Collected 4960 in 1 state (00.009570) Will take pid namespace in the image (00.009576) Add pid ns 8 pid 4960 (00.009590) Will take ipc namespace in the image (00.009595) Add ipc ns 9 pid 4960 (00.009604) Will take uts namespace in the image (00.009608) Add uts ns 10 pid 4960 (00.009618) Will take mnt namespace in the image (00.009623) Add mnt ns 11 pid 4960 (00.009671) Lock network (00.009834) type ext4 source /dev/sda6 mnt_id 456 s_dev 0x800006 / @ ./ flags 0x200001 options data=ordered (00.009856) type tmpfs source none mnt_id 457 s_dev 0x33 / @ ./tmp flags 0x200000 options size=4096k (00.009872) type tmpfs source none mnt_id 458 s_dev 0x35 / @ ./home/ flags 0x200000 options size=4096k (00.009886) type tmpfs source none mnt_id 459 s_dev 0x38 / @ ./var/tmp flags 0x200000 options size=4096k (00.009900) type tmpfs source none mnt_id 460 s_dev 0x39 / @ ./var/run flags 0x200000 options size=4096k (00.009914) type proc source /proc mnt_id 461 s_dev 0x37 / @ ./proc flags 0x20000e options (00.009928) type proc source /proc mnt_id 462 s_dev 0x37 /sys @ ./proc/sys flags 0x200001 options (00.009941) type proc source /proc mnt_id 463 s_dev 0x37 /sysrq-trigger @ ./proc/sysrq-trigger flags 0x200001 options (00.009956) type proc source /proc mnt_id 464 s_dev 0x37 /sys/kernel/hotplug @ ./proc/sys/kernel/hotplug flags 0x200001 options (00.009969) type proc source /proc mnt_id 465 s_dev 0x37 /irq @ ./proc/irq flags 0x200001 options (00.009982) type proc source /proc mnt_id 466 s_dev 0x37 /bus @ ./proc/bus flags 0x200001 options (00.009997) type ext4 source /dev/sda6 mnt_id 467 s_dev 0x800006 //dev/null @ ./proc/kcore flags 0x200001 options data=ordered (00.010015) type ext4 source /dev/sda6 mnt_id 468 s_dev 0x800006 /<path_removed/dev/null @ ./proc/kallsyms flags 0x200001 options data=ordered (00.010034) mnt: Building mountpoints tree (00.010038) mnt: Building plain mount tree (00.010043) mnt: Working on 468->461 (00.010048) mnt: Working on 467->461 (00.010053) mnt: Working on 466->461 (00.010058) mnt: Working on 465->461 (00.010063) mnt: Working on 464->462 (00.010067) mnt: Working on 463->461 (00.010072) mnt: Working on 462->461 (00.010077) mnt: Working on 461->456 (00.010082) mnt: Working on 460->456 (00.010086) mnt: Working on 459->456 (00.010091) mnt: Working on 458->456 (00.010096) mnt: Working on 457->456 (00.010103) mnt: Working on 456->449 (00.010107) mnt: Resorting siblings on 456 (00.010112) mnt: Resorting siblings on 461 (00.010117) mnt: Resorting siblings on 468 (00.010122) mnt: Resorting siblings on 467 (00.010127) mnt: Resorting siblings on 466 (00.010132) mnt: Resorting siblings on 465 (00.010136) mnt: Resorting siblings on 463 (00.010141) mnt: Resorting siblings on 462 (00.010144) mnt: Resorting siblings on 464 (00.010149) mnt: Resorting siblings on 460 (00.010153) mnt: Resorting siblings on 459 (00.010156) mnt: Resorting siblings on 458 (00.010161) mnt: Resorting siblings on 457 (00.010165) mnt: Done: (00.010169) mnt: ./ (00.010174) mnt: ./proc (00.010179) mnt: ./proc/kallsyms (00.010184) mnt: <-- (00.010187) mnt: ./proc/sys (00.010192) mnt: ./proc/sys/kernel/hotplug (00.010196) mnt: <-- (00.010200) mnt: <-- (00.010204) mnt: ./proc/sysrq-trigger (00.010209) mnt: <-- (00.010213) mnt: ./proc/irq (00.010217) mnt: <-- (00.010221) mnt: ./proc/bus (00.010225) mnt: <-- (00.010229) mnt: ./proc/kcore (00.010234) mnt: <-- (00.010237) mnt: <-- (00.010241) mnt: ./tmp (00.010246) mnt: <-- (00.010250) mnt: ./ (00.010254) mnt: <-- (00.010258) mnt: ./var/tmp (00.010263) mnt: <-- (00.010266) mnt: ./var/run (00.010271) mnt: <-- (00.010275) mnt: <-- (00.010280) mnt: Inspecting sharing on 468 shared_id 0 master_id 0 (@./proc/kallsyms) (00.010286) mnt: The mount 467 is bind for 468 (@./proc/kcore -> @./proc/kallsyms) (00.010291) mnt: The mount 456 is bind for 468 (@./ -> @./proc/kallsyms) (00.010297) mnt: Inspecting sharing on 467 shared_id 0 master_id 0 (@./proc/kcore) (00.010302) mnt: Inspecting sharing on 466 shared_id 0 master_id 0 (@./proc/bus) (00.010306) mnt: The mount 465 is bind for 466 (@./proc/irq -> @./proc/bus) (00.010311) mnt: The mount 464 is bind for 466 (@./proc/sys/kernel/hotplug -> @./proc/bus) (00.010317) mnt: The mount 463 is bind for 466 (@./proc/sysrq-trigger -> @./proc/bus) (00.010323) mnt: The mount 462 is bind for 466 (@./proc/sys -> @./proc/bus) (00.010328) mnt: The mount 461 is bind for 466 (@./proc -> @./proc/bus) (00.010333) mnt: Inspecting sharing on 465 shared_id 0 master_id 0 (@./proc/irq) (00.010338) mnt: Inspecting sharing on 464 shared_id 0 master_id 0 (@./proc/sys/kernel/hotplug) (00.010343) mnt: Inspecting sharing on 463 shared_id 0 master_id 0 (@./proc/sysrq-trigger) (00.010347) mnt: Inspecting sharing on 462 shared_id 0 master_id 0 (@./proc/sys) (00.010352) mnt: Inspecting sharing on 461 shared_id 0 master_id 0 (@./proc) (00.010356) mnt: Inspecting sharing on 460 shared_id 0 master_id 0 (@./var/run) (00.010361) mnt: Inspecting sharing on 459 shared_id 0 master_id 0 (@./var/tmp) (00.010366) mnt: Inspecting sharing on 458 shared_id 0 master_id 0 (@./) (00.010371) mnt: Inspecting sharing on 457 shared_id 0 master_id 0 (@./tmp) (00.010376) mnt: Inspecting sharing on 456 shared_id 0 master_id 0 (@./) (00.010384) Collecting netns 2/13293 (00.010751) sk unix: Collected: ino 0x6cce peer_ino 0 family 1 type 1 state 10 name (00.010771) Error (mount.c:3426): mnt: The root task has another root than mntns: / (00.011094) Can't check shutdown state of inet socket (00.011105) Collected: ino 0x 800003 family 2 type 1 port 53679 state 2 src_addr 181.4.0.0 (00.011114) Collected: ino 0x 7465 family 2 type 1 port 43702 state 1 src_addr 34.0.0.0 (00.011123) Collected: ino 0x 800003 family 2 type 1 port 54703 state 2 src_addr 182.4.0.0 (00.011131) Collected: ino 0x 800006 family 2 type 1 port 60020 state 1 src_addr 35.0.0.0 (00.011138) Collected: ino 0x 800003 family 2 type 1 port 24486 state 2 src_addr 183.4.0.0 (00.011146) Collected: ino 0x 20014 family 2 type 1 port 37989 state 1 src_addr 39.0.0.0 (00.011154) Collected: ino 0x 800003 family 2 type 1 port 56745 state 2 src_addr 184.4.0.0 (00.011160) Warn (libnetlink.c:197): netlink: 32 bytes leftover after parsing attributes. (00.011166) Collected: ino 0x39323339 family 2 type 1 port 13690 state 1 src_addr 185.4.0.0 (00.011174) Collected: ino 0x 800003 family 2 type 1 port 58793 state 2 src_addr 186.4.0.0 (00.011181) Collected: ino 0x 0 family 2 type 1 port 23552 state 2 src_addr 41.0.0.0 (00.011188) Warn (libnetlink.c:197): netlink: 12 bytes leftover after parsing attributes. (00.011194) Collected: ino 0x 0 family 2 type 1 port 25600 state 2 src_addr 42.0.0.0 (00.011201) Warn (libnetlink.c:197): netlink: 12 bytes leftover after parsing attributes. (00.011207) Collected: ino 0x 0 family 2 type 1 port 26112 state 1 src_addr 43.0.0.0 (00.011213) Warn (libnetlink.c:197): netlink: 12 bytes leftover after parsing attributes. (00.011219) Collected: ino 0x 0 family 2 type 1 port 26368 state 1 src_addr 44.0.0.0 (00.011227) Collected: ino 0x 0 family 2 type 1 port 26624 state 2 src_addr 45.0.0.0 (00.011234) Collected: ino 0x 33ed family 2 type 1 port 37049 state 5 src_addr 46.0.0.0 (00.011240) Warn (libnetlink.c:197): netlink: 32 bytes leftover after parsing attributes. (00.011246) Collected: ino 0x37373230 family 2 type 1 port 38281 state 1 src_addr 187.4.0.0 (00.011253) Warn (libnetlink.c:197): netlink: 12 bytes leftover after parsing attributes. (00.011258) Collected: ino 0x 0 family 2 type 1 port 23916 state 1 src_addr 47.0.0.0 (00.011266) Collected: ino 0x 30004 family 2 type 1 port 60276 state 1 src_addr 48.0.0.0 (00.011273) Collected: ino 0x 54 family 2 type 1 port 29782 state 1 src_addr 49.0.0.0 (00.011281) Collected: ino 0x 54 family 2 type 1 port 21104 state 1 src_addr 50.0.0.0 (00.011288) Collected: ino 0x 8c family 2 type 1 port 53890 state 1 src_addr 59.5.0.0 (00.011294) Warn (libnetlink.c:197): netlink: 52 bytes leftover after parsing attributes. (00.011300) Collected: ino 0x62633132 family 2 type 1 port 51849 state 1 src_addr 188.4.0.0 (00.011306) Warn (libnetlink.c:197): netlink: 32 bytes leftover after parsing attributes. (00.011312) Collected: ino 0x31363531 family 2 type 1 port 58175 state 1 src_addr 189.4.0.0 (00.011319) Collected: ino 0x 68 family 2 type 1 port 29036 state 1 src_addr 52.0.0.0 (00.011325) Warn (libnetlink.c:197): netlink: 16 bytes leftover after parsing attributes. (00.011331) Collected: ino 0x 4000c family 2 type 1 port 28484 state 1 src_addr 53.0.0.0 (00.011337) Warn (libnetlink.c:197): netlink: 16 bytes leftover after parsing attributes. (00.011343) Collected: ino 0x 4000c family 2 type 1 port 28740 state 1 src_addr 54.0.0.0 (00.011349) Warn (libnetlink.c:197): netlink: 4 bytes leftover after parsing attributes. (00.011355) Collected: ino 0x 60005 family 2 type 1 port 28996 state 1 src_addr 55.0.0.0 (00.011361) Warn (libnetlink.c:197): netlink: 4 bytes leftover after parsing attributes. (00.011367) Collected: ino 0x 60005 family 2 type 1 port 29252 state 1 src_addr 56.0.0.0 (00.011374) Collected: ino 0x 80 family 2 type 1 port 30532 state 1 src_addr 57.0.0.0 (00.011381) Warn (libnetlink.c:197): netlink: 4 bytes leftover after parsing attributes. (00.011386) Collected: ino 0x 60005 family 2 type 1 port 30788 state 1 src_addr 58.0.0.0 (00.011394) Collected: ino 0x 3c family 2 type 1 port 46950 state 1 src_addr 59.0.0.0 (00.011401) Collected: ino 0x 3d family 2 type 1 port 31086 state 1 src_addr 60.0.0.0 (00.011408) Collected: ino 0x 0 family 2 type 1 port 40300 state 1 src_addr 61.0.0.0 (00.011416) Collected: ino 0x 3f family 2 type 1 port 39788 state 1 src_addr 62.0.0.0 (00.011423) Collected: ino 0x 40 family 2 type 1 port 21832 state 1 src_addr 63.0.0.0 (00.011430) Collected: ino 0x 41 family 2 type 1 port 44134 state 1 src_addr 64.0.0.0 (00.011437) Collected: ino 0x 0 family 2 type 1 port 47702 state 1 src_addr 65.0.0.0 (00.011445) Collected: ino 0x 43 family 2 type 1 port 44133 state 1 src_addr 66.0.0.0 (00.011453) Collected: ino 0x 44 family 2 type 1 port 56150 state 1 src_addr 67.0.0.0 (00.011460) Collected: ino 0x 45 family 2 type 1 port 65374 state 1 src_addr 68.0.0.0 (00.011467) Collected: ino 0x 46 family 2 type 1 port 37982 state 1 src_addr 69.0.0.0 (00.011474) Collected: ino 0x 3c family 2 type 1 port 49501 state 1 src_addr 70.0.0.0 (00.011481) Collected: ino 0x 53c family 2 type 1 port 30547 state 1 src_addr 71.0.0.0 (00.011488) Collected: ino 0x 4bf family 2 type 1 port 33642 state 1 src_addr 60.5.0.0 (00.011496) Collected: ino 0x 0 family 2 type 1 port 36251 state 1 src_addr 191.4.0.0 (00.011503) Collected: ino 0x 3c family 2 type 1 port 52906 state 1 src_addr 192.4.0.0 (00.011510) Collected: ino 0x 48 family 2 type 1 port 46469 state 1 src_addr 193.4.0.0 (00.011518) Collected: ino 0x 49 family 2 type 1 port 44982 state 5 src_addr 72.0.0.0 (00.011525) Collected: ino 0x 0 family 2 type 1 port 20335 state 1 src_addr 73.0.0.0 (00.011532) Collected: ino 0x 4b family 2 type 1 port 51580 state 1 src_addr 74.0.0.0 (00.011540) Collected: ino 0x 7448 family 2 type 1 port 26722 state 1 src_addr 75.0.0.0 (00.011547) Collected: ino 0x 4d family 2 type 1 port 50809 state 1 src_addr 76.0.0.0 (00.011554) Collected: ino 0x 4e family 2 type 1 port 30563 state 1 src_addr 77.0.0.0 (00.011562) Collected: ino 0x 5696 family 2 type 1 port 44901 state 1 src_addr 78.0.0.0 (00.011569) Collected: ino 0x 3789 family 2 type 1 port 19274 state 1 src_addr 79.0.0.0 (00.011576) Collected: ino 0x 107e0e family 2 type 1 port 3182 state 1 src_addr 194.4.0.0 (00.011584) Collected: ino 0x 51 family 2 type 1 port 14259 state 1 src_addr 80.0.0.0 (00.011590) Warn (libnetlink.c:197): netlink: 24 bytes leftover after parsing attributes. (00.011595) Collected: ino 0x 20008 family 2 type 1 port 24159 state 1 src_addr 81.0.0.0 (00.011603) Collected: ino 0x 53 family 2 type 1 port 29048 state 1 src_addr 82.0.0.0 (00.011610) Collected: ino 0x 0 family 2 type 1 port 20079 state 1 src_addr 83.0.0.0 (00.011621) Collected: ino 0x 55 family 2 type 1 port 44404 state 1 src_addr 84.0.0.0 (00.011629) Collected: ino 0x 56 family 2 type 1 port 39523 state 1 src_addr 85.0.0.0 (00.011636) Collected: ino 0x 3c family 2 type 1 port 30320 state 1 src_addr 86.0.0.0 (00.011643) Collected: ino 0x 58 family 2 type 1 port 62551 state 1 src_addr 87.0.0.0 (00.011651) Collected: ino 0x 59 family 2 type 1 port 35430 state 1 src_addr 88.0.0.0 (00.011657) Warn (libnetlink.c:197): netlink: 16 bytes leftover after parsing attributes. (00.011663) Collected: ino 0x 4000c family 2 type 1 port 31854 state 1 src_addr 89.0.0.0 (00.011670) Collected: ino 0x 5c family 2 type 1 port 13674 state 1 src_addr 90.0.0.0 (00.011677) Collected: ino 0x 0 family 2 type 1 port 36221 state 1 src_addr 92.0.0.0 (00.011685) Collected: ino 0x 5e family 2 type 1 port 18552 state 1 src_addr 93.0.0.0 (00.011692) Collected: ino 0x 639a family 2 type 1 port 17515 state 1 src_addr 94.0.0.0 (00.011698) Warn (libnetlink.c:197): netlink: 36 bytes leftover after parsing attributes. (00.011704) Collected: ino 0x37373230 family 2 type 1 port 38537 state 1 src_addr 195.4.0.0 (00.011711) Collected: ino 0x 4c4 family 2 type 1 port 3678 state 1 src_addr 95.0.0.0 (00.011719) Collected: ino 0x 4a1 family 2 type 1 port 24204 state 1 src_addr 196.4.0.0 (00.011726) Collected: ino 0x 60 family 2 type 1 port 2847 state 2 src_addr 161.4.0.0 (00.011733) Collected: ino 0x 61 family 2 type 1 port 15191 state 1 src_addr 96.0.0.0 (00.011740) Collected: ino 0x 3c family 2 type 1 port 40293 state 1 src_addr 97.0.0.0 (00.011747) Collected: ino 0x 63 family 2 type 1 port 64321 state 1 src_addr 98.0.0.0 (00.011755) Collected: ino 0x 64 family 2 type 1 port 47930 state 1 src_addr 99.0.0.0 (00.011762) Collected: ino 0x 0 family 2 type 1 port 20352 state 1 src_addr 100.0.0.0 (00.011768) Collected: ino 0x 58 family 2 type 1 port 18545 state 1 src_addr 101.0.0.0 (00.011775) Collected: ino 0x 0 family 2 type 1 port 24935 state 1 src_addr 102.0.0.0 (00.011783) Collected: ino 0x 4c5 family 2 type 1 port 48509 state 1 src_addr 61.5.0.0 (00.011789) Warn (libnetlink.c:197): netlink: 12 bytes leftover after parsing attributes. (00.011795) Collected: ino 0x 0 family 2 type 1 port 43907 state 1 src_addr 197.4.0.0 (00.011802) Collected: ino 0x 68 family 2 type 1 port 2180 state 1 src_addr 103.0.0.0 (00.011809) Collected: ino 0x 69 family 2 type 1 port 3192 state 1 src_addr 104.0.0.0 (00.011816) Collected: ino 0x 53e family 2 type 1 port 20838 state 1 src_addr 105.0.0.0 (00.011824) Collected: ino 0x 6b family 2 type 1 port 57925 state 2 src_addr 62.5.0.0 (00.011831) Collected: ino 0x 6c family 2 type 1 port 29542 state 1 src_addr 107.0.0.0 (00.011837) Warn (libnetlink.c:197): netlink: 16 bytes leftover after parsing attributes. (00.011842) Collected: ino 0x 4000c family 2 type 1 port 44854 state 1 src_addr 108.0.0.0 (00.011850) Collected: ino 0x 5e0c family 2 type 1 port 44902 state 1 src_addr 109.0.0.0 (00.011857) Collected: ino 0x 6f family 2 type 1 port 51031 state 1 src_addr 110.0.0.0 (00.011864) Collected: ino 0x 0 family 2 type 1 port 23635 state 1 src_addr 111.0.0.0 (00.011871) Collected: ino 0x 71 family 2 type 1 port 27000 state 1 src_addr 112.0.0.0 (00.011879) Collected: ino 0x 72 family 2 type 1 port 49253 state 1 src_addr 113.0.0.0 (00.011886) Collected: ino 0x 73 family 2 type 1 port 58478 state 1 src_addr 114.0.0.0 (00.011893) Collected: ino 0x 6cd0 family 2 type 1 port 55145 state 1 src_addr 115.0.0.0 (00.011901) Collected: ino 0x 75 family 2 type 1 port 53356 state 1 src_addr 116.0.0.0 (00.011908) Collected: ino 0x 76 family 2 type 1 port 64072 state 1 src_addr 117.0.0.0 (00.011915) Collected: ino 0x 77 family 2 type 1 port 50544 state 1 src_addr 118.0.0.0 (00.011922) Collected: ino 0x 78 family 2 type 1 port 16471 state 1 src_addr 119.0.0.0 (00.011930) Collected: ino 0x 4c8 family 2 type 1 port 31059 state 1 src_addr 120.0.0.0 (00.011937) Collected: ino 0x 7a family 2 type 1 port 54186 state 1 src_addr 200.4.0.0 (00.011944) Collected: ino 0x 7b family 2 type 1 port 16487 state 1 src_addr 122.0.0.0 (00.011952) Collected: ino 0x 7c family 2 type 1 port 50006 state 1 src_addr 123.0.0.0 (00.011959) Collected: ino 0x 7d family 2 type 1 port 33695 state 1 src_addr 124.0.0.0 (00.011966) Collected: ino 0x 7e family 2 type 1 port 15983 state 1 src_addr 125.0.0.0 (00.011973) Collected: ino 0x 7f family 2 type 1 port 55620 state 2 src_addr 126.0.0.0 (00.011980) Collected: ino 0x 4ca family 2 type 1 port 57 state 2 src_addr 127.0.0.0 (00.011987) Collected: ino 0x 4cb family 2 type 1 port 60549 state 1 src_addr 202.4.0.0 (00.011994) Warn (libnetlink.c:197): netlink: 44 bytes leftover after parsing attributes. (00.011999) Collected: ino 0x34373154 family 2 type 1 port 58943 state 1 src_addr 203.4.0.0 (00.012006) Collected: ino 0x 82 family 2 type 1 port 40886 state 1 src_addr 128.0.0.0 (00.012014) Collected: ino 0x 84 family 2 type 1 port 21591 state 1 src_addr 130.0.0.0 (00.012021) Collected: ino 0x 85 family 2 type 1 port 30340 state 1 src_addr 132.0.0.0 (00.012028) Collected: ino 0x 86 family 2 type 1 port 48995 state 1 src_addr 133.0.0.0 (00.012035) Collected: ino 0x 87 family 2 type 1 port 49780 state 1 src_addr 134.0.0.0 (00.012042) Collected: ino 0x 3c family 2 type 1 port 12143 state 1 src_addr 135.0.0.0 (00.012050) Collected: ino 0x 8a family 2 type 1 port 60247 state 1 src_addr 136.0.0.0 (00.012057) Collected: ino 0x 8b family 2 type 1 port 10845 state 1 src_addr 138.0.0.0 (00.012064) Collected: ino 0x 8c family 2 type 1 port 53113 state 1 src_addr 139.0.0.0 (00.012072) Collected: ino 0x 8d family 2 type 1 port 43878 state 1 src_addr 140.0.0.0 (00.012079) Collected: ino 0x 8e family 2 type 1 port 37702 state 1 src_addr 141.0.0.0 (00.012086) Collected: ino 0x 4cd family 2 type 1 port 20790 state 1 src_addr 142.0.0.0 (00.012093) Collected: ino 0x 8f family 2 type 1 port 58213 state 1 src_addr 205.4.0.0 (00.012100) Collected: ino 0x 90 family 2 type 1 port 57449 state 1 src_addr 143.0.0.0 (00.012110) Collected: ino 0x 91 family 2 type 1 port 50793 state 1 src_addr 144.0.0.0 (00.012118) Collected: ino 0x 92 family 2 type 1 port 14705 state 1 src_addr 145.0.0.0 (00.012125) Collected: ino 0x 93 family 2 type 1 port 30584 state 1 src_addr 146.0.0.0 (00.012132) Collected: ino 0x 0 family 2 type 1 port 22397 state 1 src_addr 147.0.0.0 (00.012139) Collected: ino 0x 0 family 2 type 1 port 20845 state 1 src_addr 148.0.0.0 (00.012147) Collected: ino 0x 95 family 2 type 1 port 22672 state 2 src_addr 206.4.0.0 (00.012154) Collected: ino 0x 96 family 2 type 1 port 36967 state 1 src_addr 149.0.0.0 (00.012161) Collected: ino 0x 97 family 2 type 1 port 14713 state 1 src_addr 150.0.0.0 (00.012168) Collected: ino 0x 53f family 2 type 1 port 43640 state 1 src_addr 151.0.0.0 (00.012175) Collected: ino 0x 99 family 2 type 1 port 22819 state 1 src_addr 63.5.0.0 (00.012183) Collected: ino 0x 9a family 2 type 1 port 27503 state 1 src_addr 153.0.0.0 (00.012189) Warn (libnetlink.c:197): netlink: 16 bytes leftover after parsing attributes. (00.012195) Collected: ino 0x 4000c family 2 type 1 port 7530 state 1 src_addr 154.0.0.0 (00.012201) Warn (libnetlink.c:197): netlink: 16 bytes leftover after parsing attributes. (00.012206) Collected: ino 0x 4000c family 2 type 1 port 45897 state 1 src_addr 156.0.0.0 (00.012214) Collected: ino 0x 9e family 2 type 1 port 57977 state 1 src_addr 157.0.0.0 (00.012221) Collected: ino 0x 9f family 2 type 1 port 8095 state 1 src_addr 158.0.0.0 (00.012228) Collected: ino 0x a0 family 2 type 1 port 31348 state 1 src_addr 159.0.0.0 (00.012236) Collected: ino 0x 0 family 2 type 1 port 53614 state 1 src_addr 160.0.0.0 (00.012243) Collected: ino 0x 3c family 2 type 1 port 7278 state 1 src_addr 161.0.0.0 (00.012250) Collected: ino 0x a3 family 2 type 1 port 54629 state 1 src_addr 162.0.0.0 (00.012257) Collected: ino 0x a4 family 2 type 1 port 27478 state 1 src_addr 163.0.0.0 (00.012264) Collected: ino 0x a5 family 2 type 1 port 49495 state 1 src_addr 164.0.0.0 (00.012271) Collected: ino 0x 0 family 2 type 1 port 62034 state 1 src_addr 165.0.0.0 (00.012279) Collected: ino 0x a6 family 2 type 1 port 13946 state 1 src_addr 208.4.0.0 (00.012286) Collected: ino 0x 4d1 family 2 type 1 port 48462 state 1 src_addr 166.0.0.0 (00.012293) Collected: ino 0x a8 family 2 type 1 port 25484 state 1 src_addr 209.4.0.0 (00.012300) Collected: ino 0x a9 family 2 type 1 port 30072 state 1 src_addr 168.0.0.0 (00.012307) Collected: ino 0x 0 family 2 type 1 port 14955 state 1 src_addr 169.0.0.0 (00.012314) Collected: ino 0x ab family 2 type 1 port 51037 state 1 src_addr 170.0.0.0 (00.012322) Collected: ino 0x 0 family 2 type 1 port 24923 state 1 src_addr 171.0.0.0 (00.012328) Warn (libnetlink.c:197): netlink: 16 bytes leftover after parsing attributes. (00.012334) Collected: ino 0x 4000c family 2 type 1 port 15190 state 1 src_addr 172.0.0.0 (00.012341) Collected: ino 0x 0 family 2 type 1 port 53093 state 1 src_addr 176.0.0.0 (00.012348) Collected: ino 0x b2 family 2 type 1 port 35180 state 1 src_addr 177.0.0.0 (00.012356) Collected: ino 0x 6c5e family 2 type 1 port 51282 state 1 src_addr 178.0.0.0 (00.012363) Collected: ino 0x b4 family 2 type 1 port 7003 state 2 src_addr 179.0.0.0 (00.012369) Warn (libnetlink.c:197): netlink: 16 bytes leftover after parsing attributes. (00.012375) Collected: ino 0x 4000c family 2 type 1 port 14906 state 1 src_addr 180.0.0.0 (00.012382) Collected: ino 0x 0 family 2 type 1 port 39009 state 1 src_addr 181.0.0.0 (00.012388) Warn (libnetlink.c:197): netlink: 16 bytes leftover after parsing attributes. (00.012394) Collected: ino 0x 4000c family 2 type 1 port 48980 state 1 src_addr 182.0.0.0 (00.012401) Collected: ino 0x b8 family 2 type 1 port 54137 state 1 src_addr 183.0.0.0 (00.012408) Collected: ino 0x 56e9 family 2 type 1 port 1130 state 1 src_addr 184.0.0.0 (00.012416) Collected: ino 0x ba family 2 type 1 port 45910 state 2 src_addr 185.0.0.0 (00.012423) Collected: ino 0x bb family 2 type 1 port 58700 state 1 src_addr 186.0.0.0 (00.012430) Collected: ino 0x bc family 2 type 1 port 52549 state 2 src_addr 187.0.0.0 (00.012437) Collected: ino 0x be family 2 type 1 port 43333 state 2 src_addr 188.0.0.0 (00.012444) Collected: ino 0x bf family 2 type 1 port 4794 state 1 src_addr 190.0.0.0 (00.012451) Collected: ino 0x c0 family 2 type 1 port 14515 state 1 src_addr 191.0.0.0 (00.012458) Collected: ino 0x c1 family 2 type 1 port 19841 state 1 src_addr 192.0.0.0 (00.012466) Collected: ino 0x c2 family 2 type 1 port 43124 state 1 src_addr 193.0.0.0 (00.012473) Collected: ino 0x c3 family 2 type 1 port 879 state 1 src_addr 194.0.0.0 (00.012480) Collected: ino 0x c4 family 2 type 1 port 58711 state 1 src_addr 195.0.0.0 (00.012488) Collected: ino 0x c5 family 2 type 1 port 9578 state 1 src_addr 196.0.0.0 (00.012494) Warn (libnetlink.c:197): netlink: 16 bytes leftover after parsing attributes. (00.012499) Collected: ino 0x 4000c family 2 type 1 port 44396 state 1 src_addr 197.0.0.0 (00.012507) Collected: ino 0x 540 family 2 type 1 port 18223 state 1 src_addr 199.0.0.0 (00.012514) Collected: ino 0x 4d2 family 2 type 1 port 61567 state 1 src_addr 64.5.0.0 (00.012521) Collected: ino 0x 54 family 2 type 1 port 53674 state 1 src_addr 210.4.0.0 (00.012528) Collected: ino 0x 58 family 2 type 1 port 51293 state 1 src_addr 200.0.0.0 (00.012536) Collected: ino 0x 0 family 2 type 1 port 19302 state 1 src_addr 201.0.0.0 (00.012543) Collected: ino 0x 58 family 2 type 1 port 21101 state 1 src_addr 202.0.0.0 (00.012550) Collected: ino 0x 0 family 2 type 1 port 25996 state 1 src_addr 211.4.0.0 (00.012556) Warn (libnetlink.c:197): netlink: 16 bytes leftover after parsing attributes. (00.012562) Collected: ino 0x 4000c family 2 type 1 port 59266 state 1 src_addr 212.4.0.0 (00.012569) Collected: ino 0x 4d5 family 2 type 1 port 33439 state 1 src_addr 203.0.0.0 (00.012575) Warn (libnetlink.c:197): netlink: 16 bytes leftover after parsing attributes. (00.012581) Collected: ino 0x 4000c family 2 type 1 port 41589 state 1 src_addr 213.4.0.0 (00.012588) Collected: ino 0x ce family 2 type 1 port 65373 state 1 src_addr 205.0.0.0 (00.012594) Warn (libnetlink.c:197): netlink: 16 bytes leftover after parsing attributes. (00.012600) Collected: ino 0x 4000c family 2 type 1 port 61293 state 1 src_addr 206.0.0.0 (00.012607) Collected: ino 0x 0 family 2 type 1 port 11527 state 1 src_addr 65.5.0.0 (00.012617) Collected: ino 0x 791f family 2 type 1 port 6016 state 1 src_addr 208.0.0.0 (00.012625) Collected: ino 0x 78df family 2 type 1 port 16743 state 1 src_addr 209.0.0.0 (00.012631) Warn (libnetlink.c:197): netlink: 16 bytes leftover after parsing attributes. (00.012637) Collected: ino 0x 4000c family 2 type 1 port 16751 state 1 src_addr 210.0.0.0 (00.012645) Collected: ino 0x d6 family 2 type 1 port 12662 state 1 src_addr 213.0.0.0 (00.012652) Collected: ino 0x 0 family 2 type 1 port 30315 state 1 src_addr 214.0.0.0 (00.012660) Collected: ino 0x 0 family 2 type 1 port 20077 state 1 src_addr 215.0.0.0 (00.012667) Collected: ino 0x 4ac9 family 2 type 1 port 590 state 1 src_addr 216.0.0.0 (00.012674) Collected: ino 0x da family 2 type 1 port 31081 state 1 src_addr 217.0.0.0 (00.012681) Collected: ino 0x db family 2 type 1 port 6815 state 1 src_addr 218.0.0.0 (00.012688) Collected: ino 0x dc family 2 type 1 port 31860 state 1 src_addr 219.0.0.0 (00.012695) Collected: ino 0x dd family 2 type 1 port 9031 state 1 src_addr 220.0.0.0 (00.012702) Collected: ino 0x de family 2 type 1 port 32453 state 1 src_addr 221.0.0.0 (00.012710) Collected: ino 0x 3c family 2 type 1 port 7859 state 1 src_addr 222.0.0.0 (00.012717) Collected: ino 0x e0 family 2 type 1 port 23907 state 1 src_addr 223.0.0.0 (00.012724) Collected: ino 0x 0 family 2 type 1 port 36955 state 1 src_addr 224.0.0.0 (00.012731) Collected: ino 0x 0 family 2 type 1 port 50537 state 1 src_addr 225.0.0.0 (00.012737) Collected: ino 0x 46d family 2 type 1 port 49277 state 2 src_addr 66.5.0.0 (00.012743) Warn (libnetlink.c:197): netlink: 16 bytes leftover after parsing attributes. (00.012749) Collected: ino 0x 4000c family 2 type 1 port 38402 state 1 src_addr 109.4.0.0 (00.012756) Collected: ino 0x e3 family 2 type 1 port 2692 state 1 src_addr 226.0.0.0 (00.012763) Collected: ino 0x e4 family 2 type 1 port 40824 state 1 src_addr 227.0.0.0 (00.012770) Collected: ino 0x 0 family 2 type 1 port 5214 state 1 src_addr 228.0.0.0 (00.012777) Warn (libnetlink.c:197): netlink: 16 bytes leftover after parsing attributes. (00.012782) Collected: ino 0x 4000c family 2 type 1 port 32087 state 1 src_addr 229.0.0.0 (00.012790) Collected: ino 0x e7 family 2 type 1 port 21136 state 2 src_addr 214.4.0.0 (00.012797) Collected: ino 0x 0 family 2 type 1 port 1119 state 1 src_addr 231.0.0.0 (00.013040) Warn (libnetlink.c:54): ERROR -16 reported by netlink

Program received signal SIGSEGV, Segmentation fault. 0x00007ffff7398059 in nla_get_u8 () from /usr/lib64/libnl-3.so.200

(gdb) bt

0 0x00007ffff7398059 in nla_get_u8 () from /usr/lib64/libnl-3.so.200

1 0x000000000046be45 in inet_collect_one (h=0x6e92a0 , family=2, type=2) at sk-inet.c:427

2 0x00000000004487f9 in nlmsg_receive (buf=0x6e92a0 "<", arg=, err_cb=, cb=,

len=<optimized out>) at libnetlink.c:45

3 do_rtnl_req (nl=nl@entry=9, req=req@entry=0x7fffffffddf0, size=size@entry=72,

receive_callback=receive_callback@entry=0x472570 <inet_receive_one>, error_callback=0x448640 <rtnl_return_err>, 
error_callback@entry=0x0, arg=arg@entry=0x7fffffffde00) at libnetlink.c:119

4 0x00000000004725fc in do_collect_req (nl=nl@entry=9, req=req@entry=0x7fffffffddf0,

receive_callback=receive_callback@entry=0x472570 <inet_receive_one>, arg=arg@entry=0x7fffffffde00, size=72) at sockets.c:610

5 0x000000000047398e in collect_sockets (ns=ns@entry=0x6f4850) at sockets.c:655

6 0x0000000000454678 in collect_net_ns (ns=0x6f4850, oarg=) at net.c:1399

7 0x00000000004534a2 in collect_namespaces (for_dump=for_dump@entry=true) at namespaces.c:1345

8 0x00000000004315c0 in cr_dump_tasks (pid=pid@entry=4960) at cr-dump.c:1691

9 0x000000000041eeea in main (argc=, argv=0x7fffffffe358, envp=) at crtools.c:633

avagin commented 8 years ago
426 if (tb[INET_DIAG_SHUTDOWN])
427     d->shutdown = nla_get_u8(tb[INET_DIAG_SHUTDOWN]);
428 else
429     pr_err_once("Can't check shutdown state of inet socket\n");
(00.011094) Can't check shutdown state of inet socket
avagin commented 8 years ago

What is a kernel version here?

avagin commented 8 years ago

If you can reproduce this issue, could you collect strace for criu dump? strace -fs 256 -o /tmp/strace.out criu dump ....

xemul commented 8 years ago

@kikosha would you be able to help @avagin with the info he requested?

xemul commented 8 years ago

@kikosha , would you?

xemul commented 8 years ago

OK, if it's still a problem -- just re-open the issue.