search

Zygo / bees

Best-Effort Extent-Same, a btrfs dedupe agent
GNU General Public License v3.0
625 stars 56 forks source link

Bees crashes after 10 minutes of running #252

Open S-trace opened 1 year ago

S-trace commented 1 year ago

Hello.

I'm using bees version 0.9.1.r0.gfd6c3b3 on Manjaro with kernel 6.1.12-1-MANJARO #1 SMP PREEMPT_DYNAMIC Tue Feb 14 21:59:10 UTC 2023 x86_64

It sometimes crashes with the following error messages:

Process 537088 (bees) of user 0 dumped core.

Stack trace of thread 537114:
#0  0x00007f0478aa08ec n/a (libc.so.6 + 0x878ec)
#1  0x00007f0478a51ea8 raise (libc.so.6 + 0x38ea8)
#2  0x00007f0478a3b53d abort (libc.so.6 + 0x2253d)
#3  0x00007f0478a3c29e n/a (libc.so.6 + 0x2329e)
#4  0x00007f0478aaa657 n/a (libc.so.6 + 0x91657)
#5  0x00007f0478aac83c n/a (libc.so.6 + 0x9383c)
#6  0x00007f0478aaee63 __libc_free (libc.so.6 + 0x95e63)
#7  0x000055ef4faf2272 n/a (bees + 0x9b272)
#8  0x000055ef4fa8ab62 n/a (bees + 0x33b62)
#9  0x000055ef4fa9feb9 n/a (bees + 0x48eb9)
#10 0x000055ef4faa1bf8 n/a (bees + 0x4abf8)
#11 0x000055ef4fb01267 n/a (bees + 0xaa267)
#12 0x000055ef4fa94686 n/a (bees + 0x3d686)
#13 0x000055ef4fb01267 n/a (bees + 0xaa267)
#14 0x000055ef4faa252d n/a (bees + 0x4b52d)
#15 0x000055ef4fac8b7f n/a (bees + 0x71b7f)
#16 0x000055ef4fb01267 n/a (bees + 0xaa267)
#17 0x000055ef4fad4f37 n/a (bees + 0x7df37)
#18 0x000055ef4fad51da n/a (bees + 0x7e1da)
#19 0x000055ef4fb01267 n/a (bees + 0xaa267)
#20 0x000055ef4fb24267 n/a (bees + 0xcd267)
#21 0x000055ef4fb01267 n/a (bees + 0xaa267)
#22 0x000055ef4fb24acd n/a (bees + 0xcdacd)
#23 0x00007f0478cd72c3 execute_native_thread_routine (libstdc++.so.6 + 0xd72c3)
#24 0x00007f0478a9ebb5 n/a (libc.so.6 + 0x85bb5)
#25 0x00007f0478b20d90 n/a (libc.so.6 + 0x107d90)

Stack trace of thread 537112:
#0  0x000055ef4fb209e0 n/a (bees + 0xc99e0)
#1  0x000055ef4fad5204 n/a (bees + 0x7e204)
#2  0x000055ef4fb01267 n/a (bees + 0xaa267)
#3  0x000055ef4fb24267 n/a (bees + 0xcd267)
#4  0x000055ef4fb01267 n/a (bees + 0xaa267)
#5  0x000055ef4fb24acd n/a (bees + 0xcdacd)
#6  0x00007f0478cd72c3 execute_native_thread_routine (libstdc++.so.6 + 0xd72c3)
#7  0x00007f0478a9ebb5 n/a (libc.so.6 + 0x85bb5)
#8  0x00007f0478b20d90 n/a (libc.so.6 + 0x107d90)

Stack trace of thread 537117:
#0  0x00007f0478b190dd syscall (libc.so.6 + 0x1000dd)
#1  0x000055ef4fb1c125 n/a (bees + 0xc5125)
#2  0x000055ef4fae0924 n/a (bees + 0x89924)
#3  0x000055ef4fad51ba n/a (bees + 0x7e1ba)
#4  0x000055ef4fb01267 n/a (bees + 0xaa267)
#5  0x000055ef4fb24267 n/a (bees + 0xcd267)
#6  0x000055ef4fb01267 n/a (bees + 0xaa267)
#7  0x000055ef4fb24acd n/a (bees + 0xcdacd)
#8  0x00007f0478cd72c3 execute_native_thread_routine (libstdc++.so.6 + 0xd72c3)
#9  0x00007f0478a9ebb5 n/a (libc.so.6 + 0x85bb5)
#10 0x00007f0478b20d90 n/a (libc.so.6 + 0x107d90)

Stack trace of thread 537115:
#0  0x00007f0478a9ba07 n/a (libc.so.6 + 0x82a07)
#1  0x00007f0478aa3713 n/a (libc.so.6 + 0x8a713)
#2  0x000055ef4fab25e5 n/a (bees + 0x5b5e5)
#3  0x000055ef4fab2a89 n/a (bees + 0x5ba89)
#4  0x000055ef4fab7845 n/a (bees + 0x60845)
#5  0x000055ef4fa9fa1a n/a (bees + 0x48a1a)
#6  0x000055ef4faa1bf8 n/a (bees + 0x4abf8)
#7  0x000055ef4fb01267 n/a (bees + 0xaa267)
#8  0x000055ef4fa94686 n/a (bees + 0x3d686)
#9  0x000055ef4fb01267 n/a (bees + 0xaa267)
#10 0x000055ef4faa252d n/a (bees + 0x4b52d)
#11 0x000055ef4fac8b7f n/a (bees + 0x71b7f)
#12 0x000055ef4fb01267 n/a (bees + 0xaa267)
#13 0x000055ef4fad4f37 n/a (bees + 0x7df37)
#14 0x000055ef4fad51da n/a (bees + 0x7e1da)
#15 0x000055ef4fb01267 n/a (bees + 0xaa267)
#16 0x000055ef4fb24267 n/a (bees + 0xcd267)
#17 0x000055ef4fb01267 n/a (bees + 0xaa267)
#18 0x000055ef4fb24acd n/a (bees + 0xcdacd)
#19 0x00007f0478cd72c3 execute_native_thread_routine (libstdc++.so.6 + 0xd72c3)
#20 0x00007f0478a9ebb5 n/a (libc.so.6 + 0x85bb5)
#21 0x00007f0478b20d90 n/a (libc.so.6 + 0x107d90)

Stack trace of thread 537122:
#0  0x00007f0478a9b9a0 n/a (libc.so.6 + 0x829a0)
#1  0x00007f0478aa1ea2 pthread_mutex_lock (libc.so.6 + 0x88ea2)
#2  0x000055ef4fae0590 n/a (bees + 0x89590)
#3  0x000055ef4fae81cc n/a (bees + 0x911cc)
#4  0x000055ef4fae8505 n/a (bees + 0x91505)
#5  0x000055ef4fa9ed8c n/a (bees + 0x47d8c)
#6  0x000055ef4faa1bf8 n/a (bees + 0x4abf8)
#7  0x000055ef4fb01267 n/a (bees + 0xaa267)
#8  0x000055ef4fa94686 n/a (bees + 0x3d686)
#9  0x000055ef4fb01267 n/a (bees + 0xaa267)
#10 0x000055ef4faa252d n/a (bees + 0x4b52d)
#11 0x000055ef4fac8b7f n/a (bees + 0x71b7f)
#12 0x000055ef4fb01267 n/a (bees + 0xaa267)
#13 0x000055ef4fad4f37 n/a (bees + 0x7df37)
#14 0x000055ef4fad51da n/a (bees + 0x7e1da)
#15 0x000055ef4fb01267 n/a (bees + 0xaa267)
#16 0x000055ef4fb24267 n/a (bees + 0xcd267)
#17 0x000055ef4fb01267 n/a (bees + 0xaa267)
#18 0x000055ef4fb24acd n/a (bees + 0xcdacd)
#19 0x00007f0478cd72c3 execute_native_thread_routine (libstdc++.so.6 + 0xd72c3)
#20 0x00007f0478a9ebb5 n/a (libc.so.6 + 0x85bb5)
#21 0x00007f0478b20d90 n/a (libc.so.6 + 0x107d90)

Stack trace of thread 537123:
#0  0x00007f0478a9b766 n/a (libc.so.6 + 0x82766)
#1  0x00007f0478a9e597 pthread_cond_clockwait (libc.so.6 + 0x85597)
#2  0x000055ef4fa9660e n/a (bees + 0x3f60e)
#3  0x000055ef4fb01267 n/a (bees + 0xaa267)
#4  0x000055ef4fade583 n/a (bees + 0x87583)
#5  0x00007f0478cd72c3 execute_native_thread_routine (libstdc++.so.6 + 0xd72c3)
#6  0x00007f0478a9ebb5 n/a (libc.so.6 + 0x85bb5)
#7  0x00007f0478b20d90 n/a (libc.so.6 + 0x107d90)

Stack trace of thread 537126:
#0  0x00007f0478a9b766 n/a (libc.so.6 + 0x82766)
#1  0x00007f0478a9e597 pthread_cond_clockwait (libc.so.6 + 0x85597)
#2  0x000055ef4fab6d3c n/a (bees + 0x5fd3c)
#3  0x000055ef4fb01267 n/a (bees + 0xaa267)
#4  0x000055ef4fade583 n/a (bees + 0x87583)
#5  0x00007f0478cd72c3 execute_native_thread_routine (libstdc++.so.6 + 0xd72c3)
#6  0x00007f0478a9ebb5 n/a (libc.so.6 + 0x85bb5)
#7  0x00007f0478b20d90 n/a (libc.so.6 + 0x107d90)

Stack trace of thread 537111:
#0  0x00007f0478aae9b5 malloc (libc.so.6 + 0x959b5)
#1  0x00007f0478ca748d _Znwm (libstdc++.so.6 + 0xa748d)
#2  0x000055ef4fb086dd n/a (bees + 0xb16dd)
#3  0x000055ef4fb0751f n/a (bees + 0xb051f)
#4  0x000055ef4fb02fbe n/a (bees + 0xabfbe)
#5  0x000055ef4fb05518 n/a (bees + 0xae518)
#6  0x000055ef4fb06d4b n/a (bees + 0xafd4b)
#7  0x000055ef4faef0d8 n/a (bees + 0x980d8)
#8  0x000055ef4fac20e6 n/a (bees + 0x6b0e6)
#9  0x000055ef4fac3636 n/a (bees + 0x6c636)
#10 0x000055ef4fac46c7 n/a (bees + 0x6d6c7)
#11 0x000055ef4faa0c77 n/a (bees + 0x49c77)
#12 0x000055ef4faa1bf8 n/a (bees + 0x4abf8)
#13 0x000055ef4fb01267 n/a (bees + 0xaa267)
#14 0x000055ef4fa94686 n/a (bees + 0x3d686)
#15 0x000055ef4fb01267 n/a (bees + 0xaa267)
#16 0x000055ef4faa252d n/a (bees + 0x4b52d)
#17 0x000055ef4fac8b7f n/a (bees + 0x71b7f)
#18 0x000055ef4fb01267 n/a (bees + 0xaa267)
#19 0x000055ef4fad4f37 n/a (bees + 0x7df37)
#20 0x000055ef4fad51da n/a (bees + 0x7e1da)
#21 0x000055ef4fb01267 n/a (bees + 0xaa267)
#22 0x000055ef4fb24267 n/a (bees + 0xcd267)
#23 0x000055ef4fb01267 n/a (bees + 0xaa267)
#24 0x000055ef4fb24acd n/a (bees + 0xcdacd)
#25 0x00007f0478cd72c3 execute_native_thread_routine (libstdc++.so.6 + 0xd72c3)
#26 0x00007f0478a9ebb5 n/a (libc.so.6 + 0x85bb5)
#27 0x00007f0478b20d90 n/a (libc.so.6 + 0x107d90)

Stack trace of thread 537088:
#0  0x00007f0478a52c0a __sigtimedwait (libc.so.6 + 0x39c0a)
#1  0x000055ef4fa83a8c n/a (bees + 0x2ca8c)
#2  0x000055ef4fa89acb n/a (bees + 0x32acb)
#3  0x000055ef4fa8a29d n/a (bees + 0x3329d)
#4  0x000055ef4fb01267 n/a (bees + 0xaa267)
#5  0x000055ef4fa7e8f9 n/a (bees + 0x278f9)
#6  0x00007f0478a3c790 n/a (libc.so.6 + 0x23790)
#7  0x00007f0478a3c84a __libc_start_main (libc.so.6 + 0x2384a)
#8  0x000055ef4fa7f0f5 n/a (bees + 0x280f5)

Stack trace of thread 537124:
#0  0x00007f0478a9b766 n/a (libc.so.6 + 0x82766)
#1  0x00007f0478a9e597 pthread_cond_clockwait (libc.so.6 + 0x85597)
#2  0x000055ef4fa9a72e n/a (bees + 0x4372e)
#3  0x000055ef4fb01267 n/a (bees + 0xaa267)
#4  0x000055ef4fade583 n/a (bees + 0x87583)
#5  0x00007f0478cd72c3 execute_native_thread_routine (libstdc++.so.6 + 0xd72c3)
#6  0x00007f0478a9ebb5 n/a (libc.so.6 + 0x85bb5)
#7  0x00007f0478b20d90 n/a (libc.so.6 + 0x107d90)

Stack trace of thread 537120:
#0  0x00007f0478a9b9a0 n/a (libc.so.6 + 0x829a0)
#1  0x00007f0478aa1ea2 pthread_mutex_lock (libc.so.6 + 0x88ea2)
#2  0x000055ef4fae0590 n/a (bees + 0x89590)
#3  0x000055ef4fab266c n/a (bees + 0x5b66c)
#4  0x000055ef4fab2a89 n/a (bees + 0x5ba89)
#5  0x000055ef4fab3b40 n/a (bees + 0x5cb40)
#6  0x000055ef4fa9f4e3 n/a (bees + 0x484e3)
#7  0x000055ef4faa1bf8 n/a (bees + 0x4abf8)
#8  0x000055ef4fb01267 n/a (bees + 0xaa267)
#9  0x000055ef4fa94686 n/a (bees + 0x3d686)
#10 0x000055ef4fb01267 n/a (bees + 0xaa267)
#11 0x000055ef4faa252d n/a (bees + 0x4b52d)
#12 0x000055ef4fac8b7f n/a (bees + 0x71b7f)
#13 0x000055ef4fb01267 n/a (bees + 0xaa267)
#14 0x000055ef4fad4f37 n/a (bees + 0x7df37)
#15 0x000055ef4fad51da n/a (bees + 0x7e1da)
#16 0x000055ef4fb01267 n/a (bees + 0xaa267)
#17 0x000055ef4fb24267 n/a (bees + 0xcd267)
#18 0x000055ef4fb01267 n/a (bees + 0xaa267)
#19 0x000055ef4fb24acd n/a (bees + 0xcdacd)
#20 0x00007f0478cd72c3 execute_native_thread_routine (libstdc++.so.6 + 0xd72c3)
#21 0x00007f0478a9ebb5 n/a (libc.so.6 + 0x85bb5)
#22 0x00007f0478b20d90 n/a (libc.so.6 + 0x107d90)

Stack trace of thread 537125:
#0  0x00007f0478a9b766 n/a (libc.so.6 + 0x82766)
#1  0x00007f0478a9e597 pthread_cond_clockwait (libc.so.6 + 0x85597)
#2  0x000055ef4fab3541 n/a (bees + 0x5c541)
#3  0x000055ef4fab3773 n/a (bees + 0x5c773)
#4  0x000055ef4fb01267 n/a (bees + 0xaa267)
#5  0x000055ef4fade583 n/a (bees + 0x87583)
#6  0x00007f0478cd72c3 execute_native_thread_routine (libstdc++.so.6 + 0xd72c3)
#7  0x00007f0478a9ebb5 n/a (libc.so.6 + 0x85bb5)
#8  0x00007f0478b20d90 n/a (libc.so.6 + 0x107d90)

Stack trace of thread 537127:
#0  0x00007f0478a9b766 n/a (libc.so.6 + 0x82766)
#1  0x00007f0478a9e597 pthread_cond_clockwait (libc.so.6 + 0x85597)
#2  0x000055ef4facbfa7 n/a (bees + 0x74fa7)
#3  0x000055ef4fb01267 n/a (bees + 0xaa267)
#4  0x000055ef4fade583 n/a (bees + 0x87583)
#5  0x00007f0478cd72c3 execute_native_thread_routine (libstdc++.so.6 + 0xd72c3)
#6  0x00007f0478a9ebb5 n/a (libc.so.6 + 0x85bb5)
#7  0x00007f0478b20d90 n/a (libc.so.6 + 0x107d90)

Stack trace of thread 537128:
#0  0x00007f0478a9b766 n/a (libc.so.6 + 0x82766)
#1  0x00007f0478a9e597 pthread_cond_clockwait (libc.so.6 + 0x85597)
#2  0x000055ef4facc783 n/a (bees + 0x75783)
#3  0x000055ef4fb01267 n/a (bees + 0xaa267)
#4  0x000055ef4fade583 n/a (bees + 0x87583)
#5  0x00007f0478cd72c3 execute_native_thread_routine (libstdc++.so.6 + 0xd72c3)
#6  0x00007f0478a9ebb5 n/a (libc.so.6 + 0x85bb5)
#7  0x00007f0478b20d90 n/a (libc.so.6 + 0x107d90)

Stack trace of thread 537119:
#0  0x00007f0478a9b9a0 n/a (libc.so.6 + 0x829a0)
#1  0x00007f0478aa1ea2 pthread_mutex_lock (libc.so.6 + 0x88ea2)
#2  0x000055ef4fae0916 n/a (bees + 0x89916)
#3  0x000055ef4facdd97 n/a (bees + 0x76d97)
#4  0x000055ef4face2d6 n/a (bees + 0x772d6)
#5  0x000055ef4fb01267 n/a (bees + 0xaa267)
#6  0x000055ef4fb24267 n/a (bees + 0xcd267)
#7  0x000055ef4fb01267 n/a (bees + 0xaa267)
#8  0x000055ef4fb24acd n/a (bees + 0xcdacd)
#9  0x00007f0478cd72c3 execute_native_thread_routine (libstdc++.so.6 + 0xd72c3)
#10 0x00007f0478a9ebb5 n/a (libc.so.6 + 0x85bb5)
#11 0x00007f0478b20d90 n/a (libc.so.6 + 0x107d90)

Stack trace of thread 537118:
#0  0x00007f0478a9b9a0 n/a (libc.so.6 + 0x829a0)
#1  0x00007f0478aa1ea2 pthread_mutex_lock (libc.so.6 + 0x88ea2)
#2  0x000055ef4fae0916 n/a (bees + 0x89916)
#3  0x000055ef4fab25e5 n/a (bees + 0x5b5e5)
#4  0x000055ef4fab2a89 n/a (bees + 0x5ba89)
#5  0x000055ef4fab7845 n/a (bees + 0x60845)
#6  0x000055ef4fa9fa1a n/a (bees + 0x48a1a)
#7  0x000055ef4faa1bf8 n/a (bees + 0x4abf8)
#8  0x000055ef4fb01267 n/a (bees + 0xaa267)
#9  0x000055ef4fa94686 n/a (bees + 0x3d686)
#10 0x000055ef4fb01267 n/a (bees + 0xaa267)
#11 0x000055ef4faa252d n/a (bees + 0x4b52d)
#12 0x000055ef4fac8b7f n/a (bees + 0x71b7f)
#13 0x000055ef4fb01267 n/a (bees + 0xaa267)
#14 0x000055ef4fad4f37 n/a (bees + 0x7df37)
#15 0x000055ef4fad51da n/a (bees + 0x7e1da)
#16 0x000055ef4fb01267 n/a (bees + 0xaa267)
#17 0x000055ef4fb24267 n/a (bees + 0xcd267)
#18 0x000055ef4fb01267 n/a (bees + 0xaa267)
#19 0x000055ef4fb24acd n/a (bees + 0xcdacd)
#20 0x00007f0478cd72c3 execute_native_thread_routine (libstdc++.so.6 + 0xd72c3)
#21 0x00007f0478a9ebb5 n/a (libc.so.6 + 0x85bb5)
#22 0x00007f0478b20d90 n/a (libc.so.6 + 0x107d90)

Stack trace of thread 537121:
#0  0x00007f0478b1553f ioctl (libc.so.6 + 0xfc53f)
#1  0x000055ef4fb157d5 n/a (bees + 0xbe7d5)
#2  0x000055ef4fb18630 n/a (bees + 0xc1630)
#3  0x000055ef4faf2a35 n/a (bees + 0x9ba35)
#4  0x000055ef4fad4818 n/a (bees + 0x7d818)
#5  0x000055ef4fad51da n/a (bees + 0x7e1da)
#6  0x000055ef4fb01267 n/a (bees + 0xaa267)
#7  0x000055ef4fb24267 n/a (bees + 0xcd267)
#8  0x000055ef4fb01267 n/a (bees + 0xaa267)
#9  0x000055ef4fb24acd n/a (bees + 0xcdacd)
#10 0x00007f0478cd72c3 execute_native_thread_routine (libstdc++.so.6 + 0xd72c3)
#11 0x00007f0478a9ebb5 n/a (libc.so.6 + 0x85bb5)
#12 0x00007f0478b20d90 n/a (libc.so.6 + 0x107d90)

Stack trace of thread 537116:
#0  0x00007f0478b1553f ioctl (libc.so.6 + 0xfc53f)
#1  0x000055ef4fb157d5 n/a (bees + 0xbe7d5)
#2  0x000055ef4fb18630 n/a (bees + 0xc1630)
#3  0x000055ef4faf2a35 n/a (bees + 0x9ba35)
#4  0x000055ef4fad4818 n/a (bees + 0x7d818)
#5  0x000055ef4fad51da n/a (bees + 0x7e1da)
#6  0x000055ef4fb01267 n/a (bees + 0xaa267)
#7  0x000055ef4fb24267 n/a (bees + 0xcd267)
#8  0x000055ef4fb01267 n/a (bees + 0xaa267)
#9  0x000055ef4fb24acd n/a (bees + 0xcdacd)
#10 0x00007f0478cd72c3 execute_native_thread_routine (libstdc++.so.6 + 0xd72c3)
#11 0x00007f0478a9ebb5 n/a (libc.so.6 + 0x85bb5)
#12 0x00007f0478b20d90 n/a (libc.so.6 + 0x107d90)

Stack trace of thread 537113:
#0  0x00007f0478b1553f ioctl (libc.so.6 + 0xfc53f)
#1  0x000055ef4fb16c8b n/a (bees + 0xbfc8b)
#2  0x000055ef4fb16f69 n/a (bees + 0xbff69)
#3  0x000055ef4fa986d7 n/a (bees + 0x416d7)
#4  0x000055ef4fabe4ef n/a (bees + 0x674ef)
#5  0x000055ef4fac34c6 n/a (bees + 0x6c4c6)
#6  0x000055ef4fac46c7 n/a (bees + 0x6d6c7)
#7  0x000055ef4faa0c77 n/a (bees + 0x49c77)
#8  0x000055ef4faa1bf8 n/a (bees + 0x4abf8)
#9  0x000055ef4fb01267 n/a (bees + 0xaa267)
#10 0x000055ef4fa94686 n/a (bees + 0x3d686)
#11 0x000055ef4fb01267 n/a (bees + 0xaa267)
#12 0x000055ef4faa252d n/a (bees + 0x4b52d)
#13 0x000055ef4fac8b7f n/a (bees + 0x71b7f)
#14 0x000055ef4fb01267 n/a (bees + 0xaa267)
#15 0x000055ef4fad4f37 n/a (bees + 0x7df37)
#16 0x000055ef4fad51da n/a (bees + 0x7e1da)
#17 0x000055ef4fb01267 n/a (bees + 0xaa267)
#18 0x000055ef4fb24267 n/a (bees + 0xcd267)
#19 0x000055ef4fb01267 n/a (bees + 0xaa267)
#20 0x000055ef4fb24acd n/a (bees + 0xcdacd)
#21 0x00007f0478cd72c3 execute_native_thread_routine (libstdc++.so.6 + 0xd72c3)
#22 0x00007f0478a9ebb5 n/a (libc.so.6 + 0x85bb5)
#23 0x00007f0478b20d90 n/a (libc.so.6 + 0x107d90)
ELF object binary architecture: AMD x86-64

I have installed bees from AUR's 'bees-git' package.

It seems this backtrace is not very helpful. Can I improve its quality?

Zygo commented 1 year ago

It seems this backtrace is not very helpful.

I can see that free is calling abort which is usually caused by malloc arena corruption. There might be some messages in the log output just before the crash. That's only slightly helpful--we need to see the call sequence leading up to that.

Can I improve its quality?

Please rebuild the binary with -ggdb in CXXFLAGS so it has symbols and debug information.