FreeRADIUS / freeradius-server

FreeRADIUS - A multi-protocol policy server.
http://freeradius.org
GNU General Public License v2.0
2.11k stars 1.08k forks source link

segmentation fault with 3.0.x HEAD #1967

Closed alanbuxey closed 3 years ago

alanbuxey commented 7 years ago

Issue type

See here for debugging instructions and how to obtain backtraces.

NOTE: PATCHES GO IN PULL REQUESTS. IF YOU SUBMIT A DIFF HERE, THE DEVELOPMENT TEAM WILL HUNT YOU DOWN AND BEAT YOU OVER THE HEAD WITH YOUR OWN KEYBOARD.

Defect/Feature description

How to reproduce issue

REMOVE SECTION IF FEATURE REQUEST

Output of [radiusd|freeradius] -X showing issue occurring

(you may need to run [radiusd|freeradius] -fxx -l stdout if using eg RADIUS with TLS) REMOVE SECTION IF FEATURE REQUEST

...all normal , nothing seen at all, just this sort of stuff...and then

Fri Apr 21 08:00:28 2017 : Auth: (141)   Login OK: [user@domain] (from client client-1 port 0 via TLS tunnel)
Fri Apr 21 08:00:28 2017 : Info: rlm_ldap (ldap2): Deleting connection (15)
Fri Apr 21 08:00:28 2017 : Auth: (147) Login OK: [anonymous@domain] (from client client-1 port 8 cli 00-de-ad-00-be-ef)
Fri Apr 21 08:00:28 2017 : Info: rlm_ldap (ldap3): Deleting connection (12)
Fri Apr 21 08:00:28 2017 : Auth: (146)   Login OK: [host/machine1.local] (from client client-1 port 0 via TLS tunnel)
Fri Apr 21 08:00:28 2017 : Auth: (148) Login OK: [host/machine1.local] (from client client-1 port 8 cli aa-bb-cc-dd-ee-ff)
CAUGHT SIGNAL: Segmentation fault
Backtrace of last 18 frames:
/usr/lib/libfreeradius-radius.so(fr_fault+0x114)[0x7fbaa40993bc]
/lib64/libpthread.so.0(+0xf370)[0x7fbaa296b370]
/lib64/libc.so.6(+0x7c208)[0x7fbaa23e0208]
/lib64/libtalloc.so.2(+0xa0c4)[0x7fbaa361f0c4]
/lib64/libtalloc.so.2(+0xa01b)[0x7fbaa361f01b]
/lib64/libtalloc.so.2(+0xa01b)[0x7fbaa361f01b]
/lib64/libtalloc.so.2(+0xa01b)[0x7fbaa361f01b]
/lib64/libtalloc.so.2(_talloc_free+0x123)[0x7fbaa3618b63]
/usr/sbin/radiusd[0x43b800]
/usr/sbin/radiusd[0x43bf94]
/usr/sbin/radiusd[0x43c935]
/usr/sbin/radiusd[0x43b70d]
/usr/lib/libfreeradius-radius.so(fr_event_run+0x144)[0x7fbaa40c0688]
/usr/lib/libfreeradius-radius.so(fr_event_loop+0x4ed)[0x7fbaa40c0fa8]
/usr/sbin/radiusd(radius_event_process+0x26)[0x446d9d]
/usr/sbin/radiusd(main+0xc81)[0x431203]
/lib64/libc.so.6(__libc_start_main+0xf5)[0x7fbaa2385b35]
/usr/sbin/radiusd[0x40eb89]
Calling: gdb -silent -x /etc/raddb/panic.gdb /usr/sbin/radiusd 5321 2>&1 | tee /var/log/radius/gdb-radiusd-5321.log
Temporarily setting PR_DUMPABLE to 1
Resetting PR_DUMPABLE to 0
Panic action exited with 0
_EXIT(0) CALLED src/lib/debug.c[743]

Full backtrace from LLDB or GDB

REMOVE SECTION IF FEATURE REQUEST OR NOT CRASH/MEMORY CORRUPTION

more gdb-radiusd-5321.log

Reading symbols from /usr/sbin/radiusd...done.
Attaching to program: /usr/sbin/radiusd, process 5321
Reading symbols from /usr/lib/libfreeradius-server.so...done.
Loaded symbols for /usr/lib/libfreeradius-server.so
Reading symbols from /usr/lib/libfreeradius-radius.so...done.
Loaded symbols for /usr/lib/libfreeradius-radius.so
Reading symbols from /usr/lib/libfreeradius-eap.so...done.
Loaded symbols for /usr/lib/libfreeradius-eap.so
Reading symbols from /lib64/libcrypto.so.10...Reading symbols from /lib64/libcrypto.so.10...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libcrypto.so.10
Reading symbols from /lib64/libssl.so.10...Reading symbols from /lib64/libssl.so.10...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libssl.so.10
Reading symbols from /lib64/libtalloc.so.2...Reading symbols from /lib64/libtalloc.so.2...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libtalloc.so.2
Reading symbols from /lib64/libpcre.so.1...Reading symbols from /lib64/libpcre.so.1...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libpcre.so.1
Reading symbols from /lib64/libcap.so.2...Reading symbols from /lib64/libcap.so.2...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libcap.so.2
Reading symbols from /lib64/libnsl.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib64/libnsl.so.1
Reading symbols from /lib64/libresolv.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/libresolv.so.2
Reading symbols from /lib64/libdl.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/libdl.so.2
Reading symbols from /lib64/libpthread.so.0...(no debugging symbols found)...done.
[New LWP 5450]
[New LWP 5449]
[New LWP 5448]
[New LWP 5447]
[New LWP 5446]
[New LWP 5445]
[New LWP 5444]
[New LWP 5443]
[New LWP 5442]
[New LWP 5441]
[New LWP 5440]
[New LWP 5439]
[New LWP 5438]
[New LWP 5437]
[New LWP 5436]
[New LWP 5435]
[New LWP 5434]
[New LWP 5433]
[New LWP 5432]
[New LWP 5431]
[New LWP 5430]
[New LWP 5429]
[New LWP 5428]
[New LWP 5427]
[New LWP 5426]
[New LWP 5425]
[New LWP 5424]
[New LWP 5423]
[New LWP 5422]
[New LWP 5421]
[New LWP 5420]
[New LWP 5419]
[New LWP 5418]
[New LWP 5417]
[New LWP 5416]
[New LWP 5415]
[New LWP 5414]
[New LWP 5413]
[New LWP 5412]
[New LWP 5411]
[New LWP 5410]
[New LWP 5409]
[New LWP 5408]
[New LWP 5407]
[New LWP 5406]
[New LWP 5405]
[New LWP 5404]
[New LWP 5403]
[New LWP 5402]
[New LWP 5401]
[New LWP 5400]
[New LWP 5399]
[New LWP 5398]
[New LWP 5397]
[New LWP 5396]
[New LWP 5395]
[New LWP 5394]
[New LWP 5393]
[New LWP 5392]
[New LWP 5391]
[New LWP 5390]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib64/libthread_db.so.1".
Loaded symbols for /lib64/libpthread.so.0
Reading symbols from /lib64/libcrypt.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib64/libcrypt.so.1
Reading symbols from /lib64/libc.so.6...(no debugging symbols found)...done.
Loaded symbols for /lib64/libc.so.6
Reading symbols from /lib64/libpcap.so.1...Reading symbols from /lib64/libpcap.so.1...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libpcap.so.1
Reading symbols from /lib64/ld-linux-x86-64.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/ld-linux-x86-64.so.2
Reading symbols from /lib64/libz.so.1...Reading symbols from /lib64/libz.so.1...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libz.so.1
Reading symbols from /lib64/libgssapi_krb5.so.2...Reading symbols from /lib64/libgssapi_krb5.so.2...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libgssapi_krb5.so.2
Reading symbols from /lib64/libkrb5.so.3...Reading symbols from /lib64/libkrb5.so.3...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libkrb5.so.3
Reading symbols from /lib64/libcom_err.so.2...Reading symbols from /lib64/libcom_err.so.2...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libcom_err.so.2
Reading symbols from /lib64/libk5crypto.so.3...Reading symbols from /lib64/libk5crypto.so.3...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libk5crypto.so.3
Reading symbols from /lib64/libattr.so.1...Reading symbols from /lib64/libattr.so.1...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libattr.so.1
Reading symbols from /lib64/libfreebl3.so...Reading symbols from /lib64/libfreebl3.so...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libfreebl3.so
Reading symbols from /lib64/libkrb5support.so.0...Reading symbols from /lib64/libkrb5support.so.0...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libkrb5support.so.0
Reading symbols from /lib64/libkeyutils.so.1...Reading symbols from /lib64/libkeyutils.so.1...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libkeyutils.so.1
Reading symbols from /lib64/libselinux.so.1...Reading symbols from /lib64/libselinux.so.1...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libselinux.so.1
Reading symbols from /lib64/libnss_files.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/libnss_files.so.2
Reading symbols from /lib64/libgcc_s.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib64/libgcc_s.so.1
Reading symbols from /usr/lib/rlm_utf8.so...done.
Loaded symbols for /usr/lib/rlm_utf8.so
Reading symbols from /usr/lib/rlm_unpack.so...done.
Loaded symbols for /usr/lib/rlm_unpack.so
Reading symbols from /usr/lib/rlm_ldap.so...done.
Loaded symbols for /usr/lib/rlm_ldap.so
Reading symbols from /usr/local/lib/libldap-2.4.so.2...done.
Loaded symbols for /usr/local/lib/libldap-2.4.so.2
Reading symbols from /usr/local/lib/liblber-2.4.so.2...done.
Loaded symbols for /usr/local/lib/liblber-2.4.so.2
Reading symbols from /lib64/libsasl2.so.3...Reading symbols from /lib64/libsasl2.so.3...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libsasl2.so.3
Reading symbols from /usr/lib/rlm_radutmp.so...done.
Loaded symbols for /usr/lib/rlm_radutmp.so
Reading symbols from /usr/lib/rlm_sql.so...done.
Loaded symbols for /usr/lib/rlm_sql.so
Reading symbols from /usr/lib/rlm_sql_postgresql.so...done.
Loaded symbols for /usr/lib/rlm_sql_postgresql.so
Reading symbols from /lib64/libpq.so.5...Reading symbols from /lib64/libpq.so.5...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libpq.so.5
Reading symbols from /usr/local/lib/libldap_r-2.4.so.2...done.
Loaded symbols for /usr/local/lib/libldap_r-2.4.so.2
Reading symbols from /usr/lib/rlm_soh.so...done.
Loaded symbols for /usr/lib/rlm_soh.so
Reading symbols from /usr/lib/rlm_replicate.so...done.
Loaded symbols for /usr/lib/rlm_replicate.so
Reading symbols from /usr/lib/rlm_realm.so...done.
Loaded symbols for /usr/lib/rlm_realm.so
Reading symbols from /usr/lib/rlm_preprocess.so...done.
Loaded symbols for /usr/lib/rlm_preprocess.so
Reading symbols from /usr/lib/rlm_passwd.so...done.
Loaded symbols for /usr/lib/rlm_passwd.so
Reading symbols from /usr/lib/rlm_pap.so...done.
Loaded symbols for /usr/lib/rlm_pap.so
Reading symbols from /usr/lib/rlm_exec.so...done.
Loaded symbols for /usr/lib/rlm_exec.so
Reading symbols from /usr/lib/rlm_mschap.so...done.
Loaded symbols for /usr/lib/rlm_mschap.so
Reading symbols from /lib64/libwbclient.so.0...Missing separate debuginfo for /lib64/libwbclient.so.0
Try: yum --enablerepo='*debug*' install /usr/lib/debug/.build-id/99/0861876f9c3654a17e71d271e832f4b42382cd.debug
Reading symbols from /lib64/libwbclient.so.0...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libwbclient.so.0
Reading symbols from /usr/lib64/samba/libwinbind-client-samba4.so...Reading symbols from /usr/lib64/samba/libwinbind-client-samba4.so...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /usr/lib64/samba/libwinbind-client-samba4.so
Reading symbols from /usr/lib64/samba/libreplace-samba4.so...Reading symbols from /usr/lib64/samba/libreplace-samba4.so...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /usr/lib64/samba/libreplace-samba4.so
Reading symbols from /usr/lib/rlm_logintime.so...done.
Loaded symbols for /usr/lib/rlm_logintime.so
Reading symbols from /usr/lib/rlm_linelog.so...done.
Loaded symbols for /usr/lib/rlm_linelog.so
Reading symbols from /usr/lib/rlm_krb5.so...done.
Loaded symbols for /usr/lib/rlm_krb5.so
Reading symbols from /usr/lib/rlm_eap.so...done.
Loaded symbols for /usr/lib/rlm_eap.so
Reading symbols from /usr/lib/rlm_files.so...done.
Loaded symbols for /usr/lib/rlm_files.so
Reading symbols from /usr/lib/rlm_expr.so...done.
Loaded symbols for /usr/lib/rlm_expr.so
Reading symbols from /usr/lib/rlm_expiration.so...done.
Loaded symbols for /usr/lib/rlm_expiration.so
Reading symbols from /usr/lib/rlm_dynamic_clients.so...done.
Loaded symbols for /usr/lib/rlm_dynamic_clients.so
Reading symbols from /usr/lib/rlm_digest.so...done.
Loaded symbols for /usr/lib/rlm_digest.so
Reading symbols from /usr/lib/rlm_dhcp.so...done.
Loaded symbols for /usr/lib/rlm_dhcp.so
Reading symbols from /usr/lib/libfreeradius-dhcp.so...done.
Loaded symbols for /usr/lib/libfreeradius-dhcp.so
Reading symbols from /usr/lib/rlm_detail.so...done.
Loaded symbols for /usr/lib/rlm_detail.so
Reading symbols from /usr/lib/rlm_chap.so...done.
Loaded symbols for /usr/lib/rlm_chap.so
Reading symbols from /usr/lib/rlm_cache.so...done.
Loaded symbols for /usr/lib/rlm_cache.so
Reading symbols from /usr/lib/rlm_attr_filter.so...done.
Loaded symbols for /usr/lib/rlm_attr_filter.so
Reading symbols from /usr/lib/rlm_always.so...done.
Loaded symbols for /usr/lib/rlm_always.so
Reading symbols from /lib64/libnss_dns.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/libnss_dns.so.2
Reading symbols from /usr/lib/rlm_eap_tls.so...done.
Loaded symbols for /usr/lib/rlm_eap_tls.so
Reading symbols from /usr/lib/rlm_eap_ttls.so...done.
Loaded symbols for /usr/lib/rlm_eap_ttls.so
Reading symbols from /usr/lib/rlm_eap_peap.so...done.
Loaded symbols for /usr/lib/rlm_eap_peap.so
Reading symbols from /usr/lib/rlm_eap_mschapv2.so...done.
Loaded symbols for /usr/lib/rlm_eap_mschapv2.so
Reading symbols from /usr/lib/rlm_cache_rbtree.so...done.
Loaded symbols for /usr/lib/rlm_cache_rbtree.so
0x00007fbaa24222c9 in waitpid () from /lib64/libc.so.6
No symbol table info available.
No symbol table info available.

Thread 62 (Thread 0x7fba98a41700 (LWP 5390)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b11e80)
    at src/main/threads.c:629
        self = 0x12b11e80
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 61 (Thread 0x7fba98240700 (LWP 5391)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b31260)
    at src/main/threads.c:629
        self = 0x12b31260
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 60 (Thread 0x7fba97a3f700 (LWP 5392)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b41bf0)
    at src/main/threads.c:629
        self = 0x12b41bf0
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 59 (Thread 0x7fba9723e700 (LWP 5393)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b42290)
    at src/main/threads.c:629
        self = 0x12b42290
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 58 (Thread 0x7fba96a3d700 (LWP 5394)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b47870)
    at src/main/threads.c:629
        self = 0x12b47870
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 57 (Thread 0x7fba9623c700 (LWP 5395)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b49320)
    at src/main/threads.c:629
        self = 0x12b49320
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 56 (Thread 0x7fba95a3b700 (LWP 5396)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b52290)
    at src/main/threads.c:629
        self = 0x12b52290
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 55 (Thread 0x7fba9523a700 (LWP 5397)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b526e0)
    at src/main/threads.c:629
        self = 0x12b526e0
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 54 (Thread 0x7fba94a39700 (LWP 5398)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b59a30)
    at src/main/threads.c:629
        self = 0x12b59a30
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 53 (Thread 0x7fba94238700 (LWP 5399)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b67dc0)
    at src/main/threads.c:629
        self = 0x12b67dc0
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 52 (Thread 0x7fba93a37700 (LWP 5400)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b68210)
    at src/main/threads.c:629
        self = 0x12b68210
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 51 (Thread 0x7fba93236700 (LWP 5401)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b6dfe0)
    at src/main/threads.c:629
        self = 0x12b6dfe0
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 50 (Thread 0x7fba92a35700 (LWP 5402)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b6f900)
    at src/main/threads.c:629
        self = 0x12b6f900
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 49 (Thread 0x7fba92234700 (LWP 5403)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b70300)
    at src/main/threads.c:629
        self = 0x12b70300
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 48 (Thread 0x7fba91a33700 (LWP 5404)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b72720)
    at src/main/threads.c:629
        self = 0x12b72720
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 47 (Thread 0x7fba91232700 (LWP 5405)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b73270)
    at src/main/threads.c:629
        self = 0x12b73270
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 46 (Thread 0x7fba90a31700 (LWP 5406)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b76480)
    at src/main/threads.c:629
        self = 0x12b76480
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 45 (Thread 0x7fba90230700 (LWP 5407)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b78400)
    at src/main/threads.c:629
        self = 0x12b78400
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 44 (Thread 0x7fba8fa2f700 (LWP 5408)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b79a40)
    at src/main/threads.c:629
        self = 0x12b79a40
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 43 (Thread 0x7fba8f22e700 (LWP 5409)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b7b890)
    at src/main/threads.c:629
        self = 0x12b7b890
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 42 (Thread 0x7fba8ea2d700 (LWP 5410)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b7ec90)
    at src/main/threads.c:629
        self = 0x12b7ec90
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 41 (Thread 0x7fba8e22c700 (LWP 5411)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b84970)
    at src/main/threads.c:629
        self = 0x12b84970
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 40 (Thread 0x7fba8da2b700 (LWP 5412)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b8c290)
    at src/main/threads.c:629
        self = 0x12b8c290
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 39 (Thread 0x7fba8d22a700 (LWP 5413)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b8c6e0)
    at src/main/threads.c:629
        self = 0x12b8c6e0
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 38 (Thread 0x7fba8ca29700 (LWP 5414)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b92220)
    at src/main/threads.c:629
        self = 0x12b92220
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 37 (Thread 0x7fba8c228700 (LWP 5415)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b92d70)
    at src/main/threads.c:629
        self = 0x12b92d70
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 36 (Thread 0x7fba8ba27700 (LWP 5416)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b99c00)
    at src/main/threads.c:629
        self = 0x12b99c00
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 35 (Thread 0x7fba8b226700 (LWP 5417)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b9ca40)
    at src/main/threads.c:629
        self = 0x12b9ca40
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 34 (Thread 0x7fba8aa25700 (LWP 5418)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12ba1280)
    at src/main/threads.c:629
        self = 0x12ba1280
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 33 (Thread 0x7fba8a224700 (LWP 5419)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12ba5550)
    at src/main/threads.c:629
        self = 0x12ba5550
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 32 (Thread 0x7fba89a23700 (LWP 5420)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12ba9310)
    at src/main/threads.c:629
        self = 0x12ba9310
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 31 (Thread 0x7fba89222700 (LWP 5421)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12bae680)
    at src/main/threads.c:629
        self = 0x12bae680
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 30 (Thread 0x7fba88a21700 (LWP 5422)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12bb0a20)
    at src/main/threads.c:629
        self = 0x12bb0a20
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 29 (Thread 0x7fba88220700 (LWP 5423)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12bb1de0)
    at src/main/threads.c:629
        self = 0x12bb1de0
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 28 (Thread 0x7fba87a1f700 (LWP 5424)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12bb5600)
    at src/main/threads.c:629
        self = 0x12bb5600
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 27 (Thread 0x7fba8721e700 (LWP 5425)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12bb7210)
    at src/main/threads.c:629
        self = 0x12bb7210
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 26 (Thread 0x7fba86a1d700 (LWP 5426)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12bba0c0)
    at src/main/threads.c:629
        self = 0x12bba0c0
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 25 (Thread 0x7fba8621c700 (LWP 5427)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12bbac10)
    at src/main/threads.c:629
        self = 0x12bbac10
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 24 (Thread 0x7fba85a1b700 (LWP 5428)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12af4790)
    at src/main/threads.c:629
        self = 0x12af4790
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 23 (Thread 0x7fba8521a700 (LWP 5429)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b40a00)
    at src/main/threads.c:629
        self = 0x12b40a00
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 22 (Thread 0x7fba84a19700 (LWP 5430)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b52b20)
    at src/main/threads.c:629
        self = 0x12b52b20
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 21 (Thread 0x7fba84218700 (LWP 5431)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b58c40)
    at src/main/threads.c:629
        self = 0x12b58c40
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 20 (Thread 0x7fba83a17700 (LWP 5432)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b60c90)
    at src/main/threads.c:629
        self = 0x12b60c90
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 19 (Thread 0x7fba83216700 (LWP 5433)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b68650)
    at src/main/threads.c:629
        self = 0x12b68650
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 18 (Thread 0x7fba82a15700 (LWP 5434)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b6c0e0)
    at src/main/threads.c:629
        self = 0x12b6c0e0
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 17 (Thread 0x7fba82214700 (LWP 5435)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b755c0)
    at src/main/threads.c:629
        self = 0x12b755c0
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 16 (Thread 0x7fba81a13700 (LWP 5436)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b76e80)
    at src/main/threads.c:629
        self = 0x12b76e80
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 15 (Thread 0x7fba81212700 (LWP 5437)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b7a480)
    at src/main/threads.c:629
        self = 0x12b7a480
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 14 (Thread 0x7fba80a11700 (LWP 5438)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b7f850)
    at src/main/threads.c:629
        self = 0x12b7f850
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 13 (Thread 0x7fba80210700 (LWP 5439)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b82b10)
    at src/main/threads.c:629
        self = 0x12b82b10
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 12 (Thread 0x7fba7fa0f700 (LWP 5440)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b88670)
    at src/main/threads.c:629
        self = 0x12b88670
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 11 (Thread 0x7fba7f20e700 (LWP 5441)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b8cb20)
    at src/main/threads.c:629
        self = 0x12b8cb20
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 10 (Thread 0x7fba7ea0d700 (LWP 5442)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b946e0)
    at src/main/threads.c:629
        self = 0x12b946e0
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 9 (Thread 0x7fba7e20c700 (LWP 5443)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b95910)
    at src/main/threads.c:629
        self = 0x12b95910
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 8 (Thread 0x7fba7da0b700 (LWP 5444)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b968c0)
    at src/main/threads.c:629
        self = 0x12b968c0
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 7 (Thread 0x7fba7d20a700 (LWP 5445)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b987f0)
    at src/main/threads.c:629
        self = 0x12b987f0
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 6 (Thread 0x7fba7ca09700 (LWP 5446)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b9d600)
    at src/main/threads.c:629
        self = 0x12b9d600
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 5 (Thread 0x7fba7c208700 (LWP 5447)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12b9fc90)
    at src/main/threads.c:629
        self = 0x12b9fc90
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 4 (Thread 0x7fba7ba07700 (LWP 5448)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12ba67e0)
    at src/main/threads.c:629
        self = 0x12ba67e0
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 3 (Thread 0x7fba7b206700 (LWP 5449)):
#0  0x00007fbaa296979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fbaa296982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fbaa29698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x12ba98c0)
    at src/main/threads.c:629
        self = 0x12ba98c0
#4  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 2 (Thread 0x7fba7aa05700 (LWP 5450)):
#0  0x00007fbaa242266d in nanosleep () from /lib64/libc.so.6
No symbol table info available.
#1  0x00007fbaa24532c4 in usleep () from /lib64/libc.so.6
No symbol table info available.
#2  0x000000000044e85b in detail_handler_thread (arg=0x12bd73b0)
    at src/main/detail.c:1079
        packet = 0x0
        c = 0 '\000'
        this = 0x12bd73b0
        data = 0x12bd7500
#3  0x00007fbaa2963dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#4  0x00007fbaa245b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 1 (Thread 0x7fbaa471c840 (LWP 5321)):
#0  0x00007fbaa24222c9 in waitpid () from /lib64/libc.so.6
No symbol table info available.
#1  0x00007fbaa23a5c72 in do_system () from /lib64/libc.so.6
No symbol table info available.
#2  0x00007fbaa23a6021 in system () from /lib64/libc.so.6
No symbol table info available.
#3  0x00007fbaa4099578 in fr_fault (sig=11) at src/lib/debug.c:725
        disable = true
        cmd = "gdb -silent -x /etc/raddb/panic.gdb /usr/sbin/radiusd 5321 2>&1 | tee /var/log/radius/gdb-radiusd-5321.log", '\000' <repeats 425 times>
        out = 0x7fff72811446 ".log"
        left = 430
        ret = 44
        p = 0x7fbaa42d54a2 <panic_action+98> ".log"
        q = 0x0
        code = 0
#4  <signal handler called>
No symbol table info available.
#5  0x00007fbaa23e0208 in _int_free () from /lib64/libc.so.6
No symbol table info available.
#6  0x00007fbaa361f0c4 in _talloc_free_internal () from /lib64/libtalloc.so.2
No symbol table info available.
#7  0x00007fbaa361f01b in _talloc_free_internal () from /lib64/libtalloc.so.2
No symbol table info available.
#8  0x00007fbaa361f01b in _talloc_free_internal () from /lib64/libtalloc.so.2
No symbol table info available.
#9  0x00007fbaa361f01b in _talloc_free_internal () from /lib64/libtalloc.so.2
No symbol table info available.
#10 0x00007fbaa3618b63 in _talloc_free () from /lib64/libtalloc.so.2
No symbol table info available.
#11 0x000000000043b800 in request_free (request=0x9fc3560)
    at src/main/process.c:566
        ptr = 0x9fc3240
#12 0x000000000043bf94 in request_done (request=0x9fc3560, action=2)
    at src/main/process.c:814
        now = {tv_sec = 4621630028704, tv_usec = 4435457}
        when = {tv_sec = 245218208, tv_usec = 167523680}
#13 0x000000000043c935 in request_cleanup_delay (request=0x9fc3560, action=4)
    at src/main/process.c:1123
        when = {tv_sec = 1492761629, tv_usec = 124943}
        now = {tv_sec = 1492761629, tv_usec = 125048}
        __FUNCTION__ = "request_cleanup_delay"
#14 0x000000000043b70d in request_timer (ctx=0x9fc3560)
    at src/main/process.c:543
        request = 0x9fc3560
        action = 4
#15 0x00007fbaa40c0688 in fr_event_run (el=0xe8f7c0, when=0x7fff72812000)
    at src/lib/event.c:309
        callback = 0x43b6bd <request_timer>
        ctx = 0x9fc3560
        ev = 0x626de20
#16 0x00007fbaa40c0fa8 in fr_event_loop (el=0xe8f7c0) at src/lib/event.c:632
        i = 11
        rcode = 0
        when = {tv_sec = 1492761629, tv_usec = 125048}
        wake = 0x7fff72812000
        maxfd = 339
        read_fds = {fds_bits = {0 <repeats 16 times>}}
        master_fds = {fds_bits = {0, 0, 0, 0, 0, 933792, 0, 0, 0, 0, 0, 0, 0, 
            0, 0, 0}}
#17 0x0000000000446d9d in radius_event_process () at src/main/process.c:5667
No locals.
#18 0x0000000000431203 in main (argc=2, argv=0x7fff728121d8)
    at src/main/radiusd.c:585
        rcode = 0
        status = 32767
        argval = -1
        spawn_flag = true
        display_version = false
        flag = 0
        from_child = {4, 5}
        p = 0x7fff72812f92 "/radiusd"
        state = 0x680be0 <global_state>
        autofree = 0xa34090
A debugging session is active.

    Inferior 1 [process 5321] will be detached.

Quit anyway? (y or n) [answered Y; input not from terminal]
arr2036 commented 7 years ago

I've seen this before. It'll be a double free somewhere, but it's impossible to track down unless you build both FreeRADIUS and talloc with debugging symbols.

alanbuxey commented 7 years ago

i think that can be done . I've now installed the libtallod-debuginfo package... anything else i need to do for FreeRADIUS (its built from source, enable-developer enabled...)

alan

On 22 April 2017 at 16:49, Arran Cudbard-Bell notifications@github.com wrote:

I've seen this before. It'll be a double free somewhere, but it's impossible to track down unless you build both FreeRADIUS and talloc with debugging symbols.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/FreeRADIUS/freeradius-server/issues/1967#issuecomment-296382174, or mute the thread https://github.com/notifications/unsubscribe-auth/ACE-VWLk1EWAYb6uYhLuVELXPLo-NzdTks5ryiGhgaJpZM4NFH2s .

arr2036 commented 7 years ago

Nope, that's fine, should be enough.

alanbuxey commented 7 years ago

okay...with the debugging info:

CAUGHT SIGNAL: Segmentation fault
Backtrace of last 18 frames:
/usr/lib/libfreeradius-radius.so(fr_fault+0x114)[0x7f3565c993bc]
/lib64/libpthread.so.0(+0xf370)[0x7f356456b370]
/lib64/libc.so.6(+0x7c208)[0x7f3563fe0208]
/lib64/libtalloc.so.2(+0xa0c4)[0x7f356521f0c4]
/lib64/libtalloc.so.2(+0xa01b)[0x7f356521f01b]
/lib64/libtalloc.so.2(+0xa01b)[0x7f356521f01b]
/lib64/libtalloc.so.2(+0xa01b)[0x7f356521f01b]
/lib64/libtalloc.so.2(_talloc_free+0x123)[0x7f3565218b63]
/usr/sbin/radiusd[0x43b800]
/usr/sbin/radiusd[0x43bf94]
/usr/sbin/radiusd[0x43c935]
/usr/sbin/radiusd[0x43b70d]
/usr/lib/libfreeradius-radius.so(fr_event_run+0x144)[0x7f3565cc0688]
/usr/lib/libfreeradius-radius.so(fr_event_loop+0x4ed)[0x7f3565cc0fa8]
/usr/sbin/radiusd(radius_event_process+0x26)[0x446d9d]
/usr/sbin/radiusd(main+0xc81)[0x431203]
/lib64/libc.so.6(__libc_start_main+0xf5)[0x7f3563f85b35]
/usr/sbin/radiusd[0x40eb89]
Calling: gdb -silent -x /etc/raddb/panic.gdb /usr/sbin/radiusd 30248 2>&1 | tee /var/log/radius/gdb-radiusd-30248.log
Temporarily setting PR_DUMPABLE to 1
Resetting PR_DUMPABLE to 0
Panic action exited with 0
_EXIT(0) CALLED src/lib/debug.c[743]

and the gdb

cat /var/log/radius/gdb-radiusd-30248.log
Reading symbols from /usr/sbin/radiusd...done.
Attaching to program: /usr/sbin/radiusd, process 30248
Reading symbols from /usr/lib/libfreeradius-server.so...done.
Loaded symbols for /usr/lib/libfreeradius-server.so
Reading symbols from /usr/lib/libfreeradius-radius.so...done.
Loaded symbols for /usr/lib/libfreeradius-radius.so
Reading symbols from /usr/lib/libfreeradius-eap.so...done.
Loaded symbols for /usr/lib/libfreeradius-eap.so
Reading symbols from /lib64/libcrypto.so.10...Reading symbols from /lib64/libcrypto.so.10...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libcrypto.so.10
Reading symbols from /lib64/libssl.so.10...Reading symbols from /lib64/libssl.so.10...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libssl.so.10
Reading symbols from /lib64/libtalloc.so.2...Reading symbols from /usr/lib/debug/usr/lib64/libtalloc.so.2.1.6.debug...done.
done.
Loaded symbols for /lib64/libtalloc.so.2
Reading symbols from /lib64/libpcre.so.1...Reading symbols from /lib64/libpcre.so.1...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libpcre.so.1
Reading symbols from /lib64/libcap.so.2...Reading symbols from /lib64/libcap.so.2...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libcap.so.2
Reading symbols from /lib64/libnsl.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib64/libnsl.so.1
Reading symbols from /lib64/libresolv.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/libresolv.so.2
Reading symbols from /lib64/libdl.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/libdl.so.2
Reading symbols from /lib64/libpthread.so.0...(no debugging symbols found)...done.
[New LWP 30380]
[New LWP 30378]
[New LWP 30377]
[New LWP 30376]
[New LWP 30375]
[New LWP 30374]
[New LWP 30373]
[New LWP 30372]
[New LWP 30371]
[New LWP 30370]
[New LWP 30369]
[New LWP 30368]
[New LWP 30367]
[New LWP 30366]
[New LWP 30365]
[New LWP 30364]
[New LWP 30363]
[New LWP 30362]
[New LWP 30361]
[New LWP 30360]
[New LWP 30359]
[New LWP 30358]
[New LWP 30357]
[New LWP 30356]
[New LWP 30355]
[New LWP 30354]
[New LWP 30353]
[New LWP 30352]
[New LWP 30351]
[New LWP 30350]
[New LWP 30349]
[New LWP 30348]
[New LWP 30347]
[New LWP 30346]
[New LWP 30345]
[New LWP 30344]
[New LWP 30343]
[New LWP 30342]
[New LWP 30341]
[New LWP 30340]
[New LWP 30339]
[New LWP 30338]
[New LWP 30337]
[New LWP 30336]
[New LWP 30335]
[New LWP 30334]
[New LWP 30333]
[New LWP 30332]
[New LWP 30331]
[New LWP 30330]
[New LWP 30329]
[New LWP 30328]
[New LWP 30327]
[New LWP 30326]
[New LWP 30325]
[New LWP 30324]
[New LWP 30323]
[New LWP 30322]
[New LWP 30321]
[New LWP 30320]
[New LWP 30319]
[New LWP 30318]
[New LWP 30317]
[New LWP 30316]
[New LWP 30315]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib64/libthread_db.so.1".
Loaded symbols for /lib64/libpthread.so.0
Reading symbols from /lib64/libcrypt.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib64/libcrypt.so.1
Reading symbols from /lib64/libc.so.6...(no debugging symbols found)...done.
Loaded symbols for /lib64/libc.so.6
Reading symbols from /lib64/libpcap.so.1...Reading symbols from /lib64/libpcap.so.1...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libpcap.so.1
Reading symbols from /lib64/ld-linux-x86-64.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/ld-linux-x86-64.so.2
Reading symbols from /lib64/libz.so.1...Reading symbols from /lib64/libz.so.1...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libz.so.1
Reading symbols from /lib64/libgssapi_krb5.so.2...Reading symbols from /lib64/libgssapi_krb5.so.2...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libgssapi_krb5.so.2
Reading symbols from /lib64/libkrb5.so.3...Reading symbols from /lib64/libkrb5.so.3...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libkrb5.so.3
Reading symbols from /lib64/libcom_err.so.2...Reading symbols from /lib64/libcom_err.so.2...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libcom_err.so.2
Reading symbols from /lib64/libk5crypto.so.3...Reading symbols from /lib64/libk5crypto.so.3...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libk5crypto.so.3
Reading symbols from /lib64/libattr.so.1...Reading symbols from /lib64/libattr.so.1...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libattr.so.1
Reading symbols from /lib64/libfreebl3.so...Reading symbols from /lib64/libfreebl3.so...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libfreebl3.so
Reading symbols from /lib64/libkrb5support.so.0...Reading symbols from /lib64/libkrb5support.so.0...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libkrb5support.so.0
Reading symbols from /lib64/libkeyutils.so.1...Reading symbols from /lib64/libkeyutils.so.1...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libkeyutils.so.1
Reading symbols from /lib64/libselinux.so.1...Reading symbols from /lib64/libselinux.so.1...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libselinux.so.1
Reading symbols from /lib64/libnss_files.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/libnss_files.so.2
Reading symbols from /lib64/libgcc_s.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib64/libgcc_s.so.1
Reading symbols from /usr/lib/rlm_utf8.so...done.
Loaded symbols for /usr/lib/rlm_utf8.so
Reading symbols from /usr/lib/rlm_unpack.so...done.
Loaded symbols for /usr/lib/rlm_unpack.so
Reading symbols from /usr/lib/rlm_ldap.so...done.
Loaded symbols for /usr/lib/rlm_ldap.so
Reading symbols from /usr/local/lib/libldap-2.4.so.2...done.
Loaded symbols for /usr/local/lib/libldap-2.4.so.2
Reading symbols from /usr/local/lib/liblber-2.4.so.2...done.
Loaded symbols for /usr/local/lib/liblber-2.4.so.2
Reading symbols from /lib64/libsasl2.so.3...Reading symbols from /lib64/libsasl2.so.3...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libsasl2.so.3
Reading symbols from /usr/lib/rlm_radutmp.so...done.
Loaded symbols for /usr/lib/rlm_radutmp.so
Reading symbols from /usr/lib/rlm_sql.so...done.
Loaded symbols for /usr/lib/rlm_sql.so
Reading symbols from /usr/lib/rlm_sql_postgresql.so...done.
Loaded symbols for /usr/lib/rlm_sql_postgresql.so
Reading symbols from /lib64/libpq.so.5...Reading symbols from /lib64/libpq.so.5...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libpq.so.5
Reading symbols from /usr/local/lib/libldap_r-2.4.so.2...done.
Loaded symbols for /usr/local/lib/libldap_r-2.4.so.2
Reading symbols from /usr/lib/rlm_soh.so...done.
Loaded symbols for /usr/lib/rlm_soh.so
Reading symbols from /usr/lib/rlm_replicate.so...done.
Loaded symbols for /usr/lib/rlm_replicate.so
Reading symbols from /usr/lib/rlm_realm.so...done.
Loaded symbols for /usr/lib/rlm_realm.so
Reading symbols from /usr/lib/rlm_preprocess.so...done.
Loaded symbols for /usr/lib/rlm_preprocess.so
Reading symbols from /usr/lib/rlm_passwd.so...done.
Loaded symbols for /usr/lib/rlm_passwd.so
Reading symbols from /usr/lib/rlm_pap.so...done.
Loaded symbols for /usr/lib/rlm_pap.so
Reading symbols from /usr/lib/rlm_exec.so...done.
Loaded symbols for /usr/lib/rlm_exec.so
Reading symbols from /usr/lib/rlm_mschap.so...done.
Loaded symbols for /usr/lib/rlm_mschap.so
Reading symbols from /lib64/libwbclient.so.0...Missing separate debuginfo for /lib64/libwbclient.so.0
Try: yum --enablerepo='*debug*' install /usr/lib/debug/.build-id/99/0861876f9c3654a17e71d271e832f4b42382cd.debug
Reading symbols from /lib64/libwbclient.so.0...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /lib64/libwbclient.so.0
Reading symbols from /usr/lib64/samba/libwinbind-client-samba4.so...Reading symbols from /usr/lib64/samba/libwinbind-client-samba4.so...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /usr/lib64/samba/libwinbind-client-samba4.so
Reading symbols from /usr/lib64/samba/libreplace-samba4.so...Reading symbols from /usr/lib64/samba/libreplace-samba4.so...(no debugging symbols found)...done.
(no debugging symbols found)...done.
Loaded symbols for /usr/lib64/samba/libreplace-samba4.so
Reading symbols from /usr/lib/rlm_logintime.so...done.
Loaded symbols for /usr/lib/rlm_logintime.so
Reading symbols from /usr/lib/rlm_linelog.so...done.
Loaded symbols for /usr/lib/rlm_linelog.so
Reading symbols from /usr/lib/rlm_krb5.so...done.
Loaded symbols for /usr/lib/rlm_krb5.so
Reading symbols from /usr/lib/rlm_eap.so...done.
Loaded symbols for /usr/lib/rlm_eap.so
Reading symbols from /usr/lib/rlm_files.so...done.
Loaded symbols for /usr/lib/rlm_files.so
Reading symbols from /usr/lib/rlm_expr.so...done.
Loaded symbols for /usr/lib/rlm_expr.so
Reading symbols from /usr/lib/rlm_expiration.so...done.
Loaded symbols for /usr/lib/rlm_expiration.so
Reading symbols from /usr/lib/rlm_dynamic_clients.so...done.
Loaded symbols for /usr/lib/rlm_dynamic_clients.so
Reading symbols from /usr/lib/rlm_digest.so...done.
Loaded symbols for /usr/lib/rlm_digest.so
Reading symbols from /usr/lib/rlm_dhcp.so...done.
Loaded symbols for /usr/lib/rlm_dhcp.so
Reading symbols from /usr/lib/libfreeradius-dhcp.so...done.
Loaded symbols for /usr/lib/libfreeradius-dhcp.so
Reading symbols from /usr/lib/rlm_detail.so...done.
Loaded symbols for /usr/lib/rlm_detail.so
Reading symbols from /usr/lib/rlm_chap.so...done.
Loaded symbols for /usr/lib/rlm_chap.so
Reading symbols from /usr/lib/rlm_cache.so...done.
Loaded symbols for /usr/lib/rlm_cache.so
Reading symbols from /usr/lib/rlm_attr_filter.so...done.
Loaded symbols for /usr/lib/rlm_attr_filter.so
Reading symbols from /usr/lib/rlm_always.so...done.
Loaded symbols for /usr/lib/rlm_always.so
Reading symbols from /lib64/libnss_dns.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib64/libnss_dns.so.2
Reading symbols from /usr/lib/rlm_eap_tls.so...done.
Loaded symbols for /usr/lib/rlm_eap_tls.so
Reading symbols from /usr/lib/rlm_eap_ttls.so...done.
Loaded symbols for /usr/lib/rlm_eap_ttls.so
Reading symbols from /usr/lib/rlm_eap_peap.so...done.
Loaded symbols for /usr/lib/rlm_eap_peap.so
Reading symbols from /usr/lib/rlm_eap_mschapv2.so...done.
Loaded symbols for /usr/lib/rlm_eap_mschapv2.so
Reading symbols from /usr/lib/rlm_cache_rbtree.so...done.
Loaded symbols for /usr/lib/rlm_cache_rbtree.so
0x00007f35640222c9 in waitpid () from /lib64/libc.so.6
No symbol table info available.
No symbol table info available.

Thread 66 (Thread 0x7f355c645700 (LWP 30315)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x1344e6f0)
    at src/main/threads.c:629
        self = 0x1344e6f0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 65 (Thread 0x7f355be44700 (LWP 30316)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134501a0)
    at src/main/threads.c:629
        self = 0x134501a0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 64 (Thread 0x7f355b643700 (LWP 30317)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x13481130)
    at src/main/threads.c:629
        self = 0x13481130
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 63 (Thread 0x7f355ae42700 (LWP 30318)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x13482be0)
    at src/main/threads.c:629
        self = 0x13482be0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 62 (Thread 0x7f355a641700 (LWP 30319)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134a1fc0)
    at src/main/threads.c:629
        self = 0x134a1fc0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 61 (Thread 0x7f3559e40700 (LWP 30320)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134b2950)
    at src/main/threads.c:629
        self = 0x134b2950
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 60 (Thread 0x7f355963f700 (LWP 30321)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134b2ff0)
    at src/main/threads.c:629
        self = 0x134b2ff0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 59 (Thread 0x7f3558e3e700 (LWP 30322)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134b85d0)
    at src/main/threads.c:629
        self = 0x134b85d0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 58 (Thread 0x7f355863d700 (LWP 30323)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134ba080)
    at src/main/threads.c:629
        self = 0x134ba080
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 57 (Thread 0x7f3557e3c700 (LWP 30324)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134c2ff0)
    at src/main/threads.c:629
        self = 0x134c2ff0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 56 (Thread 0x7f355763b700 (LWP 30325)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134c3440)
    at src/main/threads.c:629
        self = 0x134c3440
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 55 (Thread 0x7f3556e3a700 (LWP 30326)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134ca790)
    at src/main/threads.c:629
        self = 0x134ca790
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 54 (Thread 0x7f3556639700 (LWP 30327)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134d8b20)
    at src/main/threads.c:629
        self = 0x134d8b20
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 53 (Thread 0x7f3555e38700 (LWP 30328)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134d8f70)
    at src/main/threads.c:629
        self = 0x134d8f70
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 52 (Thread 0x7f3555637700 (LWP 30329)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134ded40)
    at src/main/threads.c:629
        self = 0x134ded40
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 51 (Thread 0x7f3554e36700 (LWP 30330)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134e0660)
    at src/main/threads.c:629
        self = 0x134e0660
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 50 (Thread 0x7f3554635700 (LWP 30331)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134e1060)
    at src/main/threads.c:629
        self = 0x134e1060
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 49 (Thread 0x7f3553e34700 (LWP 30332)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134e3480)
    at src/main/threads.c:629
        self = 0x134e3480
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 48 (Thread 0x7f3553633700 (LWP 30333)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134e3fd0)
    at src/main/threads.c:629
        self = 0x134e3fd0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 47 (Thread 0x7f3552e32700 (LWP 30334)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134e71e0)
    at src/main/threads.c:629
        self = 0x134e71e0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 46 (Thread 0x7f3552631700 (LWP 30335)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134e9160)
    at src/main/threads.c:629
        self = 0x134e9160
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 45 (Thread 0x7f3551e30700 (LWP 30336)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134ea7a0)
    at src/main/threads.c:629
        self = 0x134ea7a0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 44 (Thread 0x7f355162f700 (LWP 30337)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134ec5f0)
    at src/main/threads.c:629
        self = 0x134ec5f0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 43 (Thread 0x7f3550e2e700 (LWP 30338)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134ef9f0)
    at src/main/threads.c:629
        self = 0x134ef9f0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 42 (Thread 0x7f355062d700 (LWP 30339)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134f56d0)
    at src/main/threads.c:629
        self = 0x134f56d0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 41 (Thread 0x7f354fe2c700 (LWP 30340)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134fcff0)
    at src/main/threads.c:629
        self = 0x134fcff0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 40 (Thread 0x7f354f62b700 (LWP 30341)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134fd440)
    at src/main/threads.c:629
        self = 0x134fd440
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 39 (Thread 0x7f354ee2a700 (LWP 30342)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x13502f80)
    at src/main/threads.c:629
        self = 0x13502f80
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 38 (Thread 0x7f354e629700 (LWP 30343)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x13503ad0)
    at src/main/threads.c:629
        self = 0x13503ad0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 37 (Thread 0x7f354de28700 (LWP 30344)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x1350a960)
    at src/main/threads.c:629
        self = 0x1350a960
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 36 (Thread 0x7f354d627700 (LWP 30345)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x1350d7a0)
    at src/main/threads.c:629
        self = 0x1350d7a0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 35 (Thread 0x7f354ce26700 (LWP 30346)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x13511fe0)
    at src/main/threads.c:629
        self = 0x13511fe0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 34 (Thread 0x7f354c625700 (LWP 30347)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x135165d0)
    at src/main/threads.c:629
        self = 0x135165d0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 33 (Thread 0x7f354be24700 (LWP 30348)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x1351a390)
    at src/main/threads.c:629
        self = 0x1351a390
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 32 (Thread 0x7f354b623700 (LWP 30349)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x1351f700)
    at src/main/threads.c:629
        self = 0x1351f700
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 31 (Thread 0x7f354ae22700 (LWP 30350)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x13521aa0)
    at src/main/threads.c:629
        self = 0x13521aa0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 30 (Thread 0x7f354a621700 (LWP 30351)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x13522e60)
    at src/main/threads.c:629
        self = 0x13522e60
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 29 (Thread 0x7f3549e20700 (LWP 30352)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x13526680)
    at src/main/threads.c:629
        self = 0x13526680
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 28 (Thread 0x7f354961f700 (LWP 30353)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x13528290)
    at src/main/threads.c:629
        self = 0x13528290
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 27 (Thread 0x7f3548e1e700 (LWP 30354)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x1352b140)
    at src/main/threads.c:629
        self = 0x1352b140
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 26 (Thread 0x7f354861d700 (LWP 30355)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x1352bc90)
    at src/main/threads.c:629
        self = 0x1352bc90
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 25 (Thread 0x7f3547e1c700 (LWP 30356)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x13465270)
    at src/main/threads.c:629
        self = 0x13465270
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 24 (Thread 0x7f354761b700 (LWP 30357)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134b1760)
    at src/main/threads.c:629
        self = 0x134b1760
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 23 (Thread 0x7f3546e1a700 (LWP 30358)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134c3880)
    at src/main/threads.c:629
        self = 0x134c3880
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 22 (Thread 0x7f3546619700 (LWP 30359)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134c99a0)
    at src/main/threads.c:629
        self = 0x134c99a0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 21 (Thread 0x7f3545e18700 (LWP 30360)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134d19f0)
    at src/main/threads.c:629
        self = 0x134d19f0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 20 (Thread 0x7f3545617700 (LWP 30361)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134d93b0)
    at src/main/threads.c:629
        self = 0x134d93b0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 19 (Thread 0x7f3544e16700 (LWP 30362)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134dce40)
    at src/main/threads.c:629
        self = 0x134dce40
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 18 (Thread 0x7f3544615700 (LWP 30363)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134e6320)
    at src/main/threads.c:629
        self = 0x134e6320
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 17 (Thread 0x7f3543e14700 (LWP 30364)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134e7be0)
    at src/main/threads.c:629
        self = 0x134e7be0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 16 (Thread 0x7f3543613700 (LWP 30365)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134eb1e0)
    at src/main/threads.c:629
        self = 0x134eb1e0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 15 (Thread 0x7f3542e12700 (LWP 30366)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134f05b0)
    at src/main/threads.c:629
        self = 0x134f05b0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 14 (Thread 0x7f3542611700 (LWP 30367)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134f3870)
    at src/main/threads.c:629
        self = 0x134f3870
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 13 (Thread 0x7f3541e10700 (LWP 30368)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134f93d0)
    at src/main/threads.c:629
        self = 0x134f93d0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 12 (Thread 0x7f354160f700 (LWP 30369)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x134fd880)
    at src/main/threads.c:629
        self = 0x134fd880
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 11 (Thread 0x7f3540e0e700 (LWP 30370)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x13505440)
    at src/main/threads.c:629
        self = 0x13505440
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 10 (Thread 0x7f354060d700 (LWP 30371)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x13506670)
    at src/main/threads.c:629
        self = 0x13506670
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 9 (Thread 0x7f353fe0c700 (LWP 30372)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x13507620)
    at src/main/threads.c:629
        self = 0x13507620
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 8 (Thread 0x7f353f60b700 (LWP 30373)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x13509550)
    at src/main/threads.c:629
        self = 0x13509550
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 7 (Thread 0x7f353ee0a700 (LWP 30374)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x1350e360)
    at src/main/threads.c:629
        self = 0x1350e360
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 6 (Thread 0x7f353e609700 (LWP 30375)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x135109f0)
    at src/main/threads.c:629
        self = 0x135109f0
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 5 (Thread 0x7f353de08700 (LWP 30376)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x13517860)
    at src/main/threads.c:629
        self = 0x13517860
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 4 (Thread 0x7f353d607700 (LWP 30377)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x1351a940)
    at src/main/threads.c:629
        self = 0x1351a940
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 3 (Thread 0x7f353ce06700 (LWP 30378)):
#0  0x00007f356456979b in do_futex_wait.constprop.1 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007f356456982f in __new_sem_wait_slow.constprop.0 ()
   from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007f35645698cb in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x0000000000439290 in request_handler_thread (arg=0x1351ad90)
    at src/main/threads.c:629
        self = 0x1351ad90
#4  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#5  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 2 (Thread 0x7f353c605700 (LWP 30380)):
#0  0x00007f356402266d in nanosleep () from /lib64/libc.so.6
No symbol table info available.
#1  0x00007f35640532c4 in usleep () from /lib64/libc.so.6
No symbol table info available.
#2  0x000000000044e85b in detail_handler_thread (arg=0x13547c20)
    at src/main/detail.c:1079
        packet = 0x0
        c = 0 '\000'
        this = 0x13547c20
        data = 0x13547d70
#3  0x00007f3564563dc5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#4  0x00007f356405b73d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 1 (Thread 0x7f356631c840 (LWP 30248)):
#0  0x00007f35640222c9 in waitpid () from /lib64/libc.so.6
No symbol table info available.
#1  0x00007f3563fa5c72 in do_system () from /lib64/libc.so.6
No symbol table info available.
#2  0x00007f3563fa6021 in system () from /lib64/libc.so.6
No symbol table info available.
#3  0x00007f3565c99578 in fr_fault (sig=11) at src/lib/debug.c:725
        disable = true
        cmd = "gdb -silent -x /etc/raddb/panic.gdb /usr/sbin/radiusd 30248 2>&1 | tee /var/log/radius/gdb-radiusd-30248.log", '\000' <repeats 423 times>
        out = 0x7ffc8d576108 ".log"
        left = 428
        ret = 45
        p = 0x7f3565ed54a2 <panic_action+98> ".log"
        q = 0x0
        code = 0
#4  <signal handler called>
No symbol table info available.
#5  0x00007f3563fe0208 in _int_free () from /lib64/libc.so.6
No symbol table info available.
#6  0x00007f356521f0c4 in _talloc_free_internal (ptr=<optimized out>, 
    location=0x46aed6 "src/main/process.c:566") at ../talloc.c:1116
        ptr_to_free = <optimized out>
#7  0x00007f356521f01b in _talloc_free_children_internal (
    location=0x46aed6 "src/main/process.c:566", ptr=0x7f34a8002860, 
    tc=0x7f34a8002800) at ../talloc.c:1525
        child = 0x7f34a8002920
        new_parent = 0x0
#8  _talloc_free_internal (ptr=0x7f34a8002860, 
    location=0x46aed6 "src/main/process.c:566") at ../talloc.c:1072
        ptr_to_free = <optimized out>
#9  0x00007f356521f01b in _talloc_free_children_internal (
    location=0x46aed6 "src/main/process.c:566", ptr=0x12f90e30, tc=0x12f90dd0)
    at ../talloc.c:1525
        child = 0x7f34a8002860
        new_parent = 0x0
#10 _talloc_free_internal (ptr=0x12f90e30, 
    location=0x46aed6 "src/main/process.c:566") at ../talloc.c:1072
        ptr_to_free = <optimized out>
#11 0x00007f356521f01b in _talloc_free_children_internal (
    location=0x46aed6 "src/main/process.c:566", ptr=0x12f910f0, tc=0x12f91090)
    at ../talloc.c:1525
        child = 0x12f90e30
        new_parent = 0x0
#12 _talloc_free_internal (ptr=0x12f910f0, 
    location=0x46aed6 "src/main/process.c:566") at ../talloc.c:1072
        ptr_to_free = <optimized out>
#13 0x00007f3565218b63 in _talloc_free_children_internal (
    location=0x46aed6 "src/main/process.c:566", ptr=0x12f90dd0, tc=0x12f90d70)
    at ../talloc.c:1525
        child = 0x12f910f0
        new_parent = 0x0
#14 _talloc_free_internal (location=<optimized out>, ptr=<optimized out>)
    at ../talloc.c:1072
        ptr_to_free = <optimized out>
#15 _talloc_free (ptr=0x12f90dd0, location=0x46aed6 "src/main/process.c:566")
    at ../talloc.c:1647
No locals.
#16 0x000000000043b800 in request_free (request=0x12f910f0)
    at src/main/process.c:566
        ptr = 0x12f90dd0
#17 0x000000000043bf94 in request_done (request=0x12f910f0, action=2)
    at src/main/process.c:814
        now = {tv_sec = 4621557231520, tv_usec = 4435457}
        when = {tv_sec = 172421024, tv_usec = 318312688}
#18 0x000000000043c935 in request_cleanup_delay (request=0x12f910f0, action=4)
    at src/main/process.c:1123
        when = {tv_sec = 1492889274, tv_usec = 457163}
        now = {tv_sec = 1492889274, tv_usec = 457273}
        __FUNCTION__ = "request_cleanup_delay"
#19 0x000000000043b70d in request_timer (ctx=0x12f910f0)
    at src/main/process.c:543
        request = 0x12f910f0
        action = 4
#20 0x00007f3565cc0688 in fr_event_run (el=0x1800930, when=0x7ffc8d576cc0)
    at src/lib/event.c:309
        callback = 0x43b6bd <request_timer>
        ctx = 0x12f910f0
        ev = 0x12fc75b0
#21 0x00007f3565cc0fa8 in fr_event_loop (el=0x1800930) at src/lib/event.c:632
        i = 11
        rcode = 0
        when = {tv_sec = 1492889274, tv_usec = 457273}
        wake = 0x7ffc8d576cc0
        maxfd = 339
        read_fds = {fds_bits = {0 <repeats 16 times>}}
        master_fds = {fds_bits = {0, 0, 0, 0, 0, 933792, 0, 0, 0, 0, 0, 0, 0, 
            0, 0, 0}}
#22 0x0000000000446d9d in radius_event_process () at src/main/process.c:5667
No locals.
#23 0x0000000000431203 in main (argc=2, argv=0x7ffc8d576e98)
    at src/main/radiusd.c:585
        rcode = 0
        status = 32764
        argval = -1
        spawn_flag = true
        display_version = false
        flag = 0
        from_child = {4, 5}
        p = 0x7ffc8d577f92 "/radiusd"
        state = 0x680be0 <global_state>
        autofree = 0x13a2090
A debugging session is active.

    Inferior 1 [process 30248] will be detached.

Quit anyway? (y or n) [answered Y; input not from terminal]
alandekok commented 3 years ago

Closed via commit 2c294b2e280f.

It turns out that some versions of the pcre library were calling our callback function twice.