haproxy / haproxy

HAProxy Load Balancer's development branch (mirror of git.haproxy.org)
https://git.haproxy.org/
Other
4.8k stars 783 forks source link

100% CPU on futex #2645

Closed delthas closed 1 month ago

delthas commented 1 month ago

Detailed Description of the Problem

I'm running HAProxy on Alpine in a Docker container.

I'm running a simple configuration to do TLS to a backend. I'm load testing HAProxy by sending an increasing number of requests to HAProxy.

Everything works correctly, with HAProxy using a very small CPU load (increasing slowly), until at some point, suddenly, the CPU immediately goes to 100% (on all cores).

I ran a perf & flamegraph:

17e87630b

99% if the CPU time is spent in haproxy->musl->futex (then native_queued_spin_lock_slowpath in either futex_wait or futex_wait).

Running an strace shows indeed almost only futex calls, and lots of them (about 16k lines in strace per second). Here's an excerpt of my strace:

futex(0x7f94f9803fe0, FUTEX_WAIT_PRIVATE, 2147483676, NULL) = -1 EAGAIN (Resource temporarily unavailable)
futex(0x7f94f9803fe0, FUTEX_WAIT_PRIVATE, 2147483678, NULL) = -1 EAGAIN (Resource temporarily unavailable)
futex(0x7f94f9803fe0, FUTEX_WAIT_PRIVATE, 2147483688, NULL) = -1 EAGAIN (Resource temporarily unavailable)
futex(0x7f94f9803fe0, FUTEX_WAIT_PRIVATE, 2147483682, NULL) = -1 EAGAIN (Resource temporarily unavailable)
futex(0x7f94f9803fe0, FUTEX_WAIT_PRIVATE, 2147483676, NULL) = -1 EAGAIN (Resource temporarily unavailable)
futex(0x7f94f9803fe0, FUTEX_WAKE_PRIVATE, 1) = 0
futex(0x7f94f9803fe0, FUTEX_WAIT_PRIVATE, 2147483676, NULL) = -1 EAGAIN (Resource temporarily unavailable)
futex(0x7f94f9803fe0, FUTEX_WAIT_PRIVATE, 2147483676, NULL) = -1 EAGAIN (Resource temporarily unavailable)
futex(0x7f94f9803fe0, FUTEX_WAKE_PRIVATE, 1) = 0
futex(0x7f94f9803fe0, FUTEX_WAIT_PRIVATE, 2147483677, NULL) = -1 EAGAIN (Resource temporarily unavailable)
futex(0x7f94f9803fe0, FUTEX_WAKE_PRIVATE, 1) = 0
futex(0x7f94f9803fe0, FUTEX_WAIT_PRIVATE, 2147483680, NULL) = -1 EAGAIN (Resource temporarily unavailable)
futex(0x7f94f9803fe0, FUTEX_WAKE_PRIVATE, 1) = 0
futex(0x7f94f9803fe0, FUTEX_WAKE_PRIVATE, 1) = 0
futex(0x7f94f9803fe0, FUTEX_WAIT_PRIVATE, 2147483676, NULL) = -1 EAGAIN (Resource temporarily unavailable)
futex(0x7f94f9803fe0, FUTEX_WAKE_PRIVATE, 1) = 0
futex(0x7f94f9803fe0, FUTEX_WAKE_PRIVATE, 1) = 0
futex(0x7f94f9803fe0, FUTEX_WAKE_PRIVATE, 1) = 0
futex(0x7f94f9803fe0, FUTEX_WAKE_PRIVATE, 1) = 0
futex(0x7f94f9803fe0, FUTEX_WAKE_PRIVATE, 1) = 0
futex(0x7f94f9803fe0, FUTEX_WAKE_PRIVATE, 1) = 0
futex(0x7f94f9803fe0, FUTEX_WAKE_PRIVATE, 1) = 0
futex(0x7f94f9803fe0, FUTEX_WAKE_PRIVATE, 1) = 0
futex(0x7f94f9803fe0, FUTEX_WAKE_PRIVATE, 1) = 0
futex(0x7f94f9803fe0, FUTEX_WAIT_PRIVATE, 2147483680, NULL) = -1 EAGAIN (Resource temporarily unavailable)
futex(0x7f94f9803fe0, FUTEX_WAIT_PRIVATE, 2147483678, NULL) = -1 EAGAIN (Resource temporarily unavailable)
futex(0x7f94f9803fe0, FUTEX_WAKE_PRIVATE, 1) = 0
futex(0x7f94f9803fe0, FUTEX_WAKE_PRIVATE, 1) = 0
futex(0x7f94f9803fe0, FUTEX_WAIT_PRIVATE, 2147483676, NULL) = -1 EAGAIN (Resource temporarily unavailable)
futex(0x7f94f9803fe0, FUTEX_WAKE_PRIVATE, 1) = 0
futex(0x7f94f9803fe0, FUTEX_WAIT_PRIVATE, 2147483676, NULL) = -1 EAGAIN (Resource temporarily unavailable)
futex(0x7f94f9803fe0, FUTEX_WAKE_PRIVATE, 1) = 0
futex(0x7f94f9803fe0, FUTEX_WAIT_PRIVATE, 2147483674, NULL) = -1 EAGAIN (Resource temporarily unavailable)
futex(0x7f94f9803fe0, FUTEX_WAKE_PRIVATE, 1) = 0

I'm not sure how to debug this further, I'm having a lot of trouble getting a backtrace.

In the haproxy logs I'm only seeing:

00059bc2:tls-noverify.accept(0009)=2859 from [0.0.0.0:0] ALPN=<none>
00059bc3:tls-noverify.accept(0009)=063c from [0.0.0.0:0] ALPN=<none>
00031751:tls-noverify.clicls[ffff:03c9]
00031751:tls-noverify.closed[ffff:03c9]
0003175c:tls-noverify.clicls[ffff:ff87]
0003175c:tls-noverify.closed[ffff:ff87]
00059bc4:tls-noverify.accept(0009)=0412 from [0.0.0.0:0] ALPN=<none>
00059bc5:tls-noverify.accept(0009)=2481 from [0.0.0.0:0] ALPN=<none>
0003172d:tls-noverify.clicls[ffff:295e]
0003172d:tls-noverify.closed[ffff:295e]
0003172e:tls-noverify.clicls[ffff:2993]
0003172e:tls-noverify.closed[ffff:2993]
0003174b:tls-noverify.clicls[ffff:236d]
0003174b:tls-noverify.closed[ffff:236d]
0003177e:tls-noverify.clicls[ffff:2ab1]
0003177e:tls-noverify.closed[ffff:2ab1]
00059bc6:tls-noverify.accept(0009)=03b2 from [0.0.0.0:0] ALPN=<none>
00059bc7:tls-noverify.accept(0009)=236d from [0.0.0.0:0] ALPN=<none>
0003192e:tls-noverify.clicls[ffff:2865]
0003192e:tls-noverify.closed[ffff:2865]
00031973:tls-noverify.clicls[ffff:286d]
00031973:tls-noverify.closed[ffff:286d]
00059bc8:tls-noverify.accept(0009)=0439 from [0.0.0.0:0] ALPN=<none>
00031981:tls-noverify.clicls[ffff:29b2]
00031981:tls-noverify.closed[ffff:29b2]
00059bc9:tls-noverify.accept(0009)=069d from [0.0.0.0:0] ALPN=<none>
00031752:tls-noverify.clicls[ffff:2497]

Expected Behavior

I expected the CPU to increase slowly and now spent its entire time in futex.

Steps to Reproduce the Behavior

Run the configuration below, increase the load slightly over time.

Do you have any idea what may have caused this?

Looks like some lock contention issue?

Do you have an idea how to solve the issue?

No response

What is your configuration?

global
  stats socket ipv4@127.0.0.1:25566 level admin
  stats timeout 2m
listen tls-verify
  mode    tcp
  maxconn 65536
  bind    /var/cache-run/haproxy-tls-verify.sock accept-proxy mode 777
  stick-table type ip size 100
  stick   on dst
  server-template s 8 * ssl ca-file @system-ca alpn http/1.1 sni fc_pp_authority ssl-min-ver TLSv1.1 ciphers HIGH:!aNULL:!kRSA:!PSK:!SRP:!MD5:!RC4
listen tls-noverify
  mode    tcp
  maxconn 65536
  bind    /var/cache-run/haproxy-tls-noverify.sock accept-proxy mode 777
  stick-table type ip size 100
  stick   on dst
  server-template s 8 * ssl alpn http/1.1 verify none sni fc_pp_authority ssl-min-ver TLSv1.1 ciphers HIGH:!aNULL:!kRSA:!PSK:!SRP:!MD5:!RC4

Output of haproxy -vv

HAProxy version 2.8.1-a90123a 2023/07/03 - https://haproxy.org/
Status: long-term supported branch - will stop receiving fixes around Q2 2028.
Known bugs: http://www.haproxy.org/bugs/bugs-2.8.1.html
Running on: Linux 5.14.0-362.8.1.el9_3.x86_64 #1 SMP PREEMPT_DYNAMIC Tue Nov 7 14:54:22 EST 2023 x86_64
Build options :
  TARGET  = linux-musl
  CPU     = generic
  CC      = cc
  CFLAGS  = -O2 -g -Wall -Wextra -Wundef -Wdeclaration-after-statement -Wfatal-errors -Wtype-limits -Wshift-negative-value -Wshift-overflow=2 -Wduplicated-cond -Wnull-dereference -fwrapv -Wno-address-of-packed-member -Wno-unused-label -Wno-sign-compare -Wno-unused-parameter -Wno-clobbered -Wno-missing-field-initializers -Wno-cast-function-type -Wno-string-plus-int -Wno-atomic-alignment
  OPTIONS = USE_OPENSSL=1 USE_LUA=1 USE_ZLIB=1 USE_NS=1 USE_PROMEX=1 USE_PCRE2=1 USE_PCRE2_JIT=1
  DEBUG   = -DDEBUG_STRICT -DDEBUG_MEMORY_POOLS

Feature list : -51DEGREES +ACCEPT4 -BACKTRACE -CLOSEFROM +CPU_AFFINITY +CRYPT_H -DEVICEATLAS +DL -ENGINE +EPOLL -EVPORTS +GETADDRINFO -KQUEUE -LIBATOMIC +LIBCRYPT +LINUX_SPLICE +LINUX_TPROXY +LUA +MATH -MEMORY_PROFILING +NETFILTER +NS -OBSOLETE_LINKER +OPENSSL -OPENSSL_WOLFSSL -OT -PCRE +PCRE2 +PCRE2_JIT -PCRE_JIT +POLL +PRCTL -PROCCTL +PROMEX -PTHREAD_EMULATION -QUIC +RT +SHM_OPEN -SLZ +SSL -STATIC_PCRE -STATIC_PCRE2 -SYSTEMD +TFO +THREAD +THREAD_DUMP +TPROXY -WURFL +ZLIB

Default settings :
  bufsize = 16384, maxrewrite = 1024, maxpollevents = 200

Built with multi-threading support (MAX_TGROUPS=16, MAX_THREADS=256, default=64).
Built with OpenSSL version : OpenSSL 3.1.6 4 Jun 2024
Running on OpenSSL version : OpenSSL 3.1.1 30 May 2023
OpenSSL library supports TLS extensions : yes
OpenSSL library supports SNI : yes
OpenSSL library supports : TLSv1.0 TLSv1.1 TLSv1.2 TLSv1.3
OpenSSL providers loaded : default
Built with Lua version : Lua 5.4.6
Built with the Prometheus exporter as a service
Built with network namespace support.
Built with zlib version : 1.2.13
Running on zlib version : 1.2.13
Compression algorithms supported : identity("identity"), deflate("deflate"), raw-deflate("deflate"), gzip("gzip")
Built with transparent proxy support using: IP_TRANSPARENT IPV6_TRANSPARENT IP_FREEBIND
Built with PCRE2 version : 10.42 2022-12-11
PCRE2 library supports JIT : yes
Encrypted password support via crypt(3): yes
Built with gcc compiler version 12.2.1 20220924

Available polling systems :
      epoll : pref=300,  test result OK
       poll : pref=200,  test result OK
     select : pref=150,  test result OK
Total: 3 (3 usable), will use epoll.

Available multiplexer protocols :
(protocols marked as <default> cannot be specified using 'proto' keyword)
         h2 : mode=HTTP  side=FE|BE  mux=H2    flags=HTX|HOL_RISK|NO_UPG
       fcgi : mode=HTTP  side=BE     mux=FCGI  flags=HTX|HOL_RISK|NO_UPG
  <default> : mode=HTTP  side=FE|BE  mux=H1    flags=HTX
         h1 : mode=HTTP  side=FE|BE  mux=H1    flags=HTX|NO_UPG
  <default> : mode=TCP   side=FE|BE  mux=PASS  flags=
       none : mode=TCP   side=FE|BE  mux=PASS  flags=NO_UPG

Available services : prometheus-exporter
Available filters :
    [BWLIM] bwlim-in
    [BWLIM] bwlim-out
    [CACHE] cache
    [COMP] compression
    [FCGI] fcgi-app
    [SPOE] spoe
    [TRACE] trace

Last Outputs and Backtraces

No crash.

Additional Information

> show servers state
1
# be_id be_name srv_id srv_name srv_addr srv_op_state srv_admin_state srv_uweight srv_iweight srv_time_since_last_change srv_check_status srv_check_result srv_check_health srv_check_state srv_agent_state bk_f_forced_id srv_f_forced_id srv_fqdn srv_port srvrecord srv_use_ssl srv_check_port srv_check_addr srv_agent_addr srv_agent_port
2 tls-verify 1 s1 0.0.0.0 2 0 1 1 1067 1 0 2 0 0 0 0 - 0 - 1 0 - - 0
2 tls-verify 2 s2 0.0.0.0 2 0 1 1 1067 1 0 2 0 0 0 0 - 0 - 1 0 - - 0
2 tls-verify 3 s3 0.0.0.0 2 0 1 1 1067 1 0 2 0 0 0 0 - 0 - 1 0 - - 0
2 tls-verify 4 s4 0.0.0.0 2 0 1 1 1067 1 0 2 0 0 0 0 - 0 - 1 0 - - 0
2 tls-verify 5 s5 0.0.0.0 2 0 1 1 1067 1 0 2 0 0 0 0 - 0 - 1 0 - - 0
2 tls-verify 6 s6 0.0.0.0 2 0 1 1 1067 1 0 2 0 0 0 0 - 0 - 1 0 - - 0
2 tls-verify 7 s7 0.0.0.0 2 0 1 1 1067 1 0 2 0 0 0 0 - 0 - 1 0 - - 0
2 tls-verify 8 s8 0.0.0.0 2 0 1 1 1067 1 0 2 0 0 0 0 - 0 - 1 0 - - 0
3 tls-noverify 1 s1 0.0.0.0 2 0 1 1 1067 1 0 2 0 0 0 0 - 0 - 1 0 - - 0
3 tls-noverify 2 s2 0.0.0.0 2 0 1 1 1067 1 0 2 0 0 0 0 - 0 - 1 0 - - 0
3 tls-noverify 3 s3 0.0.0.0 2 0 1 1 1067 1 0 2 0 0 0 0 - 0 - 1 0 - - 0
3 tls-noverify 4 s4 0.0.0.0 2 0 1 1 1067 1 0 2 0 0 0 0 - 0 - 1 0 - - 0
3 tls-noverify 5 s5 0.0.0.0 2 0 1 1 1067 1 0 2 0 0 0 0 - 0 - 1 0 - - 0
3 tls-noverify 6 s6 0.0.0.0 2 0 1 1 1067 1 0 2 0 0 0 0 - 0 - 1 0 - - 0
3 tls-noverify 7 s7 0.0.0.0 2 0 1 1 1067 1 0 2 0 0 0 0 - 0 - 1 0 - - 0
3 tls-noverify 8 s8 0.0.0.0 2 0 1 1 1067 1 0 2 0 0 0 0 - 0 - 1 0 - - 0

> show servers conn
# bkname/svname bkid/svid addr port - purge_delay used_cur used_max need_est unsafe_nb safe_nb idle_lim idle_cur idle_per_thr[64]
tls-verify/s1 2/1 0.0.0.0 0 - 5000 0 0 0 0 0 -1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
tls-verify/s2 2/2 0.0.0.0 0 - 5000 0 0 0 0 0 -1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
tls-verify/s3 2/3 0.0.0.0 0 - 5000 0 0 0 0 0 -1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
tls-verify/s4 2/4 0.0.0.0 0 - 5000 0 0 0 0 0 -1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
tls-verify/s5 2/5 0.0.0.0 0 - 5000 0 0 0 0 0 -1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
tls-verify/s6 2/6 0.0.0.0 0 - 5000 0 0 0 0 0 -1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
tls-verify/s7 2/7 0.0.0.0 0 - 5000 0 0 0 0 0 -1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
tls-verify/s8 2/8 0.0.0.0 0 - 5000 0 0 0 0 0 -1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
tls-noverify/s1 3/1 0.0.0.0 0 - 5000 0 3 3 0 0 -1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
tls-noverify/s2 3/2 0.0.0.0 0 - 5000 0 2 2 0 0 -1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
tls-noverify/s3 3/3 0.0.0.0 0 - 5000 0 2 2 0 0 -1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
tls-noverify/s4 3/4 0.0.0.0 0 - 5000 0 3 3 0 0 -1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
tls-noverify/s5 3/5 0.0.0.0 0 - 5000 0 2 2 0 0 -1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
tls-noverify/s6 3/6 0.0.0.0 0 - 5000 0 2 2 0 0 -1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
tls-noverify/s7 3/7 0.0.0.0 0 - 5000 0 2 2 0 0 -1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
tls-noverify/s8 3/8 0.0.0.0 0 - 5000 0 2 2 0 0 -1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
delthas commented 1 month ago
Thread 64 (LWP 2952 "haproxy"):
#0  __futexwait (priv=128, val=-2147483602, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:40
#1  __lock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:44
#2  0x00007fbe5ac71af2 in wrlock () at src/malloc/mallocng/glue.h:74
#3  __libc_free (p=<optimized out>) at src/malloc/mallocng/free.c:143
#4  0x00007fbe5aa2aa4d in OPENSSL_sk_pop_free () from /lib/libcrypto.so.3
#5  0x00007fbe5a8d8e49 in OSSL_DECODER_CTX_free () from /lib/libcrypto.so.3
#6  0x00007fbe5aa58cff in ?? () from /lib/libcrypto.so.3
#7  0x00007fbe5a81fb0f in ?? () from /lib/libcrypto.so.3
#8  0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#9  0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#10 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#11 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#12 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#13 0x00007fbe5a8207e0 in ?? () from /lib/libcrypto.so.3
#14 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#15 0x00007fbe5a82029a in ?? () from /lib/libcrypto.so.3
#16 0x00007fbe5a820968 in ASN1_item_d2i_ex () from /lib/libcrypto.so.3
#17 0x00007fbe5abe0ccc in d2i_SSL_SESSION () from /lib/libssl.so.3
#18 0x000055acf0cb1e9b in ssl_sock_init (conn=0x7fbe09652890, xprt_ctx=0x7fbe096528b0) at src/ssl_sock.c:5670
#19 0x000055acf0dc5817 in conn_prepare (xprt=<optimized out>, proto=<optimized out>, conn=<optimized out>) at include/haproxy/connection.h:284
#20 connect_server (s=0x7fbe09ac93d0) at src/backend.c:1630
#21 back_try_conn_req (s=s@entry=0x7fbe09ac93d0) at src/backend.c:1988
#22 0x000055acf0d503b8 in process_stream (t=<optimized out>, context=0x7fbe09ac93d0, state=<optimized out>) at src/stream.c:2339
#23 0x000055acf0e35bd5 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:632
#24 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#25 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#26 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#27 0x00007fbe5aca1bc2 in start (p=0x7fbe4ec54090) at src/thread/pthread_create.c:207
#28 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 63 (LWP 2951 "haproxy"):
#0  __futexwait (priv=128, val=-2147483602, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:40
#1  __lock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:44
#2  0x00007fbe5ac726c7 in rdlock () at src/malloc/mallocng/glue.h:70
#3  rdlock () at src/malloc/mallocng/glue.h:68
#4  __libc_malloc_impl (n=136) at src/malloc/mallocng/malloc.c:337
#5  0x00007fbe5a9185a2 in CRYPTO_zalloc () from /lib/libcrypto.so.3
#6  0x00007fbe5aa79291 in ?? () from /lib/libcrypto.so.3
#7  0x00007fbe5a8fff20 in EVP_KDF_CTX_new () from /lib/libcrypto.so.3
#8  0x00007fbe5abfa7d7 in ?? () from /lib/libssl.so.3
#9  0x00007fbe5ac0698d in ?? () from /lib/libssl.so.3
#10 0x00007fbe5ac090ea in ?? () from /lib/libssl.so.3
#11 0x00007fbe5ac0677a in ?? () from /lib/libssl.so.3
#12 0x00007fbe5ac1044b in ?? () from /lib/libssl.so.3
#13 0x00007fbe5ac0f83f in ?? () from /lib/libssl.so.3
#14 0x000055acf0cace0a in ssl_sock_handshake (flag=134217728, conn=<optimized out>) at src/ssl_sock.c:5918
#15 ssl_sock_io_cb (t=0x7fbe2a99b280, context=0x7fbe2aaf8b50, state=<optimized out>) at src/ssl_sock.c:6253
#16 0x000055acf0e35a20 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:596
--Type <RET> for more, q to quit, c to continue without paging--c
#17 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#18 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#19 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#20 0x00007fbe5aca1bc2 in start (p=0x7fbe4ec79090) at src/thread/pthread_create.c:207
#21 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 62 (LWP 2950 "haproxy"):
#0  __futexwait (priv=128, val=-2147483602, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:40
#1  __lock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:44
#2  0x00007fbe5ac726c7 in rdlock () at src/malloc/mallocng/glue.h:70
#3  rdlock () at src/malloc/mallocng/glue.h:68
#4  __libc_malloc_impl (n=384) at src/malloc/mallocng/malloc.c:337
#5  0x00007fbe5a9185a2 in CRYPTO_zalloc () from /lib/libcrypto.so.3
#6  0x00007fbe5a822085 in ?? () from /lib/libcrypto.so.3
#7  0x00007fbe5a81fe62 in ?? () from /lib/libcrypto.so.3
#8  0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#9  0x00007fbe5a8207e0 in ?? () from /lib/libcrypto.so.3
#10 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#11 0x00007fbe5a82029a in ?? () from /lib/libcrypto.so.3
#12 0x00007fbe5a820968 in ASN1_item_d2i_ex () from /lib/libcrypto.so.3
#13 0x00007fbe5abe0ccc in d2i_SSL_SESSION () from /lib/libssl.so.3
#14 0x000055acf0cb1e9b in ssl_sock_init (conn=0x7fbe095348a0, xprt_ctx=0x7fbe095348c0) at src/ssl_sock.c:5670
#15 0x000055acf0dc5817 in conn_prepare (xprt=<optimized out>, proto=<optimized out>, conn=<optimized out>) at include/haproxy/connection.h:284
#16 connect_server (s=0x7fbe09b27aa0) at src/backend.c:1630
#17 back_try_conn_req (s=s@entry=0x7fbe09b27aa0) at src/backend.c:1988
#18 0x000055acf0d503b8 in process_stream (t=<optimized out>, context=0x7fbe09b27aa0, state=<optimized out>) at src/stream.c:2339
#19 0x000055acf0e35bd5 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:632
#20 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#21 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#22 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#23 0x00007fbe5aca1bc2 in start (p=0x7fbe4ec9e090) at src/thread/pthread_create.c:207
#24 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 61 (LWP 2949 "haproxy"):
#0  __futexwait (priv=128, val=-2147483602, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:40
#1  __lock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:44
#2  0x00007fbe5ac726c7 in rdlock () at src/malloc/mallocng/glue.h:70
#3  rdlock () at src/malloc/mallocng/glue.h:68
#4  __libc_malloc_impl (n=23) at src/malloc/mallocng/malloc.c:337
#5  0x00007fbe5a9197ba in CRYPTO_strdup () from /lib/libcrypto.so.3
#6  0x00007fbe5a8e0fe1 in ERR_set_debug () from /lib/libcrypto.so.3
#7  0x00007fbe5a8178c5 in ASN1_get_object () from /lib/libcrypto.so.3
#8  0x00007fbe5a80f8f2 in asn1_d2i_read_bio () from /lib/libcrypto.so.3
#9  0x00007fbe5aa76c49 in ?? () from /lib/libcrypto.so.3
#10 0x00007fbe5aa6f785 in ?? () from /lib/libcrypto.so.3
#11 0x00007fbe5a8d7de7 in ?? () from /lib/libcrypto.so.3
#12 0x00007fbe5a8d7f7b in OSSL_DECODER_from_bio () from /lib/libcrypto.so.3
#13 0x00007fbe5a8d8199 in OSSL_DECODER_from_data () from /lib/libcrypto.so.3
#14 0x00007fbe5aa58ca8 in ?? () from /lib/libcrypto.so.3
#15 0x00007fbe5a81fb0f in ?? () from /lib/libcrypto.so.3
#16 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#17 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#18 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#19 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#20 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#21 0x00007fbe5a8207e0 in ?? () from /lib/libcrypto.so.3
#22 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#23 0x00007fbe5a82029a in ?? () from /lib/libcrypto.so.3
#24 0x00007fbe5a820968 in ASN1_item_d2i_ex () from /lib/libcrypto.so.3
#25 0x00007fbe5abe0ccc in d2i_SSL_SESSION () from /lib/libssl.so.3
#26 0x000055acf0cb1e9b in ssl_sock_init (conn=0x7fbe0977bc60, xprt_ctx=0x7fbe0977bc80) at src/ssl_sock.c:5670
#27 0x000055acf0dc5817 in conn_prepare (xprt=<optimized out>, proto=<optimized out>, conn=<optimized out>) at include/haproxy/connection.h:284
#28 connect_server (s=0x7fbe097866b0) at src/backend.c:1630
#29 back_try_conn_req (s=s@entry=0x7fbe097866b0) at src/backend.c:1988
#30 0x000055acf0d503b8 in process_stream (t=<optimized out>, context=0x7fbe097866b0, state=<optimized out>) at src/stream.c:2339
#31 0x000055acf0e35bd5 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:632
#32 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#33 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#34 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#35 0x00007fbe5aca1bc2 in start (p=0x7fbe4ecc3090) at src/thread/pthread_create.c:207
#36 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 60 (LWP 2948 "haproxy"):
#0  __futexwait (priv=128, val=-2147483601, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:40
#1  __lock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:44
#2  0x00007fbe5ac726c7 in rdlock () at src/malloc/mallocng/glue.h:70
#3  rdlock () at src/malloc/mallocng/glue.h:68
#4  __libc_malloc_impl (n=216) at src/malloc/mallocng/malloc.c:337
#5  0x00007fbe5a9185a2 in CRYPTO_zalloc () from /lib/libcrypto.so.3
#6  0x00007fbe5a8ea9de in ?? () from /lib/libcrypto.so.3
#7  0x00007fbe5ac0693b in ?? () from /lib/libssl.so.3
#8  0x00007fbe5ac090ea in ?? () from /lib/libssl.so.3
#9  0x00007fbe5ac0677a in ?? () from /lib/libssl.so.3
#10 0x00007fbe5ac1044b in ?? () from /lib/libssl.so.3
#11 0x00007fbe5ac0f83f in ?? () from /lib/libssl.so.3
#12 0x000055acf0cace0a in ssl_sock_handshake (flag=134217728, conn=<optimized out>) at src/ssl_sock.c:5918
#13 ssl_sock_io_cb (t=0x7fbe2c1d8860, context=0x7fbe3c803be0, state=<optimized out>) at src/ssl_sock.c:6253
#14 0x000055acf0e35a20 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:596
#15 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#16 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#17 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#18 0x00007fbe5aca1bc2 in start (p=0x7fbe4ece8090) at src/thread/pthread_create.c:207
#19 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 59 (LWP 2947 "haproxy"):
#0  __futexwait (priv=128, val=-2147483602, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:40
#1  __lock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:44
#2  0x00007fbe5ac726c7 in rdlock () at src/malloc/mallocng/glue.h:70
#3  rdlock () at src/malloc/mallocng/glue.h:68
#4  __libc_malloc_impl (n=38) at src/malloc/mallocng/malloc.c:337
#5  0x00007fbe5a9197ba in CRYPTO_strdup () from /lib/libcrypto.so.3
#6  0x00007fbe5abde292 in ?? () from /lib/libssl.so.3
#7  0x000055acf0dc60de in connect_server (s=0x7fbe096d8850) at src/backend.c:1739
#8  back_try_conn_req (s=s@entry=0x7fbe096d8850) at src/backend.c:1988
#9  0x000055acf0d503b8 in process_stream (t=<optimized out>, context=0x7fbe096d8850, state=<optimized out>) at src/stream.c:2339
#10 0x000055acf0e35bd5 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:632
#11 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#12 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#13 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#14 0x00007fbe5aca1bc2 in start (p=0x7fbe4ed0d090) at src/thread/pthread_create.c:207
#15 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 58 (LWP 2946 "haproxy"):
#0  __futexwait (priv=128, val=-2147483601, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:40
#1  __lock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:44
#2  0x00007fbe5ac726c7 in rdlock () at src/malloc/mallocng/glue.h:70
#3  rdlock () at src/malloc/mallocng/glue.h:68
#4  __libc_malloc_impl (n=1) at src/malloc/mallocng/malloc.c:337
#5  0x00007fbe5a817ac4 in ASN1_STRING_set () from /lib/libcrypto.so.3
#6  0x00007fbe5a81f713 in ?? () from /lib/libcrypto.so.3
#7  0x00007fbe5a81fae2 in ?? () from /lib/libcrypto.so.3
#8  0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#9  0x00007fbe5a8207e0 in ?? () from /lib/libcrypto.so.3
#10 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#11 0x00007fbe5a82029a in ?? () from /lib/libcrypto.so.3
#12 0x00007fbe5a820968 in ASN1_item_d2i_ex () from /lib/libcrypto.so.3
#13 0x00007fbe5abe0ccc in d2i_SSL_SESSION () from /lib/libssl.so.3
#14 0x000055acf0cb1e9b in ssl_sock_init (conn=0x7fbe0973e3e0, xprt_ctx=0x7fbe0973e400) at src/ssl_sock.c:5670
#15 0x000055acf0dc5817 in conn_prepare (xprt=<optimized out>, proto=<optimized out>, conn=<optimized out>) at include/haproxy/connection.h:284
#16 connect_server (s=0x7fbe09743070) at src/backend.c:1630
#17 back_try_conn_req (s=s@entry=0x7fbe09743070) at src/backend.c:1988
#18 0x000055acf0d503b8 in process_stream (t=<optimized out>, context=0x7fbe09743070, state=<optimized out>) at src/stream.c:2339
#19 0x000055acf0e35bd5 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:632
#20 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#21 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#22 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#23 0x00007fbe5aca1bc2 in start (p=0x7fbe4ed32090) at src/thread/pthread_create.c:207
#24 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 57 (LWP 2945 "haproxy"):
#0  __futexwait (priv=128, val=-2147483601, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:40
#1  __lock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:44
#2  0x00007fbe5ac71af2 in wrlock () at src/malloc/mallocng/glue.h:74
#3  __libc_free (p=<optimized out>) at src/malloc/mallocng/free.c:143
#4  0x00007fbe5a829dbe in BIO_free () from /lib/libcrypto.so.3
#5  0x00007fbe5a8d7e3a in ?? () from /lib/libcrypto.so.3
#6  0x00007fbe5aa6f90c in ?? () from /lib/libcrypto.so.3
#7  0x00007fbe5a8d7de7 in ?? () from /lib/libcrypto.so.3
#8  0x00007fbe5a8d7f7b in OSSL_DECODER_from_bio () from /lib/libcrypto.so.3
#9  0x00007fbe5a8d8199 in OSSL_DECODER_from_data () from /lib/libcrypto.so.3
#10 0x00007fbe5aa58ca8 in ?? () from /lib/libcrypto.so.3
#11 0x00007fbe5a81fb0f in ?? () from /lib/libcrypto.so.3
#12 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#13 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#14 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#15 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#16 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#17 0x00007fbe5a8207e0 in ?? () from /lib/libcrypto.so.3
#18 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#19 0x00007fbe5a82029a in ?? () from /lib/libcrypto.so.3
#20 0x00007fbe5a820968 in ASN1_item_d2i_ex () from /lib/libcrypto.so.3
#21 0x00007fbe5abe0ccc in d2i_SSL_SESSION () from /lib/libssl.so.3
#22 0x000055acf0cb1e9b in ssl_sock_init (conn=0x7fbe0973e4b0, xprt_ctx=0x7fbe0973e4d0) at src/ssl_sock.c:5670
#23 0x000055acf0dc5817 in conn_prepare (xprt=<optimized out>, proto=<optimized out>, conn=<optimized out>) at include/haproxy/connection.h:284
#24 connect_server (s=0x7fbe39010fd0) at src/backend.c:1630
#25 back_try_conn_req (s=s@entry=0x7fbe39010fd0) at src/backend.c:1988
#26 0x000055acf0d503b8 in process_stream (t=<optimized out>, context=0x7fbe39010fd0, state=<optimized out>) at src/stream.c:2339
#27 0x000055acf0e35bd5 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:632
#28 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#29 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#30 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#31 0x00007fbe5aca1bc2 in start (p=0x7fbe4ed57090) at src/thread/pthread_create.c:207
#32 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 56 (LWP 2944 "haproxy"):
#0  __futexwait (priv=128, val=-2147483602, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:40
#1  __lock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:44
#2  0x00007fbe5ac71af2 in wrlock () at src/malloc/mallocng/glue.h:74
#3  __libc_free (p=<optimized out>) at src/malloc/mallocng/free.c:143
#4  0x00007fbe5a829dbe in BIO_free () from /lib/libcrypto.so.3
#5  0x00007fbe5abe9e46 in ?? () from /lib/libssl.so.3
#6  0x00007fbe5ac18c51 in ?? () from /lib/libssl.so.3
#7  0x00007fbe5ac0f75e in ?? () from /lib/libssl.so.3
#8  0x00007fbe5ac012a0 in ?? () from /lib/libssl.so.3
#9  0x00007fbe5abdf7c1 in ?? () from /lib/libssl.so.3
#10 0x00007fbe5abe80de in SSL_read () from /lib/libssl.so.3
#11 0x000055acf0ca7442 in ssl_sock_to_buf (conn=0x7fbe38df0110, xprt_ctx=0x7fbe3ba51a30, buf=0x7fbe38d590c8, count=15360, flags=<optimized out>) at src/ssl_sock.c:6362
#12 0x000055acf0e5e410 in mux_pt_rcv_buf (sc=0x7fbe38e55bd0, buf=0x7fbe38d590c8, count=15360, flags=0) at src/mux_pt.c:524
#13 0x000055acf0e0a3a3 in sc_conn_recv (sc=sc@entry=0x7fbe38e55bd0) at src/stconn.c:1353
#14 0x000055acf0e0a8ce in sc_conn_io_cb (t=0x7fbe38d44060, state=<optimized out>, ctx=0x7fbe38e55bd0) at src/stconn.c:1837
#15 sc_conn_io_cb (t=0x7fbe38d44060, ctx=0x7fbe38e55bd0, state=<optimized out>) at src/stconn.c:1826
#16 0x000055acf0e35a20 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:596
#17 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#18 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#19 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#20 0x00007fbe5aca1bc2 in start (p=0x7fbe4ed7c090) at src/thread/pthread_create.c:207
#21 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 55 (LWP 2943 "haproxy"):
#0  __futexwait (priv=128, val=-2147483602, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:40
#1  __lock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:44
#2  0x00007fbe5ac726c7 in rdlock () at src/malloc/mallocng/glue.h:70
#3  rdlock () at src/malloc/mallocng/glue.h:68
#4  __libc_malloc_impl (n=16712) at src/malloc/mallocng/malloc.c:337
#5  0x00007fbe5ac014f0 in ?? () from /lib/libssl.so.3
#6  0x00007fbe5ac0168e in ?? () from /lib/libssl.so.3
#7  0x00007fbe5ac0f21d in ?? () from /lib/libssl.so.3
#8  0x000055acf0cace0a in ssl_sock_handshake (flag=134217728, conn=<optimized out>) at src/ssl_sock.c:5918
#9  ssl_sock_io_cb (t=0x7fbe2bda2d00, context=0x7fbe2be2c490, state=<optimized out>) at src/ssl_sock.c:6253
#10 0x000055acf0e35a20 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:596
#11 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#12 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#13 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#14 0x00007fbe5aca1bc2 in start (p=0x7fbe4eda1090) at src/thread/pthread_create.c:207
#15 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 54 (LWP 2942 "haproxy"):
#0  __futexwait (priv=128, val=-2147483601, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:40
#1  __lock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:44
#2  0x00007fbe5ac726c7 in rdlock () at src/malloc/mallocng/glue.h:70
#3  rdlock () at src/malloc/mallocng/glue.h:68
#4  __libc_malloc_impl (n=32) at src/malloc/mallocng/malloc.c:337
#5  0x00007fbe5a9185a2 in CRYPTO_zalloc () from /lib/libcrypto.so.3
#6  0x00007fbe5aa2a9ad in OPENSSL_sk_new_reserve () from /lib/libcrypto.so.3
#7  0x00007fbe5aa57e76 in ?? () from /lib/libcrypto.so.3
#8  0x00007fbe5aa5850a in ?? () from /lib/libcrypto.so.3
#9  0x00007fbe5a81fb2f in ?? () from /lib/libcrypto.so.3
#10 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#11 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#12 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#13 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#14 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#15 0x00007fbe5a8207e0 in ?? () from /lib/libcrypto.so.3
#16 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#17 0x00007fbe5a82029a in ?? () from /lib/libcrypto.so.3
#18 0x00007fbe5a820968 in ASN1_item_d2i_ex () from /lib/libcrypto.so.3
#19 0x00007fbe5abe0ccc in d2i_SSL_SESSION () from /lib/libssl.so.3
#20 0x000055acf0cb1e9b in ssl_sock_init (conn=0x7fbe0954a880, xprt_ctx=0x7fbe0954a8a0) at src/ssl_sock.c:5670
#21 0x000055acf0dc5817 in conn_prepare (xprt=<optimized out>, proto=<optimized out>, conn=<optimized out>) at include/haproxy/connection.h:284
#22 connect_server (s=0x7fbe0993af50) at src/backend.c:1630
#23 back_try_conn_req (s=s@entry=0x7fbe0993af50) at src/backend.c:1988
#24 0x000055acf0d503b8 in process_stream (t=<optimized out>, context=0x7fbe0993af50, state=<optimized out>) at src/stream.c:2339
#25 0x000055acf0e35bd5 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:632
#26 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#27 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#28 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#29 0x00007fbe5aca1bc2 in start (p=0x7fbe4edc6090) at src/thread/pthread_create.c:207
#30 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 53 (LWP 2941 "haproxy"):
#0  __futexwait (priv=128, val=-2147483602, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:40
#1  __lock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:44
#2  0x00007fbe5ac726c7 in rdlock () at src/malloc/mallocng/glue.h:70
#3  rdlock () at src/malloc/mallocng/glue.h:68
#4  __libc_malloc_impl (n=270) at src/malloc/mallocng/malloc.c:337
#5  0x00007fbe5a80f4f9 in ?? () from /lib/libcrypto.so.3
#6  0x00007fbe5a81f5e1 in ?? () from /lib/libcrypto.so.3
#7  0x00007fbe5a81fae2 in ?? () from /lib/libcrypto.so.3
#8  0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#9  0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#10 0x00007fbe5a82029a in ?? () from /lib/libcrypto.so.3
#11 0x00007fbe5a820968 in ASN1_item_d2i_ex () from /lib/libcrypto.so.3
#12 0x00007fbe5aa58d96 in ?? () from /lib/libcrypto.so.3
#13 0x00007fbe5aa6f7b1 in ?? () from /lib/libcrypto.so.3
#14 0x00007fbe5a8d7de7 in ?? () from /lib/libcrypto.so.3
#15 0x00007fbe5a8d7f7b in OSSL_DECODER_from_bio () from /lib/libcrypto.so.3
#16 0x00007fbe5a8d8199 in OSSL_DECODER_from_data () from /lib/libcrypto.so.3
#17 0x00007fbe5aa58ca8 in ?? () from /lib/libcrypto.so.3
#18 0x00007fbe5a81fb0f in ?? () from /lib/libcrypto.so.3
#19 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#20 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#21 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#22 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#23 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#24 0x00007fbe5a8207e0 in ?? () from /lib/libcrypto.so.3
#25 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#26 0x00007fbe5a82029a in ?? () from /lib/libcrypto.so.3
#27 0x00007fbe5a820968 in ASN1_item_d2i_ex () from /lib/libcrypto.so.3
#28 0x00007fbe5abe0ccc in d2i_SSL_SESSION () from /lib/libssl.so.3
#29 0x000055acf0cb1e9b in ssl_sock_init (conn=0x7fbe09980d40, xprt_ctx=0x7fbe09980d60) at src/ssl_sock.c:5670
#30 0x000055acf0dc5817 in conn_prepare (xprt=<optimized out>, proto=<optimized out>, conn=<optimized out>) at include/haproxy/connection.h:284
#31 connect_server (s=0x7fbe09beab60) at src/backend.c:1630
#32 back_try_conn_req (s=s@entry=0x7fbe09beab60) at src/backend.c:1988
#33 0x000055acf0d503b8 in process_stream (t=<optimized out>, context=0x7fbe09beab60, state=<optimized out>) at src/stream.c:2339
#34 0x000055acf0e35bd5 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:632
#35 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#36 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#37 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#38 0x00007fbe5aca1bc2 in start (p=0x7fbe4edeb090) at src/thread/pthread_create.c:207
#39 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 52 (LWP 2940 "haproxy"):
#0  __futexwait (priv=128, val=-2147483602, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:40
#1  __lock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:44
#2  0x00007fbe5ac71af2 in wrlock () at src/malloc/mallocng/glue.h:74
#3  __libc_free (p=<optimized out>) at src/malloc/mallocng/free.c:143
#4  0x00007fbe5aa2a731 in OPENSSL_sk_free () from /lib/libcrypto.so.3
#5  0x00007fbe5aa2aa4d in OPENSSL_sk_pop_free () from /lib/libcrypto.so.3
#6  0x00007fbe5aa580f6 in ?? () from /lib/libcrypto.so.3
#7  0x00007fbe5aa5850a in ?? () from /lib/libcrypto.so.3
#8  0x00007fbe5a81fb2f in ?? () from /lib/libcrypto.so.3
#9  0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#10 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#11 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#12 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#13 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#14 0x00007fbe5a8207e0 in ?? () from /lib/libcrypto.so.3
#15 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#16 0x00007fbe5a82029a in ?? () from /lib/libcrypto.so.3
#17 0x00007fbe5a820968 in ASN1_item_d2i_ex () from /lib/libcrypto.so.3
#18 0x00007fbe5abe0ccc in d2i_SSL_SESSION () from /lib/libssl.so.3
#19 0x000055acf0cb1e9b in ssl_sock_init (conn=0x7fbe09625210, xprt_ctx=0x7fbe09625230) at src/ssl_sock.c:5670
#20 0x000055acf0dc5817 in conn_prepare (xprt=<optimized out>, proto=<optimized out>, conn=<optimized out>) at include/haproxy/connection.h:284
#21 connect_server (s=0x7fbe09abda20) at src/backend.c:1630
#22 back_try_conn_req (s=s@entry=0x7fbe09abda20) at src/backend.c:1988
#23 0x000055acf0d503b8 in process_stream (t=<optimized out>, context=0x7fbe09abda20, state=<optimized out>) at src/stream.c:2339
#24 0x000055acf0e35bd5 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:632
#25 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#26 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#27 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#28 0x00007fbe5aca1bc2 in start (p=0x7fbe4ee10090) at src/thread/pthread_create.c:207
#29 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 51 (LWP 2939 "haproxy"):
#0  __futexwait (priv=128, val=-2147483602, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:40
#1  __lock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:44
#2  0x00007fbe5ac726c7 in rdlock () at src/malloc/mallocng/glue.h:70
#3  rdlock () at src/malloc/mallocng/glue.h:68
#4  __libc_malloc_impl (n=40) at src/malloc/mallocng/malloc.c:337
#5  0x00007fbe5a9185a2 in CRYPTO_zalloc () from /lib/libcrypto.so.3
#6  0x00007fbe5a91a407 in ?? () from /lib/libcrypto.so.3
#7  0x00007fbe5aa79370 in ?? () from /lib/libcrypto.so.3
#8  0x00007fbe5aa79860 in ?? () from /lib/libcrypto.so.3
#9  0x00007fbe5abfaa28 in ?? () from /lib/libssl.so.3
#10 0x00007fbe5ac132f2 in ?? () from /lib/libssl.so.3
#11 0x00007fbe5ac0f2c4 in ?? () from /lib/libssl.so.3
#12 0x00007fbe5ac012a0 in ?? () from /lib/libssl.so.3
#13 0x00007fbe5abdf7c1 in ?? () from /lib/libssl.so.3
#14 0x00007fbe5abe80de in SSL_read () from /lib/libssl.so.3
#15 0x000055acf0ca7442 in ssl_sock_to_buf (conn=0x7fbe3901af20, xprt_ctx=0x7fbe39019f40, buf=0x7fbe38f7af28, count=15360, flags=<optimized out>) at src/ssl_sock.c:6362
#16 0x000055acf0e5e410 in mux_pt_rcv_buf (sc=0x7fbe38f63ce0, buf=0x7fbe38f7af28, count=15360, flags=0) at src/mux_pt.c:524
#17 0x000055acf0e0a3a3 in sc_conn_recv (sc=sc@entry=0x7fbe38f63ce0) at src/stconn.c:1353
#18 0x000055acf0e0a8ce in sc_conn_io_cb (t=0x7fbe38f649d0, state=<optimized out>, ctx=0x7fbe38f63ce0) at src/stconn.c:1837
#19 sc_conn_io_cb (t=0x7fbe38f649d0, ctx=0x7fbe38f63ce0, state=<optimized out>) at src/stconn.c:1826
#20 0x000055acf0e35a20 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:596
#21 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#22 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#23 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#24 0x00007fbe5aca1bc2 in start (p=0x7fbe4ee35090) at src/thread/pthread_create.c:207
#25 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 50 (LWP 2938 "haproxy"):
#0  __futexwait (priv=128, val=-2147483602, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:40
#1  __lock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:44
#2  0x00007fbe5ac726c7 in rdlock () at src/malloc/mallocng/glue.h:70
#3  rdlock () at src/malloc/mallocng/glue.h:68
#4  __libc_malloc_impl (n=104) at src/malloc/mallocng/malloc.c:337
#5  0x00007fbe5a83a119 in BN_MONT_CTX_new () from /lib/libcrypto.so.3
#6  0x00007fbe5a83a4c5 in BN_MONT_CTX_set_locked () from /lib/libcrypto.so.3
#7  0x00007fbe5a9fe081 in ?? () from /lib/libcrypto.so.3
#8  0x00007fbe5aa9002c in ?? () from /lib/libcrypto.so.3
#9  0x00007fbe5aa901b9 in ?? () from /lib/libcrypto.so.3
#10 0x00007fbe5a903648 in EVP_DigestVerifyFinal () from /lib/libcrypto.so.3
#11 0x00007fbe5ac18396 in ?? () from /lib/libssl.so.3
#12 0x00007fbe5ac0f2c4 in ?? () from /lib/libssl.so.3
#13 0x000055acf0cace0a in ssl_sock_handshake (flag=134217728, conn=<optimized out>) at src/ssl_sock.c:5918
#14 ssl_sock_io_cb (t=0x7fbe34e09a80, context=0x7fbe3ca9feb0, state=<optimized out>) at src/ssl_sock.c:6253
#15 0x000055acf0e35a20 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:596
#16 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#17 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#18 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#19 0x00007fbe5aca1bc2 in start (p=0x7fbe4ee5a090) at src/thread/pthread_create.c:207
#20 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 49 (LWP 2937 "haproxy"):
#0  __futexwait (priv=128, val=-2147483602, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:40
#1  __lock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:44
#2  0x00007fbe5ac71af2 in wrlock () at src/malloc/mallocng/glue.h:74
#3  __libc_free (p=<optimized out>) at src/malloc/mallocng/free.c:143
#4  0x00007fbe5a821871 in ?? () from /lib/libcrypto.so.3
#5  0x00007fbe5a821bdd in ?? () from /lib/libcrypto.so.3
#6  0x00007fbe5a821aaa in ?? () from /lib/libcrypto.so.3
#7  0x00007fbe5a821b34 in ASN1_item_free () from /lib/libcrypto.so.3
#8  0x00007fbe5abe1047 in d2i_SSL_SESSION () from /lib/libssl.so.3
#9  0x000055acf0cb1e9b in ssl_sock_init (conn=0x7fbe39537a80, xprt_ctx=0x7fbe39537aa0) at src/ssl_sock.c:5670
#10 0x000055acf0dc5817 in conn_prepare (xprt=<optimized out>, proto=<optimized out>, conn=<optimized out>) at include/haproxy/connection.h:284
#11 connect_server (s=0x7fbe097283f0) at src/backend.c:1630
#12 back_try_conn_req (s=s@entry=0x7fbe097283f0) at src/backend.c:1988
#13 0x000055acf0d503b8 in process_stream (t=<optimized out>, context=0x7fbe097283f0, state=<optimized out>) at src/stream.c:2339
#14 0x000055acf0e35bd5 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:632
#15 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#16 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#17 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#18 0x00007fbe5aca1bc2 in start (p=0x7fbe4ee7f090) at src/thread/pthread_create.c:207
#19 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 48 (LWP 2936 "haproxy"):
#0  __futexwait (priv=128, val=-2147483601, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:40
#1  __lock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:44
#2  0x00007fbe5ac726c7 in rdlock () at src/malloc/mallocng/glue.h:70
#3  rdlock () at src/malloc/mallocng/glue.h:68
#4  __libc_malloc_impl (n=19) at src/malloc/mallocng/malloc.c:337
#5  0x00007fbe5a9197ba in CRYPTO_strdup () from /lib/libcrypto.so.3
#6  0x00007fbe5a8e0fe1 in ERR_set_debug () from /lib/libcrypto.so.3
#7  0x00007fbe5a9067b3 in ?? () from /lib/libcrypto.so.3
#8  0x00007fbe5a906b54 in ?? () from /lib/libcrypto.so.3
#9  0x00007fbe5a915b66 in ?? () from /lib/libcrypto.so.3
#10 0x00007fbe5a906aa1 in EVP_PKEY_set_type_by_keymgmt () from /lib/libcrypto.so.3
#11 0x00007fbe5a9014f0 in ?? () from /lib/libcrypto.so.3
#12 0x00007fbe5a901540 in ?? () from /lib/libcrypto.so.3
#13 0x00007fbe5a8d9014 in ?? () from /lib/libcrypto.so.3
#14 0x00007fbe5a8d7acd in ?? () from /lib/libcrypto.so.3
#15 0x00007fbe5aa6e365 in ?? () from /lib/libcrypto.so.3
#16 0x00007fbe5a8d7de7 in ?? () from /lib/libcrypto.so.3
#17 0x00007fbe5aa6f90c in ?? () from /lib/libcrypto.so.3
#18 0x00007fbe5a8d7de7 in ?? () from /lib/libcrypto.so.3
#19 0x00007fbe5a8d7f7b in OSSL_DECODER_from_bio () from /lib/libcrypto.so.3
#20 0x00007fbe5a8d8199 in OSSL_DECODER_from_data () from /lib/libcrypto.so.3
#21 0x00007fbe5aa58ca8 in ?? () from /lib/libcrypto.so.3
#22 0x00007fbe5a81fb0f in ?? () from /lib/libcrypto.so.3
#23 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#24 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#25 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#26 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#27 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#28 0x00007fbe5a8207e0 in ?? () from /lib/libcrypto.so.3
#29 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#30 0x00007fbe5a82029a in ?? () from /lib/libcrypto.so.3
#31 0x00007fbe5a820968 in ASN1_item_d2i_ex () from /lib/libcrypto.so.3
#32 0x00007fbe5abe0ccc in d2i_SSL_SESSION () from /lib/libssl.so.3
#33 0x000055acf0cb1e9b in ssl_sock_init (conn=0x7fbe09653c40, xprt_ctx=0x7fbe09653c60) at src/ssl_sock.c:5670
#34 0x000055acf0dc5817 in conn_prepare (xprt=<optimized out>, proto=<optimized out>, conn=<optimized out>) at include/haproxy/connection.h:284
#35 connect_server (s=0x7fbe0964a740) at src/backend.c:1630
#36 back_try_conn_req (s=s@entry=0x7fbe0964a740) at src/backend.c:1988
#37 0x000055acf0d503b8 in process_stream (t=<optimized out>, context=0x7fbe0964a740, state=<optimized out>) at src/stream.c:2339
#38 0x000055acf0e35bd5 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:632
#39 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#40 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#41 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#42 0x00007fbe5aca1bc2 in start (p=0x7fbe4eea4090) at src/thread/pthread_create.c:207
#43 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 47 (LWP 2935 "haproxy"):
#0  __futexwait (priv=128, val=-2147483602, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:40
#1  __lock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:44
#2  0x00007fbe5ac726c7 in rdlock () at src/malloc/mallocng/glue.h:70
#3  rdlock () at src/malloc/mallocng/glue.h:68
#4  __libc_malloc_impl (n=5) at src/malloc/mallocng/malloc.c:337
#5  0x00007fbe5a817ac4 in ASN1_STRING_set () from /lib/libcrypto.so.3
#6  0x00007fbe5a81f713 in ?? () from /lib/libcrypto.so.3
#7  0x00007fbe5a81fae2 in ?? () from /lib/libcrypto.so.3
#8  0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#9  0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#10 0x00007fbe5a8204df in ?? () from /lib/libcrypto.so.3
#11 0x00007fbe5a8207e0 in ?? () from /lib/libcrypto.so.3
#12 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#13 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#14 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#15 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#16 0x00007fbe5a8207e0 in ?? () from /lib/libcrypto.so.3
#17 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#18 0x00007fbe5a82029a in ?? () from /lib/libcrypto.so.3
#19 0x00007fbe5a820968 in ASN1_item_d2i_ex () from /lib/libcrypto.so.3
#20 0x00007fbe5abe0ccc in d2i_SSL_SESSION () from /lib/libssl.so.3
#21 0x000055acf0cb1e9b in ssl_sock_init (conn=0x7fbe0973d8a0, xprt_ctx=0x7fbe0973d8c0) at src/ssl_sock.c:5670
#22 0x000055acf0dc5817 in conn_prepare (xprt=<optimized out>, proto=<optimized out>, conn=<optimized out>) at include/haproxy/connection.h:284
#23 connect_server (s=0x7fbe097287f0) at src/backend.c:1630
#24 back_try_conn_req (s=s@entry=0x7fbe097287f0) at src/backend.c:1988
#25 0x000055acf0d503b8 in process_stream (t=<optimized out>, context=0x7fbe097287f0, state=<optimized out>) at src/stream.c:2339
#26 0x000055acf0e35bd5 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:632
#27 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#28 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#29 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#30 0x00007fbe5aca1bc2 in start (p=0x7fbe4eec9090) at src/thread/pthread_create.c:207
#31 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 46 (LWP 2934 "haproxy"):
#0  __futexwait (priv=128, val=-2147483602, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:40
#1  __lock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:44
#2  0x00007fbe5ac726c7 in rdlock () at src/malloc/mallocng/glue.h:70
#3  rdlock () at src/malloc/mallocng/glue.h:68
#4  __libc_malloc_impl (n=32) at src/malloc/mallocng/malloc.c:337
#5  0x00007fbe5a9185a2 in CRYPTO_zalloc () from /lib/libcrypto.so.3
#6  0x00007fbe5aa2a9ad in OPENSSL_sk_new_reserve () from /lib/libcrypto.so.3
#7  0x00007fbe5a9f8978 in ?? () from /lib/libcrypto.so.3
#8  0x00007fbe5aa849fc in ?? () from /lib/libcrypto.so.3
#9  0x00007fbe5a901451 in ?? () from /lib/libcrypto.so.3
#10 0x00007fbe5a901502 in ?? () from /lib/libcrypto.so.3
#11 0x00007fbe5a901540 in ?? () from /lib/libcrypto.so.3
#12 0x00007fbe5a8d9014 in ?? () from /lib/libcrypto.so.3
#13 0x00007fbe5a8d7acd in ?? () from /lib/libcrypto.so.3
#14 0x00007fbe5aa6e365 in ?? () from /lib/libcrypto.so.3
#15 0x00007fbe5a8d7de7 in ?? () from /lib/libcrypto.so.3
#16 0x00007fbe5aa6f90c in ?? () from /lib/libcrypto.so.3
#17 0x00007fbe5a8d7de7 in ?? () from /lib/libcrypto.so.3
#18 0x00007fbe5a8d7f7b in OSSL_DECODER_from_bio () from /lib/libcrypto.so.3
#19 0x00007fbe5a8d8199 in OSSL_DECODER_from_data () from /lib/libcrypto.so.3
#20 0x00007fbe5aa58ca8 in ?? () from /lib/libcrypto.so.3
#21 0x00007fbe5a81fb0f in ?? () from /lib/libcrypto.so.3
#22 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#23 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#24 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#25 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#26 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#27 0x00007fbe5a8207e0 in ?? () from /lib/libcrypto.so.3
#28 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#29 0x00007fbe5a82029a in ?? () from /lib/libcrypto.so.3
#30 0x00007fbe5a820968 in ASN1_item_d2i_ex () from /lib/libcrypto.so.3
#31 0x00007fbe5abe0ccc in d2i_SSL_SESSION () from /lib/libssl.so.3
#32 0x000055acf0cb1e9b in ssl_sock_init (conn=0x7fbe09ac5790, xprt_ctx=0x7fbe09ac57b0) at src/ssl_sock.c:5670
#33 0x000055acf0dc5817 in conn_prepare (xprt=<optimized out>, proto=<optimized out>, conn=<optimized out>) at include/haproxy/connection.h:284
#34 connect_server (s=0x7fbe098707a0) at src/backend.c:1630
#35 back_try_conn_req (s=s@entry=0x7fbe098707a0) at src/backend.c:1988
#36 0x000055acf0d503b8 in process_stream (t=<optimized out>, context=0x7fbe098707a0, state=<optimized out>) at src/stream.c:2339
#37 0x000055acf0e35bd5 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:632
#38 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#39 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#40 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#41 0x00007fbe5aca1bc2 in start (p=0x7fbe4eeee090) at src/thread/pthread_create.c:207
#42 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 45 (LWP 2933 "haproxy"):
#0  __futexwait (priv=128, val=-2147483601, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:40
#1  __lock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:44
#2  0x00007fbe5ac726c7 in rdlock () at src/malloc/mallocng/glue.h:70
#3  rdlock () at src/malloc/mallocng/glue.h:68
#4  __libc_malloc_impl (n=64) at src/malloc/mallocng/malloc.c:337
#5  0x000055acf0e4d215 in pool_alloc_area (size=<optimized out>) at include/haproxy/pool-os.h:37
#6  pool_get_from_os (pool=pool@entry=0x7fbe5a586200) at src/pool.c:377
#7  0x000055acf0e4d329 in pool_alloc_nocache (pool=pool@entry=0x7fbe5a586200) at src/pool.c:409
#8  0x000055acf0e4de44 in __pool_alloc (pool=0x7fbe5a586200, flags=flags@entry=0) at src/pool.c:779
#9  0x000055acf0e91015 in tasklet_new () at include/haproxy/task.h:530
#10 xprt_handshake_init (conn=0x7fbe09b1c970, xprt_ctx=0x7fbe4ef12de0) at src/xprt_handshake.c:158
#11 0x000055acf0dd97ba in xprt_add_hs (conn=conn@entry=0x7fbe09b1c970) at src/connection.c:573
#12 0x000055acf0e6d5f8 in session_accept_fd (cli_conn=0x7fbe09b1c970) at src/session.c:183
#13 0x000055acf0e1ad07 in accept_queue_process (t=<optimized out>, context=0x55acf1007040 <accept_queue_rings+363264>, state=<optimized out>) at src/listener.c:152
#14 0x000055acf0e35a20 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:596
#15 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#16 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#17 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#18 0x00007fbe5aca1bc2 in start (p=0x7fbe4ef13090) at src/thread/pthread_create.c:207
#19 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 44 (LWP 2932 "haproxy"):
#0  __futexwait (priv=128, val=-2147483602, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:40
#1  __lock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:44
#2  0x00007fbe5ac726c7 in rdlock () at src/malloc/mallocng/glue.h:70
#3  rdlock () at src/malloc/mallocng/glue.h:68
#4  __libc_malloc_impl (n=16) at src/malloc/mallocng/malloc.c:337
#5  0x00007fbe5a9197ba in CRYPTO_strdup () from /lib/libcrypto.so.3
#6  0x00007fbe5a8e103c in ERR_set_debug () from /lib/libcrypto.so.3
#7  0x00007fbe5a8178c5 in ASN1_get_object () from /lib/libcrypto.so.3
#8  0x00007fbe5a80f8f2 in asn1_d2i_read_bio () from /lib/libcrypto.so.3
#9  0x00007fbe5aa76c49 in ?? () from /lib/libcrypto.so.3
#10 0x00007fbe5aa6e14e in ?? () from /lib/libcrypto.so.3
#11 0x00007fbe5a8d7de7 in ?? () from /lib/libcrypto.so.3
#12 0x00007fbe5aa6f90c in ?? () from /lib/libcrypto.so.3
#13 0x00007fbe5a8d7de7 in ?? () from /lib/libcrypto.so.3
#14 0x00007fbe5a8d7f7b in OSSL_DECODER_from_bio () from /lib/libcrypto.so.3
#15 0x00007fbe5a8d8199 in OSSL_DECODER_from_data () from /lib/libcrypto.so.3
#16 0x00007fbe5aa58ca8 in ?? () from /lib/libcrypto.so.3
#17 0x00007fbe5a81fb0f in ?? () from /lib/libcrypto.so.3
#18 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#19 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#20 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#21 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#22 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#23 0x00007fbe5a8207e0 in ?? () from /lib/libcrypto.so.3
#24 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#25 0x00007fbe5a82029a in ?? () from /lib/libcrypto.so.3
#26 0x00007fbe5a820968 in ASN1_item_d2i_ex () from /lib/libcrypto.so.3
#27 0x00007fbe5abe0ccc in d2i_SSL_SESSION () from /lib/libssl.so.3
#28 0x000055acf0cb1e9b in ssl_sock_init (conn=0x7fbe3b817c60, xprt_ctx=0x7fbe3b817c80) at src/ssl_sock.c:5670
#29 0x000055acf0dc5817 in conn_prepare (xprt=<optimized out>, proto=<optimized out>, conn=<optimized out>) at include/haproxy/connection.h:284
#30 connect_server (s=0x7fbe3b836250) at src/backend.c:1630
#31 back_try_conn_req (s=s@entry=0x7fbe3b836250) at src/backend.c:1988
#32 0x000055acf0d503b8 in process_stream (t=<optimized out>, context=0x7fbe3b836250, state=<optimized out>) at src/stream.c:2339
#33 0x000055acf0e35bd5 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:632
#34 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#35 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#36 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#37 0x00007fbe5aca1bc2 in start (p=0x7fbe4ef38090) at src/thread/pthread_create.c:207
#38 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 43 (LWP 2931 "haproxy"):
#0  __futexwait (priv=128, val=-2147483601, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:40
#1  __lock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:44
#2  0x00007fbe5ac71af2 in wrlock () at src/malloc/mallocng/glue.h:74
#3  __libc_free (p=<optimized out>) at src/malloc/mallocng/free.c:143
#4  0x00007fbe5a817c62 in ?? () from /lib/libcrypto.so.3
#5  0x00007fbe5a821871 in ?? () from /lib/libcrypto.so.3
#6  0x00007fbe5a821bdd in ?? () from /lib/libcrypto.so.3
#7  0x00007fbe5a821aaa in ?? () from /lib/libcrypto.so.3
#8  0x00007fbe5a821b34 in ASN1_item_free () from /lib/libcrypto.so.3
#9  0x00007fbe5abe1047 in d2i_SSL_SESSION () from /lib/libssl.so.3
#10 0x000055acf0cb1e9b in ssl_sock_init (conn=0x7fbe2a553d40, xprt_ctx=0x7fbe2a553d60) at src/ssl_sock.c:5670
#11 0x000055acf0dc5817 in conn_prepare (xprt=<optimized out>, proto=<optimized out>, conn=<optimized out>) at include/haproxy/connection.h:284
#12 connect_server (s=0x7fbe0985b430) at src/backend.c:1630
#13 back_try_conn_req (s=s@entry=0x7fbe0985b430) at src/backend.c:1988
#14 0x000055acf0d503b8 in process_stream (t=<optimized out>, context=0x7fbe0985b430, state=<optimized out>) at src/stream.c:2339
#15 0x000055acf0e35bd5 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:632
#16 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#17 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#18 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#19 0x00007fbe5aca1bc2 in start (p=0x7fbe4ef5d090) at src/thread/pthread_create.c:207
#20 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 42 (LWP 2930 "haproxy"):
#0  __futexwait (priv=128, val=-2147483602, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:40
#1  __lock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:44
#2  0x00007fbe5ac726c7 in rdlock () at src/malloc/mallocng/glue.h:70
#3  rdlock () at src/malloc/mallocng/glue.h:68
#4  __libc_malloc_impl (n=4096) at src/malloc/mallocng/malloc.c:337
#5  0x00007fbe5a8269de in ?? () from /lib/libcrypto.so.3
#6  0x00007fbe5a829ca3 in BIO_new_ex () from /lib/libcrypto.so.3
#7  0x00007fbe5abe9da2 in ?? () from /lib/libssl.so.3
#8  0x00007fbe5ac0f253 in ?? () from /lib/libssl.so.3
#9  0x00007fbe5ac012a0 in ?? () from /lib/libssl.so.3
#10 0x00007fbe5abdf7c1 in ?? () from /lib/libssl.so.3
#11 0x00007fbe5abe80de in SSL_read () from /lib/libssl.so.3
#12 0x000055acf0ca7442 in ssl_sock_to_buf (conn=0x7fbe3bad65c0, xprt_ctx=0x7fbe3bb74e20, buf=0x7fbe3893f808, count=15360, flags=<optimized out>) at src/ssl_sock.c:6362
#13 0x000055acf0e5e410 in mux_pt_rcv_buf (sc=0x7fbe3bae7f10, buf=0x7fbe3893f808, count=15360, flags=0) at src/mux_pt.c:524
#14 0x000055acf0e0a3a3 in sc_conn_recv (sc=sc@entry=0x7fbe3bae7f10) at src/stconn.c:1353
#15 0x000055acf0e0a8ce in sc_conn_io_cb (t=0x7fbe3ba9b1b0, state=<optimized out>, ctx=0x7fbe3bae7f10) at src/stconn.c:1837
#16 sc_conn_io_cb (t=0x7fbe3ba9b1b0, ctx=0x7fbe3bae7f10, state=<optimized out>) at src/stconn.c:1826
#17 0x000055acf0e35a20 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:596
#18 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#19 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#20 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#21 0x00007fbe5aca1bc2 in start (p=0x7fbe4ef82090) at src/thread/pthread_create.c:207
#22 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 41 (LWP 2929 "haproxy"):
#0  __futexwait (priv=128, val=-2147483601, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:40
#1  __lock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:44
#2  0x00007fbe5ac726c7 in rdlock () at src/malloc/mallocng/glue.h:70
#3  rdlock () at src/malloc/mallocng/glue.h:68
#4  __libc_malloc_impl (n=32) at src/malloc/mallocng/malloc.c:337
#5  0x00007fbe5a9185a2 in CRYPTO_zalloc () from /lib/libcrypto.so.3
#6  0x00007fbe5aa2a2d6 in ?? () from /lib/libcrypto.so.3
#7  0x00007fbe5aa2a5f1 in OPENSSL_sk_insert () from /lib/libcrypto.so.3
#8  0x00007fbe5a8d7123 in ?? () from /lib/libcrypto.so.3
#9  0x00007fbe5a9eeae3 in ?? () from /lib/libcrypto.so.3
#10 0x00007fbe5a9220e4 in ?? () from /lib/libcrypto.so.3
#11 0x00007fbe5a9ef0d5 in ?? () from /lib/libcrypto.so.3
#12 0x00007fbe5a8d8c1a in OSSL_DECODER_do_all_provided () from /lib/libcrypto.so.3
#13 0x00007fbe5a8d77e1 in OSSL_DECODER_CTX_add_extra () from /lib/libcrypto.so.3
#14 0x00007fbe5a8d9543 in OSSL_DECODER_CTX_new_for_pkey () from /lib/libcrypto.so.3
#15 0x00007fbe5aa58c8c in ?? () from /lib/libcrypto.so.3
#16 0x00007fbe5a81fb0f in ?? () from /lib/libcrypto.so.3
#17 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#18 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#19 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#20 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#21 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#22 0x00007fbe5a8207e0 in ?? () from /lib/libcrypto.so.3
#23 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#24 0x00007fbe5a82029a in ?? () from /lib/libcrypto.so.3
#25 0x00007fbe5a820968 in ASN1_item_d2i_ex () from /lib/libcrypto.so.3
#26 0x00007fbe5abe0ccc in d2i_SSL_SESSION () from /lib/libssl.so.3
#27 0x000055acf0cb1e9b in ssl_sock_init (conn=0x7fbe0973db70, xprt_ctx=0x7fbe0973db90) at src/ssl_sock.c:5670
#28 0x000055acf0dc5817 in conn_prepare (xprt=<optimized out>, proto=<optimized out>, conn=<optimized out>) at include/haproxy/connection.h:284
#29 connect_server (s=0x7fbe096dc320) at src/backend.c:1630
#30 back_try_conn_req (s=s@entry=0x7fbe096dc320) at src/backend.c:1988
#31 0x000055acf0d503b8 in process_stream (t=<optimized out>, context=0x7fbe096dc320, state=<optimized out>) at src/stream.c:2339
#32 0x000055acf0e35bd5 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:632
#33 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#34 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#35 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#36 0x00007fbe5aca1bc2 in start (p=0x7fbe4efa7090) at src/thread/pthread_create.c:207
#37 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 40 (LWP 2928 "haproxy"):
#0  __futexwait (priv=128, val=-2147483601, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:40
#1  __lock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:44
#2  0x00007fbe5ac726c7 in rdlock () at src/malloc/mallocng/glue.h:70
#3  rdlock () at src/malloc/mallocng/glue.h:68
#4  __libc_malloc_impl (n=8) at src/malloc/mallocng/malloc.c:337
#5  0x00007fbe5a9185a2 in CRYPTO_zalloc () from /lib/libcrypto.so.3
#6  0x00007fbe5aa6f96e in ?? () from /lib/libcrypto.so.3
#7  0x00007fbe5a8d78f9 in OSSL_DECODER_CTX_add_extra () from /lib/libcrypto.so.3
#8  0x00007fbe5a8d9543 in OSSL_DECODER_CTX_new_for_pkey () from /lib/libcrypto.so.3
#9  0x00007fbe5aa58c8c in ?? () from /lib/libcrypto.so.3
#10 0x00007fbe5a81fb0f in ?? () from /lib/libcrypto.so.3
#11 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#12 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#13 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#14 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#15 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#16 0x00007fbe5a8207e0 in ?? () from /lib/libcrypto.so.3
#17 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#18 0x00007fbe5a82029a in ?? () from /lib/libcrypto.so.3
#19 0x00007fbe5a820968 in ASN1_item_d2i_ex () from /lib/libcrypto.so.3
#20 0x00007fbe5abe0ccc in d2i_SSL_SESSION () from /lib/libssl.so.3
#21 0x000055acf0cb1e9b in ssl_sock_init (conn=0x7fbe09626a60, xprt_ctx=0x7fbe09626a80) at src/ssl_sock.c:5670
#22 0x000055acf0dc5817 in conn_prepare (xprt=<optimized out>, proto=<optimized out>, conn=<optimized out>) at include/haproxy/connection.h:284
#23 connect_server (s=0x7fbe09785ae0) at src/backend.c:1630
#24 back_try_conn_req (s=s@entry=0x7fbe09785ae0) at src/backend.c:1988
#25 0x000055acf0d503b8 in process_stream (t=<optimized out>, context=0x7fbe09785ae0, state=<optimized out>) at src/stream.c:2339
#26 0x000055acf0e35bd5 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:632
#27 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#28 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#29 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#30 0x00007fbe5aca1bc2 in start (p=0x7fbe4efcc090) at src/thread/pthread_create.c:207
#31 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 39 (LWP 2927 "haproxy"):
#0  __futexwait (priv=128, val=-2147483602, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:40
#1  __lock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:44
#2  0x00007fbe5ac726c7 in rdlock () at src/malloc/mallocng/glue.h:70
#3  rdlock () at src/malloc/mallocng/glue.h:68
#4  __libc_malloc_impl (n=56) at src/malloc/mallocng/malloc.c:337
#5  0x00007fbe5a9185a2 in CRYPTO_zalloc () from /lib/libcrypto.so.3
#6  0x00007fbe5a92239d in CRYPTO_THREAD_lock_new () from /lib/libcrypto.so.3
#7  0x00007fbe5abe161f in ?? () from /lib/libssl.so.3
#8  0x00007fbe5abecb94 in SSL_new () from /lib/libssl.so.3
#9  0x000055acf0cb1bb8 in ssl_bio_and_sess_init (conn=conn@entry=0x7fbe095352d0, ssl_ctx=0x7fbe5a34c990, ssl=ssl@entry=0x7fbe0953a648, bio=bio@entry=0x7fbe0953a650, bio_meth=0x7fbe5a6a0c30, ctx=ctx@entry=0x7fbe0953a640) at src/ssl_sock.c:5549
#10 0x000055acf0cb1e19 in ssl_sock_init (conn=0x7fbe095352d0, xprt_ctx=0x7fbe095352f0) at src/ssl_sock.c:5662
#11 0x000055acf0dc5817 in conn_prepare (xprt=<optimized out>, proto=<optimized out>, conn=<optimized out>) at include/haproxy/connection.h:284
#12 connect_server (s=0x7fbe0993ab50) at src/backend.c:1630
#13 back_try_conn_req (s=s@entry=0x7fbe0993ab50) at src/backend.c:1988
#14 0x000055acf0d503b8 in process_stream (t=<optimized out>, context=0x7fbe0993ab50, state=<optimized out>) at src/stream.c:2339
#15 0x000055acf0e35bd5 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:632
#16 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#17 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#18 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#19 0x00007fbe5aca1bc2 in start (p=0x7fbe4eff1090) at src/thread/pthread_create.c:207
#20 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 38 (LWP 2926 "haproxy"):
#0  __futexwait (priv=128, val=-2147483601, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:40
#1  __lock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:44
#2  0x00007fbe5ac726c7 in rdlock () at src/malloc/mallocng/glue.h:70
#3  rdlock () at src/malloc/mallocng/glue.h:68
#4  __libc_malloc_impl (n=72) at src/malloc/mallocng/malloc.c:337
#5  0x00007fbe5a9185a2 in CRYPTO_zalloc () from /lib/libcrypto.so.3
#6  0x00007fbe5a9105df in ?? () from /lib/libcrypto.so.3
#7  0x00007fbe5a910970 in HMAC_CTX_reset () from /lib/libcrypto.so.3
#8  0x00007fbe5a910a05 in HMAC_CTX_new () from /lib/libcrypto.so.3
#9  0x00007fbe5aa864d4 in ?? () from /lib/libcrypto.so.3
#10 0x00007fbe5a903991 in EVP_MAC_CTX_new () from /lib/libcrypto.so.3
#11 0x00007fbe5a903efc in EVP_Q_mac () from /lib/libcrypto.so.3
#12 0x00007fbe5aa78daf in ?? () from /lib/libcrypto.so.3
#13 0x00007fbe5aa79816 in ?? () from /lib/libcrypto.so.3
#14 0x00007fbe5abfaf9b in ?? () from /lib/libssl.so.3
#15 0x00007fbe5ac06902 in ?? () from /lib/libssl.so.3
#16 0x00007fbe5ac090ea in ?? () from /lib/libssl.so.3
#17 0x00007fbe5ac0677a in ?? () from /lib/libssl.so.3
#18 0x00007fbe5ac1044b in ?? () from /lib/libssl.so.3
#19 0x00007fbe5ac0f83f in ?? () from /lib/libssl.so.3
#20 0x000055acf0cace0a in ssl_sock_handshake (flag=134217728, conn=<optimized out>) at src/ssl_sock.c:5918
#21 ssl_sock_io_cb (t=0x7fbe2dc6ab90, context=0x7fbe2de5ea30, state=<optimized out>) at src/ssl_sock.c:6253
#22 0x000055acf0e35a20 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:596
#23 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#24 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#25 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#26 0x00007fbe5aca1bc2 in start (p=0x7fbe4f016090) at src/thread/pthread_create.c:207
#27 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 37 (LWP 2925 "haproxy"):
#0  __futexwait (priv=128, val=-2147483602, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:40
#1  __lock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:44
#2  0x00007fbe5ac726c7 in rdlock () at src/malloc/mallocng/glue.h:70
#3  rdlock () at src/malloc/mallocng/glue.h:68
#4  __libc_malloc_impl (n=56) at src/malloc/mallocng/malloc.c:337
#5  0x00007fbe5a9185a2 in CRYPTO_zalloc () from /lib/libcrypto.so.3
#6  0x00007fbe5a92239d in CRYPTO_THREAD_lock_new () from /lib/libcrypto.so.3
#7  0x00007fbe5a829c41 in BIO_new_ex () from /lib/libcrypto.so.3
#8  0x000055acf0cb1bc8 in ssl_bio_and_sess_init (conn=conn@entry=0x7fbe09534a70, ssl_ctx=0x7fbe5a33a330, ssl=ssl@entry=0x7fbe0953a498, bio=bio@entry=0x7fbe0953a4a0, bio_meth=0x7fbe5a6a0c30, ctx=ctx@entry=0x7fbe0953a490) at src/ssl_sock.c:5558
#9  0x000055acf0cb1e19 in ssl_sock_init (conn=0x7fbe09534a70, xprt_ctx=0x7fbe09534a90) at src/ssl_sock.c:5662
#10 0x000055acf0dc5817 in conn_prepare (xprt=<optimized out>, proto=<optimized out>, conn=<optimized out>) at include/haproxy/connection.h:284
#11 connect_server (s=0x7fbe096da380) at src/backend.c:1630
#12 back_try_conn_req (s=s@entry=0x7fbe096da380) at src/backend.c:1988
#13 0x000055acf0d503b8 in process_stream (t=<optimized out>, context=0x7fbe096da380, state=<optimized out>) at src/stream.c:2339
#14 0x000055acf0e35bd5 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:632
#15 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#16 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#17 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#18 0x00007fbe5aca1bc2 in start (p=0x7fbe4f03b090) at src/thread/pthread_create.c:207
#19 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 36 (LWP 2924 "haproxy"):
#0  __cp_end () at src/thread/x86_64/syscall_cp.s:29
#1  0x00007fbe5aca10ee in __syscall_cp_c (nr=45, u=<optimized out>, v=<optimized out>, w=<optimized out>, x=<optimized out>, y=<optimized out>, z=0) at src/thread/pthread_cancel.c:33
#2  0x00007fbe5ac89631 in __alt_socketcall (f=0, e=0, d=2, c=<optimized out>, b=<optimized out>, a=<optimized out>, cp=1, sock=12, sys=45) at ./src/internal/syscall.h:64
#3  recvfrom (fd=<optimized out>, buf=<optimized out>, len=<optimized out>, flags=flags@entry=2, addr=addr@entry=0x0, alen=alen@entry=0x0) at src/network/recvfrom.c:6
#4  0x00007fbe5ac8960f in recv (fd=<optimized out>, buf=<optimized out>, len=<optimized out>, flags=flags@entry=2) at src/network/recv.c:5
#5  0x000055acf0dd9fb5 in recv (__fl=2, __n=<optimized out>, __s=<optimized out>, __f=<optimized out>) at /usr/include/fortify/sys/socket.h:44
#6  conn_recv_proxy (conn=conn@entry=0x7fbe09534210, flag=flag@entry=33554432) at src/connection.c:814
#7  0x000055acf0e911a5 in xprt_handshake_io_cb (t=0x7fbe0963ca90, bctx=0x7fbe09640920, state=<optimized out>) at src/xprt_handshake.c:67
#8  0x000055acf0e35a20 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:596
#9  0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#10 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#11 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#12 0x00007fbe5aca1bc2 in start (p=0x7fbe4f060090) at src/thread/pthread_create.c:207
#13 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 35 (LWP 2923 "haproxy"):
#0  __futexwait (priv=128, val=-2147483602, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:40
#1  __lock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:44
#2  0x00007fbe5ac726c7 in rdlock () at src/malloc/mallocng/glue.h:70
#3  rdlock () at src/malloc/mallocng/glue.h:68
#4  __libc_malloc_impl (n=3) at src/malloc/mallocng/malloc.c:337
#5  0x00007fbe5a817ac4 in ASN1_STRING_set () from /lib/libcrypto.so.3
#6  0x00007fbe5a81f713 in ?? () from /lib/libcrypto.so.3
#7  0x00007fbe5a81fae2 in ?? () from /lib/libcrypto.so.3
#8  0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#9  0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#10 0x00007fbe5a8204df in ?? () from /lib/libcrypto.so.3
#11 0x00007fbe5a8207e0 in ?? () from /lib/libcrypto.so.3
#12 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#13 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#14 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#15 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#16 0x00007fbe5a8207e0 in ?? () from /lib/libcrypto.so.3
#17 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#18 0x00007fbe5a82029a in ?? () from /lib/libcrypto.so.3
#19 0x00007fbe5a820968 in ASN1_item_d2i_ex () from /lib/libcrypto.so.3
#20 0x00007fbe5abe0ccc in d2i_SSL_SESSION () from /lib/libssl.so.3
#21 0x000055acf0cb1e9b in ssl_sock_init (conn=0x7fbe0973ea70, xprt_ctx=0x7fbe0973ea90) at src/ssl_sock.c:5670
#22 0x000055acf0dc5817 in conn_prepare (xprt=<optimized out>, proto=<optimized out>, conn=<optimized out>) at include/haproxy/connection.h:284
#23 connect_server (s=0x7fbe09728fe0) at src/backend.c:1630
#24 back_try_conn_req (s=s@entry=0x7fbe09728fe0) at src/backend.c:1988
#25 0x000055acf0d503b8 in process_stream (t=<optimized out>, context=0x7fbe09728fe0, state=<optimized out>) at src/stream.c:2339
#26 0x000055acf0e35bd5 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:632
#27 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#28 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#29 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#30 0x00007fbe5aca1bc2 in start (p=0x7fbe4f085090) at src/thread/pthread_create.c:207
#31 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 34 (LWP 2922 "haproxy"):
#0  __futexwait (priv=128, val=-2147483602, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:40
#1  __lock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:44
#2  0x00007fbe5ac71af2 in wrlock () at src/malloc/mallocng/glue.h:74
#3  __libc_free (p=<optimized out>) at src/malloc/mallocng/free.c:143
#4  0x00007fbe5a8d8e39 in OSSL_DECODER_CTX_free () from /lib/libcrypto.so.3
#5  0x00007fbe5aa58cff in ?? () from /lib/libcrypto.so.3
#6  0x00007fbe5a81fb0f in ?? () from /lib/libcrypto.so.3
#7  0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#8  0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#9  0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#10 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#11 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#12 0x00007fbe5a8207e0 in ?? () from /lib/libcrypto.so.3
#13 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#14 0x00007fbe5a82029a in ?? () from /lib/libcrypto.so.3
#15 0x00007fbe5a820968 in ASN1_item_d2i_ex () from /lib/libcrypto.so.3
#16 0x00007fbe5abe0ccc in d2i_SSL_SESSION () from /lib/libssl.so.3
#17 0x000055acf0cb1e9b in ssl_sock_init (conn=0x7fbe0977ca70, xprt_ctx=0x7fbe0977ca90) at src/ssl_sock.c:5670
#18 0x000055acf0dc5817 in conn_prepare (xprt=<optimized out>, proto=<optimized out>, conn=<optimized out>) at include/haproxy/connection.h:284
#19 connect_server (s=0x7fbe09d70b10) at src/backend.c:1630
#20 back_try_conn_req (s=s@entry=0x7fbe09d70b10) at src/backend.c:1988
#21 0x000055acf0d503b8 in process_stream (t=<optimized out>, context=0x7fbe09d70b10, state=<optimized out>) at src/stream.c:2339
#22 0x000055acf0e35bd5 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:632
#23 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#24 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#25 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#26 0x00007fbe5aca1bc2 in start (p=0x7fbe4f0aa090) at src/thread/pthread_create.c:207
#27 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 33 (LWP 2921 "haproxy"):
#0  __futexwait (priv=128, val=-2147483602, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:40
#1  __lock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:44
#2  0x00007fbe5ac726c7 in rdlock () at src/malloc/mallocng/glue.h:70
#3  rdlock () at src/malloc/mallocng/glue.h:68
#4  __libc_malloc_impl (n=8) at src/malloc/mallocng/malloc.c:337
#5  0x00007fbe5a91b7f0 in ?? () from /lib/libcrypto.so.3
#6  0x00007fbe5a91d330 in OSSL_PARAM_get_octet_string () from /lib/libcrypto.so.3
#7  0x00007fbe5aa78aca in ?? () from /lib/libcrypto.so.3
#8  0x00007fbe5aa7968b in ?? () from /lib/libcrypto.so.3
#9  0x00007fbe5abfaa28 in ?? () from /lib/libssl.so.3
#10 0x00007fbe5abfad41 in ?? () from /lib/libssl.so.3
#11 0x00007fbe5ac069c0 in ?? () from /lib/libssl.so.3
#12 0x00007fbe5ac090ea in ?? () from /lib/libssl.so.3
#13 0x00007fbe5ac0677a in ?? () from /lib/libssl.so.3
#14 0x00007fbe5ac1044b in ?? () from /lib/libssl.so.3
#15 0x00007fbe5ac0f83f in ?? () from /lib/libssl.so.3
#16 0x000055acf0cace0a in ssl_sock_handshake (flag=134217728, conn=<optimized out>) at src/ssl_sock.c:5918
#17 ssl_sock_io_cb (t=0x7fbe2d1a4b20, context=0x7fbe2d20df40, state=<optimized out>) at src/ssl_sock.c:6253
#18 0x000055acf0e35a20 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:596
#19 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#20 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#21 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#22 0x00007fbe5aca1bc2 in start (p=0x7fbe4f0cf090) at src/thread/pthread_create.c:207
#23 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 32 (LWP 2920 "haproxy"):
#0  __futexwait (priv=128, val=-2147483601, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:40
#1  __lock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:44
#2  0x00007fbe5ac726c7 in rdlock () at src/malloc/mallocng/glue.h:70
#3  rdlock () at src/malloc/mallocng/glue.h:68
#4  __libc_malloc_impl (n=256) at src/malloc/mallocng/malloc.c:337
#5  0x00007fbe5a9185a2 in CRYPTO_zalloc () from /lib/libcrypto.so.3
#6  0x00007fbe5a838f25 in ?? () from /lib/libcrypto.so.3
#7  0x00007fbe5a839315 in BN_bin2bn () from /lib/libcrypto.so.3
#8  0x00007fbe5a82407f in ?? () from /lib/libcrypto.so.3
#9  0x00007fbe5a81f4bb in ?? () from /lib/libcrypto.so.3
#10 0x00007fbe5a81fae2 in ?? () from /lib/libcrypto.so.3
#11 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#12 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#13 0x00007fbe5a82029a in ?? () from /lib/libcrypto.so.3
#14 0x00007fbe5a820968 in ASN1_item_d2i_ex () from /lib/libcrypto.so.3
#15 0x00007fbe5a9f742e in ?? () from /lib/libcrypto.so.3
#16 0x00007fbe5aa5883a in ?? () from /lib/libcrypto.so.3
#17 0x00007fbe5aa58c12 in ?? () from /lib/libcrypto.so.3
#18 0x00007fbe5a81fb0f in ?? () from /lib/libcrypto.so.3
#19 0x00007fbe5a82029a in ?? () from /lib/libcrypto.so.3
#20 0x00007fbe5a820968 in ASN1_item_d2i_ex () from /lib/libcrypto.so.3
#21 0x00007fbe5aa593fa in ?? () from /lib/libcrypto.so.3
#22 0x00007fbe5aa5964a in d2i_RSA_PUBKEY () from /lib/libcrypto.so.3
#23 0x00007fbe5aa6e228 in ?? () from /lib/libcrypto.so.3
#24 0x00007fbe5a8d7de7 in ?? () from /lib/libcrypto.so.3
#25 0x00007fbe5aa6f90c in ?? () from /lib/libcrypto.so.3
#26 0x00007fbe5a8d7de7 in ?? () from /lib/libcrypto.so.3
#27 0x00007fbe5a8d7f7b in OSSL_DECODER_from_bio () from /lib/libcrypto.so.3
#28 0x00007fbe5a8d8199 in OSSL_DECODER_from_data () from /lib/libcrypto.so.3
#29 0x00007fbe5aa58ca8 in ?? () from /lib/libcrypto.so.3
#30 0x00007fbe5a81fb0f in ?? () from /lib/libcrypto.so.3
#31 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#32 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#33 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#34 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#35 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#36 0x00007fbe5a8207e0 in ?? () from /lib/libcrypto.so.3
#37 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#38 0x00007fbe5a82029a in ?? () from /lib/libcrypto.so.3
#39 0x00007fbe5a820968 in ASN1_item_d2i_ex () from /lib/libcrypto.so.3
#40 0x00007fbe5abe0ccc in d2i_SSL_SESSION () from /lib/libssl.so.3
#41 0x000055acf0cb1e9b in ssl_sock_init (conn=0x7fbe0973d020, xprt_ctx=0x7fbe0973d040) at src/ssl_sock.c:5670
#42 0x000055acf0dc5817 in conn_prepare (xprt=<optimized out>, proto=<optimized out>, conn=<optimized out>) at include/haproxy/connection.h:284
#43 connect_server (s=0x7fbe097297d0) at src/backend.c:1630
#44 back_try_conn_req (s=s@entry=0x7fbe097297d0) at src/backend.c:1988
#45 0x000055acf0d503b8 in process_stream (t=<optimized out>, context=0x7fbe097297d0, state=<optimized out>) at src/stream.c:2339
#46 0x000055acf0e35bd5 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:632
#47 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#48 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#49 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#50 0x00007fbe5aca1bc2 in start (p=0x7fbe4f0f4090) at src/thread/pthread_create.c:207
#51 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 31 (LWP 2919 "haproxy"):
#0  __futexwait (priv=128, val=-2147483602, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:40
#1  __lock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:44
#2  0x00007fbe5ac71af2 in wrlock () at src/malloc/mallocng/glue.h:74
#3  __libc_free (p=<optimized out>) at src/malloc/mallocng/free.c:143
#4  0x00007fbe5abdfdac in ?? () from /lib/libssl.so.3
#5  0x00007fbe5ac08428 in ?? () from /lib/libssl.so.3
#6  0x00007fbe5ac0677a in ?? () from /lib/libssl.so.3
#7  0x00007fbe5ac1044b in ?? () from /lib/libssl.so.3
#8  0x00007fbe5ac0f83f in ?? () from /lib/libssl.so.3
#9  0x000055acf0cace0a in ssl_sock_handshake (flag=134217728, conn=<optimized out>) at src/ssl_sock.c:5918
#10 ssl_sock_io_cb (t=0x7fbe2c232880, context=0x7fbe35a9f6d0, state=<optimized out>) at src/ssl_sock.c:6253
#11 0x000055acf0e35a20 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:596
#12 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#13 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#14 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#15 0x00007fbe5aca1bc2 in start (p=0x7fbe4f119090) at src/thread/pthread_create.c:207
#16 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 30 (LWP 2918 "haproxy"):
#0  __futexwait (priv=128, val=-2147483602, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:40
#1  __lock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:44
#2  0x00007fbe5ac726c7 in rdlock () at src/malloc/mallocng/glue.h:70
#3  rdlock () at src/malloc/mallocng/glue.h:68
#4  __libc_malloc_impl (n=17) at src/malloc/mallocng/malloc.c:337
#5  0x00007fbe5a9197ba in CRYPTO_strdup () from /lib/libcrypto.so.3
#6  0x00007fbe5a8e103c in ERR_set_debug () from /lib/libcrypto.so.3
#7  0x00007fbe5a91b500 in ?? () from /lib/libcrypto.so.3
#8  0x00007fbe5a91d5de in OSSL_PARAM_get_utf8_string_ptr () from /lib/libcrypto.so.3
#9  0x00007fbe5a8d7b68 in ?? () from /lib/libcrypto.so.3
#10 0x00007fbe5aa6f90c in ?? () from /lib/libcrypto.so.3
#11 0x00007fbe5a8d7de7 in ?? () from /lib/libcrypto.so.3
#12 0x00007fbe5a8d7f7b in OSSL_DECODER_from_bio () from /lib/libcrypto.so.3
#13 0x00007fbe5a8d8199 in OSSL_DECODER_from_data () from /lib/libcrypto.so.3
#14 0x00007fbe5aa58ca8 in ?? () from /lib/libcrypto.so.3
#15 0x00007fbe5a81fb0f in ?? () from /lib/libcrypto.so.3
#16 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#17 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#18 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#19 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#20 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#21 0x00007fbe5a8207e0 in ?? () from /lib/libcrypto.so.3
#22 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#23 0x00007fbe5a82029a in ?? () from /lib/libcrypto.so.3
#24 0x00007fbe5a820968 in ASN1_item_d2i_ex () from /lib/libcrypto.so.3
#25 0x00007fbe5abe0ccc in d2i_SSL_SESSION () from /lib/libssl.so.3
#26 0x000055acf0cb1e9b in ssl_sock_init (conn=0x7fbe09653d30, xprt_ctx=0x7fbe09653d50) at src/ssl_sock.c:5670
#27 0x000055acf0dc5817 in conn_prepare (xprt=<optimized out>, proto=<optimized out>, conn=<optimized out>) at include/haproxy/connection.h:284
#28 connect_server (s=0x7fbe09896ec0) at src/backend.c:1630
#29 back_try_conn_req (s=s@entry=0x7fbe09896ec0) at src/backend.c:1988
#30 0x000055acf0d503b8 in process_stream (t=<optimized out>, context=0x7fbe09896ec0, state=<optimized out>) at src/stream.c:2339
#31 0x000055acf0e35bd5 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:632
#32 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#33 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#34 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#35 0x00007fbe5aca1bc2 in start (p=0x7fbe4f13e090) at src/thread/pthread_create.c:207
#36 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 29 (LWP 2917 "haproxy"):
#0  __futexwait (priv=128, val=-2147483602, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:40
#1  __lock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:44
#2  0x00007fbe5ac726c7 in rdlock () at src/malloc/mallocng/glue.h:70
#3  rdlock () at src/malloc/mallocng/glue.h:68
#4  __libc_malloc_impl (n=3) at src/malloc/mallocng/malloc.c:337
#5  0x00007fbe5a817ac4 in ASN1_STRING_set () from /lib/libcrypto.so.3
#6  0x00007fbe5a81f713 in ?? () from /lib/libcrypto.so.3
#7  0x00007fbe5a81fae2 in ?? () from /lib/libcrypto.so.3
#8  0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#9  0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#10 0x00007fbe5a82029a in ?? () from /lib/libcrypto.so.3
#11 0x00007fbe5a820968 in ASN1_item_d2i_ex () from /lib/libcrypto.so.3
#12 0x00007fbe5abe0ccc in d2i_SSL_SESSION () from /lib/libssl.so.3
#13 0x000055acf0cb1e9b in ssl_sock_init (conn=0x7fbe095345c0, xprt_ctx=0x7fbe095345e0) at src/ssl_sock.c:5670
#14 0x000055acf0dc5817 in conn_prepare (xprt=<optimized out>, proto=<optimized out>, conn=<optimized out>) at include/haproxy/connection.h:284
#15 connect_server (s=0x7fbe09540b10) at src/backend.c:1630
#16 back_try_conn_req (s=s@entry=0x7fbe09540b10) at src/backend.c:1988
#17 0x000055acf0d503b8 in process_stream (t=<optimized out>, context=0x7fbe09540b10, state=<optimized out>) at src/stream.c:2339
#18 0x000055acf0e35bd5 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:632
#19 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#20 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#21 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#22 0x00007fbe5aca1bc2 in start (p=0x7fbe4f163090) at src/thread/pthread_create.c:207
#23 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 28 (LWP 2916 "haproxy"):
#0  __futexwait (priv=128, val=-2147483615, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:40
#1  __lock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:44
#2  0x00007fbe5ac71af2 in wrlock () at src/malloc/mallocng/glue.h:74
#3  __libc_free (p=<optimized out>) at src/malloc/mallocng/free.c:143
#4  0x00007fbe5a903ff2 in EVP_Q_mac () from /lib/libcrypto.so.3
#5  0x00007fbe5aa78daf in ?? () from /lib/libcrypto.so.3
#6  0x00007fbe5aa79816 in ?? () from /lib/libcrypto.so.3
#7  0x00007fbe5abfaf9b in ?? () from /lib/libssl.so.3
#8  0x00007fbe5abdff10 in ?? () from /lib/libssl.so.3
#9  0x00007fbe5abe0121 in ?? () from /lib/libssl.so.3
#10 0x00007fbe5ac0a4b4 in ?? () from /lib/libssl.so.3
#11 0x00007fbe5ac06562 in ?? () from /lib/libssl.so.3
#12 0x00007fbe5ac12362 in ?? () from /lib/libssl.so.3
#13 0x00007fbe5ac0f2c4 in ?? () from /lib/libssl.so.3
#14 0x000055acf0cace0a in ssl_sock_handshake (flag=134217728, conn=<optimized out>) at src/ssl_sock.c:5918
#15 ssl_sock_io_cb (t=0x7fbe3d4835f0, context=0x7fbe3d3f47f0, state=<optimized out>) at src/ssl_sock.c:6253
#16 0x000055acf0e35a20 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:596
#17 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#18 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#19 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#20 0x00007fbe5aca1bc2 in start (p=0x7fbe4f188090) at src/thread/pthread_create.c:207
#21 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 27 (LWP 2915 "haproxy"):
#0  __libc_malloc_impl (n=56) at src/malloc/mallocng/malloc.c:358
#1  0x00007fbe5a9185a2 in CRYPTO_zalloc () from /lib/libcrypto.so.3
#2  0x00007fbe5a92239d in CRYPTO_THREAD_lock_new () from /lib/libcrypto.so.3
#3  0x00007fbe5a906510 in EVP_PKEY_new () from /lib/libcrypto.so.3
#4  0x00007fbe5a90152a in ?? () from /lib/libcrypto.so.3
#5  0x00007fbe5a8d9014 in ?? () from /lib/libcrypto.so.3
#6  0x00007fbe5a8d7acd in ?? () from /lib/libcrypto.so.3
#7  0x00007fbe5aa6e365 in ?? () from /lib/libcrypto.so.3
#8  0x00007fbe5a8d7de7 in ?? () from /lib/libcrypto.so.3
#9  0x00007fbe5aa6f90c in ?? () from /lib/libcrypto.so.3
#10 0x00007fbe5a8d7de7 in ?? () from /lib/libcrypto.so.3
#11 0x00007fbe5a8d7f7b in OSSL_DECODER_from_bio () from /lib/libcrypto.so.3
#12 0x00007fbe5a8d8199 in OSSL_DECODER_from_data () from /lib/libcrypto.so.3
#13 0x00007fbe5aa58ca8 in ?? () from /lib/libcrypto.so.3
#14 0x00007fbe5a81fb0f in ?? () from /lib/libcrypto.so.3
#15 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#16 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#17 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#18 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#19 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#20 0x00007fbe5a8207e0 in ?? () from /lib/libcrypto.so.3
#21 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#22 0x00007fbe5a82029a in ?? () from /lib/libcrypto.so.3
#23 0x00007fbe5a820968 in ASN1_item_d2i_ex () from /lib/libcrypto.so.3
#24 0x00007fbe5abe0ccc in d2i_SSL_SESSION () from /lib/libssl.so.3
#25 0x000055acf0cb1e9b in ssl_sock_init (conn=0x7fbe099255b0, xprt_ctx=0x7fbe099255d0) at src/ssl_sock.c:5670
#26 0x000055acf0dc5817 in conn_prepare (xprt=<optimized out>, proto=<optimized out>, conn=<optimized out>) at include/haproxy/connection.h:284
#27 connect_server (s=0x7fbe0985e750) at src/backend.c:1630
#28 back_try_conn_req (s=s@entry=0x7fbe0985e750) at src/backend.c:1988
#29 0x000055acf0d503b8 in process_stream (t=<optimized out>, context=0x7fbe0985e750, state=<optimized out>) at src/stream.c:2339
#30 0x000055acf0e35bd5 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:632
#31 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#32 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#33 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#34 0x00007fbe5aca1bc2 in start (p=0x7fbe4f1ad090) at src/thread/pthread_create.c:207
#35 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 26 (LWP 2914 "haproxy"):
#0  __wake (priv=128, cnt=1, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:31
#1  __unlock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:59
#2  0x00007fbe5ac727a5 in unlock () at src/malloc/mallocng/glue.h:78
#3  __libc_malloc_impl (n=64) at src/malloc/mallocng/malloc.c:378
#4  0x000055acf0e4d215 in pool_alloc_area (size=<optimized out>) at include/haproxy/pool-os.h:37
#5  pool_get_from_os (pool=pool@entry=0x7fbe5a586200) at src/pool.c:377
#6  0x000055acf0e4d329 in pool_alloc_nocache (pool=pool@entry=0x7fbe5a586200) at src/pool.c:409
#7  0x000055acf0e4de44 in __pool_alloc (pool=0x7fbe5a586200, flags=flags@entry=0) at src/pool.c:779
#8  0x000055acf0e6c682 in session_new (fe=fe@entry=0x7fbe5a3dc300, li=li@entry=0x7fbe5a3db2b0, origin=origin@entry=0x7fbe0954a110) at src/session.c:53
#9  0x000055acf0e6d45c in session_accept_fd (cli_conn=0x7fbe0954a110) at src/session.c:186
#10 0x000055acf0e1ad07 in accept_queue_process (t=<optimized out>, context=0x55acf0fe0b80 <accept_queue_rings+206400>, state=<optimized out>) at src/listener.c:152
#11 0x000055acf0e35a20 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:596
#12 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#13 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#14 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#15 0x00007fbe5aca1bc2 in start (p=0x7fbe4f1d2090) at src/thread/pthread_create.c:207
#16 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 25 (LWP 2913 "haproxy"):
#0  __wake (priv=128, cnt=1, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:31
#1  __unlock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:59
#2  0x00007fbe5ac727a5 in unlock () at src/malloc/mallocng/glue.h:78
#3  __libc_malloc_impl (n=216) at src/malloc/mallocng/malloc.c:378
#4  0x00007fbe5a9185a2 in CRYPTO_zalloc () from /lib/libcrypto.so.3
#5  0x00007fbe5a8ea9de in ?? () from /lib/libcrypto.so.3
#6  0x00007fbe5a910790 in HMAC_Init_ex () from /lib/libcrypto.so.3
#7  0x00007fbe5aa78e5e in ?? () from /lib/libcrypto.so.3
#8  0x00007fbe5aa79428 in ?? () from /lib/libcrypto.so.3
#9  0x00007fbe5aa79860 in ?? () from /lib/libcrypto.so.3
#10 0x00007fbe5abfaa28 in ?? () from /lib/libssl.so.3
#11 0x00007fbe5abfab82 in ?? () from /lib/libssl.so.3
#12 0x00007fbe5abfb999 in ?? () from /lib/libssl.so.3
#13 0x00007fbe5ac184ef in ?? () from /lib/libssl.so.3
#14 0x00007fbe5ac0f83f in ?? () from /lib/libssl.so.3
#15 0x000055acf0cace0a in ssl_sock_handshake (flag=134217728, conn=<optimized out>) at src/ssl_sock.c:5918
#16 ssl_sock_io_cb (t=0x7fbe3ba9eff0, context=0x7fbe34c97130, state=<optimized out>) at src/ssl_sock.c:6253
#17 0x000055acf0e35a20 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:596
#18 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#19 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#20 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#21 0x00007fbe5aca1bc2 in start (p=0x7fbe4f1f7090) at src/thread/pthread_create.c:207
#22 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 24 (LWP 2912 "haproxy"):
#0  __wake (priv=128, cnt=1, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:31
#1  __unlock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:59
#2  0x00007fbe5ac727a5 in unlock () at src/malloc/mallocng/glue.h:78
#3  __libc_malloc_impl (n=56) at src/malloc/mallocng/malloc.c:378
#4  0x00007fbe5a9185a2 in CRYPTO_zalloc () from /lib/libcrypto.so.3
#5  0x00007fbe5a92239d in CRYPTO_THREAD_lock_new () from /lib/libcrypto.so.3
#6  0x00007fbe5a8237cd in ?? () from /lib/libcrypto.so.3
#7  0x00007fbe5a82209e in ?? () from /lib/libcrypto.so.3
#8  0x00007fbe5a81fe62 in ?? () from /lib/libcrypto.so.3
#9  0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#10 0x00007fbe5a8207e0 in ?? () from /lib/libcrypto.so.3
#11 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#12 0x00007fbe5a82029a in ?? () from /lib/libcrypto.so.3
#13 0x00007fbe5a820968 in ASN1_item_d2i_ex () from /lib/libcrypto.so.3
#14 0x00007fbe5abe0ccc in d2i_SSL_SESSION () from /lib/libssl.so.3
#15 0x000055acf0cb1e9b in ssl_sock_init (conn=0x7fbe09534030, xprt_ctx=0x7fbe09534050) at src/ssl_sock.c:5670
#16 0x000055acf0dc5817 in conn_prepare (xprt=<optimized out>, proto=<optimized out>, conn=<optimized out>) at include/haproxy/connection.h:284
#17 connect_server (s=0x7fbe0985e340) at src/backend.c:1630
#18 back_try_conn_req (s=s@entry=0x7fbe0985e340) at src/backend.c:1988
#19 0x000055acf0d503b8 in process_stream (t=<optimized out>, context=0x7fbe0985e340, state=<optimized out>) at src/stream.c:2339
#20 0x000055acf0e35bd5 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:632
#21 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#22 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#23 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#24 0x00007fbe5aca1bc2 in start (p=0x7fbe4f21c090) at src/thread/pthread_create.c:207
#25 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 23 (LWP 2911 "haproxy"):
#0  __futexwait (priv=128, val=-2147483609, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:40
#1  __lock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:44
#2  0x00007fbe5ac726c7 in rdlock () at src/malloc/mallocng/glue.h:70
#3  rdlock () at src/malloc/mallocng/glue.h:68
#4  __libc_malloc_impl (n=104) at src/malloc/mallocng/malloc.c:337
#5  0x00007fbe5a84dfe7 in BUF_MEM_grow () from /lib/libcrypto.so.3
#6  0x00007fbe5aa58461 in ?? () from /lib/libcrypto.so.3
#7  0x00007fbe5a81fb2f in ?? () from /lib/libcrypto.so.3
#8  0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#9  0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#10 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#11 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#12 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#13 0x00007fbe5a8207e0 in ?? () from /lib/libcrypto.so.3
#14 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#15 0x00007fbe5a82029a in ?? () from /lib/libcrypto.so.3
#16 0x00007fbe5a820968 in ASN1_item_d2i_ex () from /lib/libcrypto.so.3
#17 0x00007fbe5abe0ccc in d2i_SSL_SESSION () from /lib/libssl.so.3
#18 0x000055acf0cb1e9b in ssl_sock_init (conn=0x7fbe0973df30, xprt_ctx=0x7fbe0973df50) at src/ssl_sock.c:5670
#19 0x000055acf0dc5817 in conn_prepare (xprt=<optimized out>, proto=<optimized out>, conn=<optimized out>) at include/haproxy/connection.h:284
#20 connect_server (s=0x7fbe09624630) at src/backend.c:1630
#21 back_try_conn_req (s=s@entry=0x7fbe09624630) at src/backend.c:1988
#22 0x000055acf0d503b8 in process_stream (t=<optimized out>, context=0x7fbe09624630, state=<optimized out>) at src/stream.c:2339
#23 0x000055acf0e35bd5 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:632
#24 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#25 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#26 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#27 0x00007fbe5aca1bc2 in start (p=0x7fbe4f241090) at src/thread/pthread_create.c:207
#28 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 22 (LWP 2910 "haproxy"):
#0  __futexwait (priv=128, val=-2147483607, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:40
#1  __lock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:44
#2  0x00007fbe5ac726c7 in rdlock () at src/malloc/mallocng/glue.h:70
#3  rdlock () at src/malloc/mallocng/glue.h:68
#4  __libc_malloc_impl (n=16) at src/malloc/mallocng/malloc.c:337
#5  0x00007fbe5a9185a2 in CRYPTO_zalloc () from /lib/libcrypto.so.3
#6  0x00007fbe5a822085 in ?? () from /lib/libcrypto.so.3
#7  0x00007fbe5a81fe62 in ?? () from /lib/libcrypto.so.3
#8  0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#9  0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#10 0x00007fbe5a82029a in ?? () from /lib/libcrypto.so.3
#11 0x00007fbe5a820968 in ASN1_item_d2i_ex () from /lib/libcrypto.so.3
#12 0x00007fbe5aa58d96 in ?? () from /lib/libcrypto.so.3
#13 0x00007fbe5aa6f7b1 in ?? () from /lib/libcrypto.so.3
#14 0x00007fbe5a8d7de7 in ?? () from /lib/libcrypto.so.3
#15 0x00007fbe5a8d7f7b in OSSL_DECODER_from_bio () from /lib/libcrypto.so.3
#16 0x00007fbe5a8d8199 in OSSL_DECODER_from_data () from /lib/libcrypto.so.3
#17 0x00007fbe5aa58ca8 in ?? () from /lib/libcrypto.so.3
#18 0x00007fbe5a81fb0f in ?? () from /lib/libcrypto.so.3
#19 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#20 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#21 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#22 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#23 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#24 0x00007fbe5a8207e0 in ?? () from /lib/libcrypto.so.3
#25 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#26 0x00007fbe5a82029a in ?? () from /lib/libcrypto.so.3
#27 0x00007fbe5a820968 in ASN1_item_d2i_ex () from /lib/libcrypto.so.3
#28 0x00007fbe5abe0ccc in d2i_SSL_SESSION () from /lib/libssl.so.3
#29 0x000055acf0cb1e9b in ssl_sock_init (conn=0x7fbe09ac5690, xprt_ctx=0x7fbe09ac56b0) at src/ssl_sock.c:5670
#30 0x000055acf0dc5817 in conn_prepare (xprt=<optimized out>, proto=<optimized out>, conn=<optimized out>) at include/haproxy/connection.h:284
#31 connect_server (s=0x7fbe09875a40) at src/backend.c:1630
#32 back_try_conn_req (s=s@entry=0x7fbe09875a40) at src/backend.c:1988
#33 0x000055acf0d503b8 in process_stream (t=<optimized out>, context=0x7fbe09875a40, state=<optimized out>) at src/stream.c:2339
#34 0x000055acf0e35bd5 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:632
#35 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#36 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#37 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#38 0x00007fbe5aca1bc2 in start (p=0x7fbe4f266090) at src/thread/pthread_create.c:207
#39 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 21 (LWP 2909 "haproxy"):
#0  __wake (priv=128, cnt=1, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:31
#1  __unlock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:59
#2  0x00007fbe5ac727a5 in unlock () at src/malloc/mallocng/glue.h:78
#3  __libc_malloc_impl (n=12) at src/malloc/mallocng/malloc.c:378
#4  0x00007fbe5a84e0f0 in BUF_MEM_grow_clean () from /lib/libcrypto.so.3
#5  0x00007fbe5a80f844 in asn1_d2i_read_bio () from /lib/libcrypto.so.3
#6  0x00007fbe5aa76c49 in ?? () from /lib/libcrypto.so.3
#7  0x00007fbe5aa6f785 in ?? () from /lib/libcrypto.so.3
#8  0x00007fbe5a8d7de7 in ?? () from /lib/libcrypto.so.3
#9  0x00007fbe5a8d7f7b in OSSL_DECODER_from_bio () from /lib/libcrypto.so.3
#10 0x00007fbe5a8d8199 in OSSL_DECODER_from_data () from /lib/libcrypto.so.3
#11 0x00007fbe5aa58ca8 in ?? () from /lib/libcrypto.so.3
#12 0x00007fbe5a81fb0f in ?? () from /lib/libcrypto.so.3
#13 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#14 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#15 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#16 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#17 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#18 0x00007fbe5a8207e0 in ?? () from /lib/libcrypto.so.3
#19 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#20 0x00007fbe5a82029a in ?? () from /lib/libcrypto.so.3
#21 0x00007fbe5a820968 in ASN1_item_d2i_ex () from /lib/libcrypto.so.3
#22 0x00007fbe5abe0ccc in d2i_SSL_SESSION () from /lib/libssl.so.3
#23 0x000055acf0cb1e9b in ssl_sock_init (conn=0x7fbe096527a0, xprt_ctx=0x7fbe096527c0) at src/ssl_sock.c:5670
#24 0x000055acf0dc5817 in conn_prepare (xprt=<optimized out>, proto=<optimized out>, conn=<optimized out>) at include/haproxy/connection.h:284
#25 connect_server (s=0x7fbe096dd2d0) at src/backend.c:1630
#26 back_try_conn_req (s=s@entry=0x7fbe096dd2d0) at src/backend.c:1988
#27 0x000055acf0d503b8 in process_stream (t=<optimized out>, context=0x7fbe096dd2d0, state=<optimized out>) at src/stream.c:2339
#28 0x000055acf0e35bd5 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:632
#29 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#30 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#31 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#32 0x00007fbe5aca1bc2 in start (p=0x7fbe4f28b090) at src/thread/pthread_create.c:207
#33 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 20 (LWP 2908 "haproxy"):
#0  __futexwait (priv=128, val=-2147483614, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:40
#1  __lock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:44
#2  0x00007fbe5ac726c7 in rdlock () at src/malloc/mallocng/glue.h:70
#3  rdlock () at src/malloc/mallocng/glue.h:68
#4  __libc_malloc_impl (n=32) at src/malloc/mallocng/malloc.c:337
#5  0x00007fbe5a9185a2 in CRYPTO_zalloc () from /lib/libcrypto.so.3
#6  0x00007fbe5aa2a2d6 in ?? () from /lib/libcrypto.so.3
#7  0x00007fbe5aa2a5f1 in OPENSSL_sk_insert () from /lib/libcrypto.so.3
#8  0x00007fbe5a8d749b in ?? () from /lib/libcrypto.so.3
#9  0x00007fbe5a8d927c in ?? () from /lib/libcrypto.so.3
#10 0x00007fbe5a9eeae3 in ?? () from /lib/libcrypto.so.3
#11 0x00007fbe5a9220e4 in ?? () from /lib/libcrypto.so.3
#12 0x00007fbe5a9ef0d5 in ?? () from /lib/libcrypto.so.3
#13 0x00007fbe5a8d8c1a in OSSL_DECODER_do_all_provided () from /lib/libcrypto.so.3
#14 0x00007fbe5a8d93f2 in ?? () from /lib/libcrypto.so.3
#15 0x00007fbe5a8d952f in OSSL_DECODER_CTX_new_for_pkey () from /lib/libcrypto.so.3
#16 0x00007fbe5aa58c8c in ?? () from /lib/libcrypto.so.3
#17 0x00007fbe5a81fb0f in ?? () from /lib/libcrypto.so.3
#18 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#19 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#20 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#21 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#22 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#23 0x00007fbe5a8207e0 in ?? () from /lib/libcrypto.so.3
#24 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#25 0x00007fbe5a82029a in ?? () from /lib/libcrypto.so.3
#26 0x00007fbe5a820968 in ASN1_item_d2i_ex () from /lib/libcrypto.so.3
#27 0x00007fbe5abe0ccc in d2i_SSL_SESSION () from /lib/libssl.so.3
#28 0x000055acf0cb1e9b in ssl_sock_init (conn=0x7fbe0988ec40, xprt_ctx=0x7fbe0988ec60) at src/ssl_sock.c:5670
#29 0x000055acf0dc5817 in conn_prepare (xprt=<optimized out>, proto=<optimized out>, conn=<optimized out>) at include/haproxy/connection.h:284
#30 connect_server (s=0x7fbe09784f10) at src/backend.c:1630
#31 back_try_conn_req (s=s@entry=0x7fbe09784f10) at src/backend.c:1988
#32 0x000055acf0d503b8 in process_stream (t=<optimized out>, context=0x7fbe09784f10, state=<optimized out>) at src/stream.c:2339
#33 0x000055acf0e35bd5 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:632
#34 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#35 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#36 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#37 0x00007fbe5aca1bc2 in start (p=0x7fbe4f2b0090) at src/thread/pthread_create.c:207
#38 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 19 (LWP 2907 "haproxy"):
#0  __wake (priv=128, cnt=1, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:31
#1  __unlock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:59
#2  0x00007fbe5ac71b0a in unlock () at src/malloc/mallocng/glue.h:78
#3  __libc_free (p=<optimized out>) at src/malloc/mallocng/free.c:145
#4  0x00007fbe5a91a5a0 in ?? () from /lib/libcrypto.so.3
#5  0x00007fbe5aa793a5 in ?? () from /lib/libcrypto.so.3
#6  0x00007fbe5aa79860 in ?? () from /lib/libcrypto.so.3
#7  0x00007fbe5abfaa28 in ?? () from /lib/libssl.so.3
#8  0x00007fbe5abfad41 in ?? () from /lib/libssl.so.3
#9  0x00007fbe5ac069c0 in ?? () from /lib/libssl.so.3
#10 0x00007fbe5ac090ea in ?? () from /lib/libssl.so.3
#11 0x00007fbe5ac0677a in ?? () from /lib/libssl.so.3
#12 0x00007fbe5ac1044b in ?? () from /lib/libssl.so.3
#13 0x00007fbe5ac0f83f in ?? () from /lib/libssl.so.3
#14 0x000055acf0cace0a in ssl_sock_handshake (flag=134217728, conn=<optimized out>) at src/ssl_sock.c:5918
#15 ssl_sock_io_cb (t=0x7fbe2d11a700, context=0x7fbe2d0f4a30, state=<optimized out>) at src/ssl_sock.c:6253
#16 0x000055acf0e35a20 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:596
#17 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#18 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#19 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#20 0x00007fbe5aca1bc2 in start (p=0x7fbe4f2d5090) at src/thread/pthread_create.c:207
#21 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 18 (LWP 2906 "haproxy"):
#0  __wake (priv=128, cnt=1, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:31
#1  __unlock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:59
#2  0x00007fbe5ac727a5 in unlock () at src/malloc/mallocng/glue.h:78
#3  __libc_malloc_impl (n=16392) at src/malloc/mallocng/malloc.c:378
#4  0x000055acf0e4d215 in pool_alloc_area (size=<optimized out>) at include/haproxy/pool-os.h:37
#5  pool_get_from_os (pool=pool@entry=0x7fbe5a291440) at src/pool.c:377
#6  0x000055acf0e4d329 in pool_alloc_nocache (pool=pool@entry=0x7fbe5a291440) at src/pool.c:409
#7  0x000055acf0e4de44 in __pool_alloc (pool=0x7fbe5a291440, flags=flags@entry=5) at src/pool.c:779
#8  0x000055acf0e0a2dd in channel_alloc_buffer (wait=<optimized out>, chn=0x7fbe095422a0) at include/haproxy/channel.h:829
#9  sc_alloc_ibuf (wait=<optimized out>, sc=0x7fbe09640250) at include/haproxy/sc_strm.h:151
#10 sc_conn_recv (sc=sc@entry=0x7fbe09640250) at src/stconn.c:1312
#11 0x000055acf0e0a8ce in sc_conn_io_cb (t=0x7fbe09521c20, state=<optimized out>, ctx=0x7fbe09640250) at src/stconn.c:1837
#12 sc_conn_io_cb (t=0x7fbe09521c20, ctx=0x7fbe09640250, state=<optimized out>) at src/stconn.c:1826
#13 0x000055acf0e35a20 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:596
#14 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#15 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#16 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#17 0x00007fbe5aca1bc2 in start (p=0x7fbe4f2fa090) at src/thread/pthread_create.c:207
#18 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 17 (LWP 2905 "haproxy"):
#0  __wake (priv=128, cnt=1, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:31
#1  __unlock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:59
#2  0x00007fbe5ac71b0a in unlock () at src/malloc/mallocng/glue.h:78
#3  __libc_free (p=<optimized out>) at src/malloc/mallocng/free.c:145
#4  0x00007fbe5a821ae1 in ?? () from /lib/libcrypto.so.3
#5  0x00007fbe5a821bdd in ?? () from /lib/libcrypto.so.3
#6  0x00007fbe5a821aaa in ?? () from /lib/libcrypto.so.3
#7  0x00007fbe5a821b34 in ASN1_item_free () from /lib/libcrypto.so.3
#8  0x00007fbe5aa6f849 in ?? () from /lib/libcrypto.so.3
#9  0x00007fbe5a8d7de7 in ?? () from /lib/libcrypto.so.3
#10 0x00007fbe5a8d7f7b in OSSL_DECODER_from_bio () from /lib/libcrypto.so.3
#11 0x00007fbe5a8d8199 in OSSL_DECODER_from_data () from /lib/libcrypto.so.3
#12 0x00007fbe5aa58ca8 in ?? () from /lib/libcrypto.so.3
#13 0x00007fbe5a81fb0f in ?? () from /lib/libcrypto.so.3
#14 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#15 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#16 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#17 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#18 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#19 0x00007fbe5a8207e0 in ?? () from /lib/libcrypto.so.3
#20 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#21 0x00007fbe5a82029a in ?? () from /lib/libcrypto.so.3
#22 0x00007fbe5a820968 in ASN1_item_d2i_ex () from /lib/libcrypto.so.3
#23 0x00007fbe5abe0ccc in d2i_SSL_SESSION () from /lib/libssl.so.3
#24 0x000055acf0cb1e9b in ssl_sock_init (conn=0x7fbe09864980, xprt_ctx=0x7fbe098649a0) at src/ssl_sock.c:5670
#25 0x000055acf0dc5817 in conn_prepare (xprt=<optimized out>, proto=<optimized out>, conn=<optimized out>) at include/haproxy/connection.h:284
#26 connect_server (s=0x7fbe0964da20) at src/backend.c:1630
#27 back_try_conn_req (s=s@entry=0x7fbe0964da20) at src/backend.c:1988
#28 0x000055acf0d503b8 in process_stream (t=<optimized out>, context=0x7fbe0964da20, state=<optimized out>) at src/stream.c:2339
#29 0x000055acf0e35bd5 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:632
#30 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#31 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#32 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#33 0x00007fbe5aca1bc2 in start (p=0x7fbe4f31f090) at src/thread/pthread_create.c:207
#34 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 16 (LWP 2904 "haproxy"):
#0  __wake (priv=128, cnt=1, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:31
#1  __unlock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:59
#2  0x00007fbe5ac71b0a in unlock () at src/malloc/mallocng/glue.h:78
#3  __libc_free (p=p@entry=0x7fbe0951e150) at src/malloc/mallocng/free.c:145
#4  0x00007fbe5ac72e5b in __libc_realloc (p=0x7fbe0951e150, n=224) at src/malloc/mallocng/realloc.c:49
#5  0x00007fbe5aa2a370 in ?? () from /lib/libcrypto.so.3
#6  0x00007fbe5aa2a5f1 in OPENSSL_sk_insert () from /lib/libcrypto.so.3
#7  0x00007fbe5a8d7123 in ?? () from /lib/libcrypto.so.3
#8  0x00007fbe5a9eeae3 in ?? () from /lib/libcrypto.so.3
#9  0x00007fbe5a9220e4 in ?? () from /lib/libcrypto.so.3
#10 0x00007fbe5a9ef0d5 in ?? () from /lib/libcrypto.so.3
#11 0x00007fbe5a8d8c1a in OSSL_DECODER_do_all_provided () from /lib/libcrypto.so.3
#12 0x00007fbe5a8d77e1 in OSSL_DECODER_CTX_add_extra () from /lib/libcrypto.so.3
#13 0x00007fbe5a8d9543 in OSSL_DECODER_CTX_new_for_pkey () from /lib/libcrypto.so.3
#14 0x00007fbe5aa58c8c in ?? () from /lib/libcrypto.so.3
#15 0x00007fbe5a81fb0f in ?? () from /lib/libcrypto.so.3
#16 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#17 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#18 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#19 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#20 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#21 0x00007fbe5a8207e0 in ?? () from /lib/libcrypto.so.3
#22 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#23 0x00007fbe5a82029a in ?? () from /lib/libcrypto.so.3
#24 0x00007fbe5a820968 in ASN1_item_d2i_ex () from /lib/libcrypto.so.3
#25 0x00007fbe5abe0ccc in d2i_SSL_SESSION () from /lib/libssl.so.3
#26 0x000055acf0cb1e9b in ssl_sock_init (conn=0x7fbe0977b4d0, xprt_ctx=0x7fbe0977b4f0) at src/ssl_sock.c:5670
#27 0x000055acf0dc5817 in conn_prepare (xprt=<optimized out>, proto=<optimized out>, conn=<optimized out>) at include/haproxy/connection.h:284
#28 connect_server (s=0x7fbe09624a20) at src/backend.c:1630
#29 back_try_conn_req (s=s@entry=0x7fbe09624a20) at src/backend.c:1988
#30 0x000055acf0d503b8 in process_stream (t=<optimized out>, context=0x7fbe09624a20, state=<optimized out>) at src/stream.c:2339
#31 0x000055acf0e35bd5 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:632
#32 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#33 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#34 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#35 0x00007fbe5aca1bc2 in start (p=0x7fbe4f344090) at src/thread/pthread_create.c:207
#36 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 15 (LWP 2903 "haproxy"):
#0  __wake (priv=128, cnt=1, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:31
#1  __unlock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:59
#2  0x00007fbe5ac71b0a in unlock () at src/malloc/mallocng/glue.h:78
#3  __libc_free (p=<optimized out>) at src/malloc/mallocng/free.c:145
#4  0x00007fbe5a8dfe6e in ?? () from /lib/libcrypto.so.3
#5  0x00007fbe5a8e0bc6 in ERR_pop_to_mark () from /lib/libcrypto.so.3
#6  0x00007fbe5a91d5e6 in OSSL_PARAM_get_utf8_string_ptr () from /lib/libcrypto.so.3
#7  0x00007fbe5a8d7b58 in ?? () from /lib/libcrypto.so.3
#8  0x00007fbe5aa6f90c in ?? () from /lib/libcrypto.so.3
#9  0x00007fbe5a8d7de7 in ?? () from /lib/libcrypto.so.3
#10 0x00007fbe5a8d7f7b in OSSL_DECODER_from_bio () from /lib/libcrypto.so.3
#11 0x00007fbe5a8d8199 in OSSL_DECODER_from_data () from /lib/libcrypto.so.3
#12 0x00007fbe5aa58ca8 in ?? () from /lib/libcrypto.so.3
#13 0x00007fbe5a81fb0f in ?? () from /lib/libcrypto.so.3
#14 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#15 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#16 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#17 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#18 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#19 0x00007fbe5a8207e0 in ?? () from /lib/libcrypto.so.3
#20 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#21 0x00007fbe5a82029a in ?? () from /lib/libcrypto.so.3
#22 0x00007fbe5a820968 in ASN1_item_d2i_ex () from /lib/libcrypto.so.3
#23 0x00007fbe5abe0ccc in d2i_SSL_SESSION () from /lib/libssl.so.3
#24 0x000055acf0cb1e9b in ssl_sock_init (conn=0x7fbe09625980, xprt_ctx=0x7fbe096259a0) at src/ssl_sock.c:5670
#25 0x000055acf0dc5817 in conn_prepare (xprt=<optimized out>, proto=<optimized out>, conn=<optimized out>) at include/haproxy/connection.h:284
#26 connect_server (s=0x7fbe0961e000) at src/backend.c:1630
#27 back_try_conn_req (s=s@entry=0x7fbe0961e000) at src/backend.c:1988
#28 0x000055acf0d503b8 in process_stream (t=<optimized out>, context=0x7fbe0961e000, state=<optimized out>) at src/stream.c:2339
#29 0x000055acf0e35bd5 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:632
#30 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#31 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#32 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#33 0x00007fbe5aca1bc2 in start (p=0x7fbe4f369090) at src/thread/pthread_create.c:207
#34 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 14 (LWP 2902 "haproxy"):
#0  __wake (priv=128, cnt=1, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:31
#1  __unlock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:59
#2  0x00007fbe5ac727a5 in unlock () at src/malloc/mallocng/glue.h:78
#3  __libc_malloc_impl (n=n@entry=152) at src/malloc/mallocng/malloc.c:378
#4  0x00007fbe5ac72e2e in __libc_realloc (p=0x7fbe09639b90, n=152) at src/malloc/mallocng/realloc.c:46
#5  0x00007fbe5aa2a370 in ?? () from /lib/libcrypto.so.3
#6  0x00007fbe5aa2a5f1 in OPENSSL_sk_insert () from /lib/libcrypto.so.3
#7  0x00007fbe5abe90f3 in SSL_get1_supported_ciphers () from /lib/libssl.so.3
#8  0x00007fbe5ac06d7c in ?? () from /lib/libssl.so.3
#9  0x00007fbe5ac07377 in ?? () from /lib/libssl.so.3
#10 0x00007fbe5ac0677a in ?? () from /lib/libssl.so.3
#11 0x00007fbe5ac1044b in ?? () from /lib/libssl.so.3
#12 0x00007fbe5ac0f83f in ?? () from /lib/libssl.so.3
#13 0x000055acf0cace0a in ssl_sock_handshake (flag=134217728, conn=<optimized out>) at src/ssl_sock.c:5918
#14 ssl_sock_io_cb (t=0x7fbe2c2d2aa0, context=0x7fbe2c2cbd00, state=<optimized out>) at src/ssl_sock.c:6253
#15 0x000055acf0e35a20 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:596
#16 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#17 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#18 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#19 0x00007fbe5aca1bc2 in start (p=0x7fbe4f38e090) at src/thread/pthread_create.c:207
#20 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 13 (LWP 2901 "haproxy"):
#0  __futexwait (priv=128, val=-2147483612, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:40
#1  __lock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:44
#2  0x00007fbe5ac726c7 in rdlock () at src/malloc/mallocng/glue.h:70
#3  rdlock () at src/malloc/mallocng/glue.h:68
#4  __libc_malloc_impl (n=64) at src/malloc/mallocng/malloc.c:337
#5  0x000055acf0e4d215 in pool_alloc_area (size=<optimized out>) at include/haproxy/pool-os.h:37
#6  pool_get_from_os (pool=pool@entry=0x7fbe5a586200) at src/pool.c:377
#7  0x000055acf0e4d329 in pool_alloc_nocache (pool=pool@entry=0x7fbe5a586200) at src/pool.c:409
#8  0x000055acf0e4de44 in __pool_alloc (pool=0x7fbe5a586200, flags=flags@entry=0) at src/pool.c:779
#9  0x000055acf0e5eb2a in tasklet_new () at include/haproxy/task.h:530
#10 mux_pt_init (conn=0x7fbe2dc8a2f0, prx=<optimized out>, sess=0x7fbe095339d0, input=0x7fbe4f3b2de0) at src/mux_pt.c:293
#11 0x000055acf0dd8562 in conn_install_mux (sess=<optimized out>, prx=<optimized out>, ctx=0x0, mux=<optimized out>, conn=0x7fbe2dc8a2f0) at include/haproxy/connection.h:498
#12 conn_install_mux_fe (conn=conn@entry=0x7fbe2dc8a2f0, ctx=ctx@entry=0x0) at src/connection.c:247
#13 0x000055acf0e6d2de in conn_complete_session (conn=0x7fbe2dc8a2f0) at src/session.c:486
#14 0x000055acf0dd8d83 in conn_create_mux (conn=<optimized out>) at src/connection.c:97
#15 0x000055acf0e913f5 in xprt_handshake_io_cb (t=<optimized out>, bctx=0x7fbe09521700, state=<optimized out>) at src/xprt_handshake.c:118
#16 0x000055acf0e35a20 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:596
#17 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#18 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#19 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#20 0x00007fbe5aca1bc2 in start (p=0x7fbe4f3b3090) at src/thread/pthread_create.c:207
#21 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 12 (LWP 2900 "haproxy"):
#0  __futexwait (priv=128, val=-2147483611, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:40
#1  __lock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:44
#2  0x00007fbe5ac726c7 in rdlock () at src/malloc/mallocng/glue.h:70
#3  rdlock () at src/malloc/mallocng/glue.h:68
#4  __libc_malloc_impl (n=216) at src/malloc/mallocng/malloc.c:337
#5  0x00007fbe5a9185a2 in CRYPTO_zalloc () from /lib/libcrypto.so.3
#6  0x00007fbe5a8ea9de in ?? () from /lib/libcrypto.so.3
#7  0x00007fbe5ac0693b in ?? () from /lib/libssl.so.3
#8  0x00007fbe5ac090ea in ?? () from /lib/libssl.so.3
#9  0x00007fbe5ac0677a in ?? () from /lib/libssl.so.3
#10 0x00007fbe5ac1044b in ?? () from /lib/libssl.so.3
#11 0x00007fbe5ac0f83f in ?? () from /lib/libssl.so.3
#12 0x000055acf0cace0a in ssl_sock_handshake (flag=134217728, conn=<optimized out>) at src/ssl_sock.c:5918
#13 ssl_sock_io_cb (t=0x7fbe2ac28730, context=0x7fbe2acdbbe0, state=<optimized out>) at src/ssl_sock.c:6253
#14 0x000055acf0e35a20 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:596
#15 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#16 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#17 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#18 0x00007fbe5aca1bc2 in start (p=0x7fbe4f3d8090) at src/thread/pthread_create.c:207
#19 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 11 (LWP 2899 "haproxy"):
#0  __wake (priv=128, cnt=1, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:31
#1  __unlock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:59
#2  0x00007fbe5ac727a5 in unlock () at src/malloc/mallocng/glue.h:78
#3  __libc_malloc_impl (n=24) at src/malloc/mallocng/malloc.c:378
#4  0x00007fbe5a9185a2 in CRYPTO_zalloc () from /lib/libcrypto.so.3
#5  0x00007fbe5a817bee in ASN1_STRING_type_new () from /lib/libcrypto.so.3
#6  0x00007fbe5a821d75 in ?? () from /lib/libcrypto.so.3
#7  0x00007fbe5a821fb0 in ?? () from /lib/libcrypto.so.3
#8  0x00007fbe5a821edf in ?? () from /lib/libcrypto.so.3
#9  0x00007fbe5a8220f6 in ?? () from /lib/libcrypto.so.3
#10 0x00007fbe5a81fe62 in ?? () from /lib/libcrypto.so.3
#11 0x00007fbe5a82029a in ?? () from /lib/libcrypto.so.3
#12 0x00007fbe5a820968 in ASN1_item_d2i_ex () from /lib/libcrypto.so.3
#13 0x00007fbe5abe0ccc in d2i_SSL_SESSION () from /lib/libssl.so.3
#14 0x000055acf0cb1e9b in ssl_sock_init (conn=0x7fbe0977c3c0, xprt_ctx=0x7fbe0977c3e0) at src/ssl_sock.c:5670
#15 0x000055acf0dc5817 in conn_prepare (xprt=<optimized out>, proto=<optimized out>, conn=<optimized out>) at include/haproxy/connection.h:284
#16 connect_server (s=0x7fbe09747320) at src/backend.c:1630
#17 back_try_conn_req (s=s@entry=0x7fbe09747320) at src/backend.c:1988
#18 0x000055acf0d503b8 in process_stream (t=<optimized out>, context=0x7fbe09747320, state=<optimized out>) at src/stream.c:2339
#19 0x000055acf0e35bd5 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:632
#20 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#21 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#22 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#23 0x00007fbe5aca1bc2 in start (p=0x7fbe4f3fd090) at src/thread/pthread_create.c:207
#24 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 10 (LWP 2898 "haproxy"):
#0  __wake (priv=128, cnt=1, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:31
#1  __unlock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:59
#2  0x00007fbe5ac727a5 in unlock () at src/malloc/mallocng/glue.h:78
#3  __libc_malloc_impl (n=47) at src/malloc/mallocng/malloc.c:378
#4  0x00007fbe5a817ac4 in ASN1_STRING_set () from /lib/libcrypto.so.3
#5  0x00007fbe5a81f713 in ?? () from /lib/libcrypto.so.3
#6  0x00007fbe5a81fae2 in ?? () from /lib/libcrypto.so.3
#7  0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#8  0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#9  0x00007fbe5a8204df in ?? () from /lib/libcrypto.so.3
#10 0x00007fbe5a81f9bc in ?? () from /lib/libcrypto.so.3
#11 0x00007fbe5a8204df in ?? () from /lib/libcrypto.so.3
#12 0x00007fbe5a81f9bc in ?? () from /lib/libcrypto.so.3
#13 0x00007fbe5a82029a in ?? () from /lib/libcrypto.so.3
#14 0x00007fbe5a82091d in ASN1_item_ex_d2i () from /lib/libcrypto.so.3
#15 0x00007fbe5aa5841c in ?? () from /lib/libcrypto.so.3
#16 0x00007fbe5a81fb2f in ?? () from /lib/libcrypto.so.3
#17 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#18 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#19 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#20 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#21 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#22 0x00007fbe5a8207e0 in ?? () from /lib/libcrypto.so.3
#23 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#24 0x00007fbe5a82029a in ?? () from /lib/libcrypto.so.3
#25 0x00007fbe5a820968 in ASN1_item_d2i_ex () from /lib/libcrypto.so.3
#26 0x00007fbe5abe0ccc in d2i_SSL_SESSION () from /lib/libssl.so.3
#27 0x000055acf0cb1e9b in ssl_sock_init (conn=0x7fbe09549e30, xprt_ctx=0x7fbe09549e50) at src/ssl_sock.c:5670
#28 0x000055acf0dc5817 in conn_prepare (xprt=<optimized out>, proto=<optimized out>, conn=<optimized out>) at include/haproxy/connection.h:284
#29 connect_server (s=0x7fbe09611ef0) at src/backend.c:1630
#30 back_try_conn_req (s=s@entry=0x7fbe09611ef0) at src/backend.c:1988
#31 0x000055acf0d503b8 in process_stream (t=<optimized out>, context=0x7fbe09611ef0, state=<optimized out>) at src/stream.c:2339
#32 0x000055acf0e35bd5 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:632
#33 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#34 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#35 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#36 0x00007fbe5aca1bc2 in start (p=0x7fbe4f422090) at src/thread/pthread_create.c:207
#37 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 9 (LWP 2897 "haproxy"):
#0  __futexwait (priv=128, val=-2147483621, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:40
#1  __lock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:44
#2  0x00007fbe5ac71af2 in wrlock () at src/malloc/mallocng/glue.h:74
#3  __libc_free (p=<optimized out>) at src/malloc/mallocng/free.c:143
#4  0x00007fbe5a821ae1 in ?? () from /lib/libcrypto.so.3
#5  0x00007fbe5a821b34 in ASN1_item_free () from /lib/libcrypto.so.3
#6  0x00007fbe5aa5892c in ?? () from /lib/libcrypto.so.3
#7  0x00007fbe5a821b34 in ASN1_item_free () from /lib/libcrypto.so.3
#8  0x00007fbe5aa59415 in ?? () from /lib/libcrypto.so.3
#9  0x00007fbe5aa5964a in d2i_RSA_PUBKEY () from /lib/libcrypto.so.3
#10 0x00007fbe5aa6e228 in ?? () from /lib/libcrypto.so.3
#11 0x00007fbe5a8d7de7 in ?? () from /lib/libcrypto.so.3
#12 0x00007fbe5aa6f90c in ?? () from /lib/libcrypto.so.3
#13 0x00007fbe5a8d7de7 in ?? () from /lib/libcrypto.so.3
#14 0x00007fbe5a8d7f7b in OSSL_DECODER_from_bio () from /lib/libcrypto.so.3
#15 0x00007fbe5a8d8199 in OSSL_DECODER_from_data () from /lib/libcrypto.so.3
#16 0x00007fbe5aa58ca8 in ?? () from /lib/libcrypto.so.3
#17 0x00007fbe5a81fb0f in ?? () from /lib/libcrypto.so.3
#18 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#19 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#20 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#21 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#22 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#23 0x00007fbe5a8207e0 in ?? () from /lib/libcrypto.so.3
#24 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#25 0x00007fbe5a82029a in ?? () from /lib/libcrypto.so.3
#26 0x00007fbe5a820968 in ASN1_item_d2i_ex () from /lib/libcrypto.so.3
#27 0x00007fbe5abe0ccc in d2i_SSL_SESSION () from /lib/libssl.so.3
#28 0x000055acf0cb1e9b in ssl_sock_init (conn=0x7fbe0988e4d0, xprt_ctx=0x7fbe0988e4f0) at src/ssl_sock.c:5670
#29 0x000055acf0dc5817 in conn_prepare (xprt=<optimized out>, proto=<optimized out>, conn=<optimized out>) at include/haproxy/connection.h:284
#30 connect_server (s=0x7fbe0964a340) at src/backend.c:1630
#31 back_try_conn_req (s=s@entry=0x7fbe0964a340) at src/backend.c:1988
#32 0x000055acf0d503b8 in process_stream (t=<optimized out>, context=0x7fbe0964a340, state=<optimized out>) at src/stream.c:2339
#33 0x000055acf0e35bd5 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:632
#34 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#35 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#36 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#37 0x00007fbe5aca1bc2 in start (p=0x7fbe4f447090) at src/thread/pthread_create.c:207
#38 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 8 (LWP 2896 "haproxy"):
#0  __futexwait (priv=128, val=-2147483615, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:40
#1  __lock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:44
#2  0x00007fbe5ac726c7 in rdlock () at src/malloc/mallocng/glue.h:70
#3  rdlock () at src/malloc/mallocng/glue.h:68
#4  __libc_malloc_impl (n=56) at src/malloc/mallocng/malloc.c:337
#5  0x00007fbe5a9185a2 in CRYPTO_zalloc () from /lib/libcrypto.so.3
#6  0x00007fbe5a92239d in CRYPTO_THREAD_lock_new () from /lib/libcrypto.so.3
#7  0x00007fbe5a829c41 in BIO_new_ex () from /lib/libcrypto.so.3
#8  0x00007fbe5aa5b9f1 in ?? () from /lib/libcrypto.so.3
#9  0x00007fbe5aa76c36 in ?? () from /lib/libcrypto.so.3
#10 0x00007fbe5aa6e14e in ?? () from /lib/libcrypto.so.3
#11 0x00007fbe5a8d7de7 in ?? () from /lib/libcrypto.so.3
#12 0x00007fbe5aa6f90c in ?? () from /lib/libcrypto.so.3
#13 0x00007fbe5a8d7de7 in ?? () from /lib/libcrypto.so.3
#14 0x00007fbe5a8d7f7b in OSSL_DECODER_from_bio () from /lib/libcrypto.so.3
#15 0x00007fbe5a8d8199 in OSSL_DECODER_from_data () from /lib/libcrypto.so.3
#16 0x00007fbe5aa58ca8 in ?? () from /lib/libcrypto.so.3
#17 0x00007fbe5a81fb0f in ?? () from /lib/libcrypto.so.3
#18 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#19 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#20 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#21 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#22 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#23 0x00007fbe5a8207e0 in ?? () from /lib/libcrypto.so.3
#24 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#25 0x00007fbe5a82029a in ?? () from /lib/libcrypto.so.3
#26 0x00007fbe5a820968 in ASN1_item_d2i_ex () from /lib/libcrypto.so.3
#27 0x00007fbe5abe0ccc in d2i_SSL_SESSION () from /lib/libssl.so.3
#28 0x000055acf0cb1e9b in ssl_sock_init (conn=0x7fbe2c6f5c60, xprt_ctx=0x7fbe2c6f5c80) at src/ssl_sock.c:5670
#29 0x000055acf0dc5817 in conn_prepare (xprt=<optimized out>, proto=<optimized out>, conn=<optimized out>) at include/haproxy/connection.h:284
#30 connect_server (s=0x7fbe09acea40) at src/backend.c:1630
#31 back_try_conn_req (s=s@entry=0x7fbe09acea40) at src/backend.c:1988
#32 0x000055acf0d503b8 in process_stream (t=<optimized out>, context=0x7fbe09acea40, state=<optimized out>) at src/stream.c:2339
#33 0x000055acf0e35bd5 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:632
#34 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#35 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#36 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#37 0x00007fbe5aca1bc2 in start (p=0x7fbe4f46c090) at src/thread/pthread_create.c:207
#38 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 7 (LWP 2895 "haproxy"):
#0  __wake (priv=128, cnt=1, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:31
#1  __unlock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:59
#2  0x00007fbe5ac727a5 in unlock () at src/malloc/mallocng/glue.h:78
#3  __libc_malloc_impl (n=32) at src/malloc/mallocng/malloc.c:378
#4  0x00007fbe5a9185a2 in CRYPTO_zalloc () from /lib/libcrypto.so.3
#5  0x00007fbe5aa2a9ad in OPENSSL_sk_new_reserve () from /lib/libcrypto.so.3
#6  0x00007fbe5a8d9367 in ?? () from /lib/libcrypto.so.3
#7  0x00007fbe5a8d952f in OSSL_DECODER_CTX_new_for_pkey () from /lib/libcrypto.so.3
#8  0x00007fbe5aa58c8c in ?? () from /lib/libcrypto.so.3
#9  0x00007fbe5a81fb0f in ?? () from /lib/libcrypto.so.3
#10 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#11 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#12 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#13 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#14 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#15 0x00007fbe5a8207e0 in ?? () from /lib/libcrypto.so.3
#16 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#17 0x00007fbe5a82029a in ?? () from /lib/libcrypto.so.3
#18 0x00007fbe5a820968 in ASN1_item_d2i_ex () from /lib/libcrypto.so.3
#19 0x00007fbe5abe0ccc in d2i_SSL_SESSION () from /lib/libssl.so.3
#20 0x000055acf0cb1e9b in ssl_sock_init (conn=0x7fbe096537a0, xprt_ctx=0x7fbe096537c0) at src/ssl_sock.c:5670
#21 0x000055acf0dc5817 in conn_prepare (xprt=<optimized out>, proto=<optimized out>, conn=<optimized out>) at include/haproxy/connection.h:284
#22 connect_server (s=0x7fbe0985bc10) at src/backend.c:1630
#23 back_try_conn_req (s=s@entry=0x7fbe0985bc10) at src/backend.c:1988
#24 0x000055acf0d503b8 in process_stream (t=<optimized out>, context=0x7fbe0985bc10, state=<optimized out>) at src/stream.c:2339
#25 0x000055acf0e35bd5 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:632
#26 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#27 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#28 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#29 0x00007fbe5aca1bc2 in start (p=0x7fbe4f491090) at src/thread/pthread_create.c:207
#30 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 6 (LWP 2894 "haproxy"):
#0  __futexwait (priv=128, val=-2147483618, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:40
#1  __lock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:44
#2  0x00007fbe5ac726c7 in rdlock () at src/malloc/mallocng/glue.h:70
#3  rdlock () at src/malloc/mallocng/glue.h:68
#4  __libc_malloc_impl (n=16) at src/malloc/mallocng/malloc.c:337
#5  0x00007fbe5a821cee in ?? () from /lib/libcrypto.so.3
#6  0x00007fbe5a821fb0 in ?? () from /lib/libcrypto.so.3
#7  0x00007fbe5a82223c in ASN1_item_new () from /lib/libcrypto.so.3
#8  0x00007fbe5a81f4dc in ?? () from /lib/libcrypto.so.3
#9  0x00007fbe5a81fae2 in ?? () from /lib/libcrypto.so.3
#10 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#11 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#12 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#13 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#14 0x00007fbe5a82029a in ?? () from /lib/libcrypto.so.3
#15 0x00007fbe5a82091d in ASN1_item_ex_d2i () from /lib/libcrypto.so.3
#16 0x00007fbe5aa58ba7 in ?? () from /lib/libcrypto.so.3
#17 0x00007fbe5a81fb0f in ?? () from /lib/libcrypto.so.3
#18 0x00007fbe5a82029a in ?? () from /lib/libcrypto.so.3
#19 0x00007fbe5a820968 in ASN1_item_d2i_ex () from /lib/libcrypto.so.3
#20 0x00007fbe5aa593fa in ?? () from /lib/libcrypto.so.3
#21 0x00007fbe5aa5964a in d2i_RSA_PUBKEY () from /lib/libcrypto.so.3
#22 0x00007fbe5aa6e228 in ?? () from /lib/libcrypto.so.3
#23 0x00007fbe5a8d7de7 in ?? () from /lib/libcrypto.so.3
#24 0x00007fbe5aa6f90c in ?? () from /lib/libcrypto.so.3
#25 0x00007fbe5a8d7de7 in ?? () from /lib/libcrypto.so.3
#26 0x00007fbe5a8d7f7b in OSSL_DECODER_from_bio () from /lib/libcrypto.so.3
#27 0x00007fbe5a8d8199 in OSSL_DECODER_from_data () from /lib/libcrypto.so.3
#28 0x00007fbe5aa58ca8 in ?? () from /lib/libcrypto.so.3
#29 0x00007fbe5a81fb0f in ?? () from /lib/libcrypto.so.3
#30 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#31 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#32 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#33 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#34 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#35 0x00007fbe5a8207e0 in ?? () from /lib/libcrypto.so.3
#36 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#37 0x00007fbe5a82029a in ?? () from /lib/libcrypto.so.3
#38 0x00007fbe5a820968 in ASN1_item_d2i_ex () from /lib/libcrypto.so.3
#39 0x00007fbe5abe0ccc in d2i_SSL_SESSION () from /lib/libssl.so.3
#40 0x000055acf0cb1e9b in ssl_sock_init (conn=0x7fbe09652300, xprt_ctx=0x7fbe09652320) at src/ssl_sock.c:5670
#41 0x000055acf0dc5817 in conn_prepare (xprt=<optimized out>, proto=<optimized out>, conn=<optimized out>) at include/haproxy/connection.h:284
#42 connect_server (s=0x7fbe098732c0) at src/backend.c:1630
#43 back_try_conn_req (s=s@entry=0x7fbe098732c0) at src/backend.c:1988
#44 0x000055acf0d503b8 in process_stream (t=<optimized out>, context=0x7fbe098732c0, state=<optimized out>) at src/stream.c:2339
#45 0x000055acf0e35bd5 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:632
#46 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#47 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#48 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#49 0x00007fbe5aca1bc2 in start (p=0x7fbe4f8d7090) at src/thread/pthread_create.c:207
#50 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 5 (LWP 2893 "haproxy"):
#0  __futexwait (priv=128, val=-2147483620, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:40
#1  __lock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:44
#2  0x00007fbe5ac726c7 in rdlock () at src/malloc/mallocng/glue.h:70
#3  rdlock () at src/malloc/mallocng/glue.h:68
#4  __libc_malloc_impl (n=136) at src/malloc/mallocng/malloc.c:337
#5  0x00007fbe5a9185a2 in CRYPTO_zalloc () from /lib/libcrypto.so.3
#6  0x00007fbe5a829bd1 in BIO_new_ex () from /lib/libcrypto.so.3
#7  0x00007fbe5a83187c in BIO_new_mem_buf () from /lib/libcrypto.so.3
#8  0x00007fbe5a8d7b04 in ?? () from /lib/libcrypto.so.3
#9  0x00007fbe5aa6f90c in ?? () from /lib/libcrypto.so.3
#10 0x00007fbe5a8d7de7 in ?? () from /lib/libcrypto.so.3
#11 0x00007fbe5a8d7f7b in OSSL_DECODER_from_bio () from /lib/libcrypto.so.3
#12 0x00007fbe5a8d8199 in OSSL_DECODER_from_data () from /lib/libcrypto.so.3
#13 0x00007fbe5aa58ca8 in ?? () from /lib/libcrypto.so.3
#14 0x00007fbe5a81fb0f in ?? () from /lib/libcrypto.so.3
#15 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#16 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#17 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#18 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#19 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#20 0x00007fbe5a8207e0 in ?? () from /lib/libcrypto.so.3
#21 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#22 0x00007fbe5a82029a in ?? () from /lib/libcrypto.so.3
#23 0x00007fbe5a820968 in ASN1_item_d2i_ex () from /lib/libcrypto.so.3
#24 0x00007fbe5abe0ccc in d2i_SSL_SESSION () from /lib/libssl.so.3
#25 0x000055acf0cb1e9b in ssl_sock_init (conn=0x7fbe09653a70, xprt_ctx=0x7fbe09653a90) at src/ssl_sock.c:5670
#26 0x000055acf0dc5817 in conn_prepare (xprt=<optimized out>, proto=<optimized out>, conn=<optimized out>) at include/haproxy/connection.h:284
#27 connect_server (s=0x7fbe09d93b40) at src/backend.c:1630
#28 back_try_conn_req (s=s@entry=0x7fbe09d93b40) at src/backend.c:1988
#29 0x000055acf0d503b8 in process_stream (t=<optimized out>, context=0x7fbe09d93b40, state=<optimized out>) at src/stream.c:2339
#30 0x000055acf0e35bd5 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:632
#31 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#32 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#33 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#34 0x00007fbe5aca1bc2 in start (p=0x7fbe4f90d090) at src/thread/pthread_create.c:207
#35 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 4 (LWP 2892 "haproxy"):
#0  __wake (priv=128, cnt=1, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:31
#1  __unlock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:59
#2  0x00007fbe5ac727a5 in unlock () at src/malloc/mallocng/glue.h:78
#3  __libc_malloc_impl (n=32) at src/malloc/mallocng/malloc.c:378
#4  0x00007fbe5a9185a2 in CRYPTO_zalloc () from /lib/libcrypto.so.3
#5  0x00007fbe5aa2a2d6 in ?? () from /lib/libcrypto.so.3
#6  0x00007fbe5aa2a5f1 in OPENSSL_sk_insert () from /lib/libcrypto.so.3
#7  0x00007fbe5a820528 in ?? () from /lib/libcrypto.so.3
#8  0x00007fbe5a81f9bc in ?? () from /lib/libcrypto.so.3
#9  0x00007fbe5a8204df in ?? () from /lib/libcrypto.so.3
#10 0x00007fbe5a81f9bc in ?? () from /lib/libcrypto.so.3
#11 0x00007fbe5a82029a in ?? () from /lib/libcrypto.so.3
#12 0x00007fbe5a82091d in ASN1_item_ex_d2i () from /lib/libcrypto.so.3
#13 0x00007fbe5aa5841c in ?? () from /lib/libcrypto.so.3
#14 0x00007fbe5a81fb2f in ?? () from /lib/libcrypto.so.3
#15 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#16 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#17 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#18 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#19 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#20 0x00007fbe5a8207e0 in ?? () from /lib/libcrypto.so.3
#21 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#22 0x00007fbe5a82029a in ?? () from /lib/libcrypto.so.3
#23 0x00007fbe5a820968 in ASN1_item_d2i_ex () from /lib/libcrypto.so.3
#24 0x00007fbe5abe0ccc in d2i_SSL_SESSION () from /lib/libssl.so.3
#25 0x000055acf0cb1e9b in ssl_sock_init (conn=0x7fbe0954a6b0, xprt_ctx=0x7fbe0954a6d0) at src/ssl_sock.c:5670
#26 0x000055acf0dc5817 in conn_prepare (xprt=<optimized out>, proto=<optimized out>, conn=<optimized out>) at include/haproxy/connection.h:284
#27 connect_server (s=0x7fbe09614a60) at src/backend.c:1630
#28 back_try_conn_req (s=s@entry=0x7fbe09614a60) at src/backend.c:1988
#29 0x000055acf0d503b8 in process_stream (t=<optimized out>, context=0x7fbe09614a60, state=<optimized out>) at src/stream.c:2339
#30 0x000055acf0e35bd5 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:632
#31 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#32 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#33 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#34 0x00007fbe5aca1bc2 in start (p=0x7fbe4f932090) at src/thread/pthread_create.c:207
#35 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 3 (LWP 2891 "haproxy"):
#0  __futexwait (priv=128, val=-2147483611, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:40
#1  __lock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:44
#2  0x00007fbe5ac726c7 in rdlock () at src/malloc/mallocng/glue.h:70
#3  rdlock () at src/malloc/mallocng/glue.h:68
#4  __libc_malloc_impl (n=8) at src/malloc/mallocng/malloc.c:337
#5  0x00007fbe5a817ac4 in ASN1_STRING_set () from /lib/libcrypto.so.3
#6  0x00007fbe5a81f713 in ?? () from /lib/libcrypto.so.3
#7  0x00007fbe5a81fae2 in ?? () from /lib/libcrypto.so.3
#8  0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#9  0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#10 0x00007fbe5a8204df in ?? () from /lib/libcrypto.so.3
#11 0x00007fbe5a81f9bc in ?? () from /lib/libcrypto.so.3
#12 0x00007fbe5a8204df in ?? () from /lib/libcrypto.so.3
#13 0x00007fbe5a81f9bc in ?? () from /lib/libcrypto.so.3
#14 0x00007fbe5a82029a in ?? () from /lib/libcrypto.so.3
#15 0x00007fbe5a82091d in ASN1_item_ex_d2i () from /lib/libcrypto.so.3
#16 0x00007fbe5aa5841c in ?? () from /lib/libcrypto.so.3
#17 0x00007fbe5a81fb2f in ?? () from /lib/libcrypto.so.3
#18 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#19 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#20 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#21 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#22 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#23 0x00007fbe5a8207e0 in ?? () from /lib/libcrypto.so.3
#24 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#25 0x00007fbe5a82029a in ?? () from /lib/libcrypto.so.3
#26 0x00007fbe5a820968 in ASN1_item_d2i_ex () from /lib/libcrypto.so.3
#27 0x00007fbe5abe0ccc in d2i_SSL_SESSION () from /lib/libssl.so.3
#28 0x000055acf0cb1e9b in ssl_sock_init (conn=0x7fbe0954a2e0, xprt_ctx=0x7fbe0954a300) at src/ssl_sock.c:5670
#29 0x000055acf0dc5817 in conn_prepare (xprt=<optimized out>, proto=<optimized out>, conn=<optimized out>) at include/haproxy/connection.h:284
#30 connect_server (s=0x7fbe0953cbe0) at src/backend.c:1630
#31 back_try_conn_req (s=s@entry=0x7fbe0953cbe0) at src/backend.c:1988
#32 0x000055acf0d503b8 in process_stream (t=<optimized out>, context=0x7fbe0953cbe0, state=<optimized out>) at src/stream.c:2339
#33 0x000055acf0e35bd5 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:632
#34 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#35 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#36 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#37 0x00007fbe5aca1bc2 in start (p=0x7fbe4f957090) at src/thread/pthread_create.c:207
#38 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 2 (LWP 2890 "haproxy"):
#0  __wake (priv=128, cnt=1, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:31
#1  __unlock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:59
#2  0x00007fbe5ac727a5 in unlock () at src/malloc/mallocng/glue.h:78
#3  __libc_malloc_impl (n=32) at src/malloc/mallocng/malloc.c:378
#4  0x00007fbe5aa2a765 in OPENSSL_sk_dup () from /lib/libcrypto.so.3
#5  0x00007fbe5a9213e8 in ?? () from /lib/libcrypto.so.3
#6  0x00007fbe5a915600 in ?? () from /lib/libcrypto.so.3
#7  0x00007fbe5a9158d8 in ?? () from /lib/libcrypto.so.3
#8  0x00007fbe5a8fb04d in ?? () from /lib/libcrypto.so.3
#9  0x00007fbe5a8fb68b in ?? () from /lib/libcrypto.so.3
#10 0x00007fbe5a901fad in EVP_KEYMGMT_do_all_provided () from /lib/libcrypto.so.3
#11 0x00007fbe5a8d93d8 in ?? () from /lib/libcrypto.so.3
#12 0x00007fbe5a8d952f in OSSL_DECODER_CTX_new_for_pkey () from /lib/libcrypto.so.3
#13 0x00007fbe5aa58c8c in ?? () from /lib/libcrypto.so.3
#14 0x00007fbe5a81fb0f in ?? () from /lib/libcrypto.so.3
#15 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#16 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#17 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#18 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#19 0x00007fbe5a82065d in ?? () from /lib/libcrypto.so.3
#20 0x00007fbe5a8207e0 in ?? () from /lib/libcrypto.so.3
#21 0x00007fbe5a82000c in ?? () from /lib/libcrypto.so.3
#22 0x00007fbe5a82029a in ?? () from /lib/libcrypto.so.3
#23 0x00007fbe5a820968 in ASN1_item_d2i_ex () from /lib/libcrypto.so.3
#24 0x00007fbe5abe0ccc in d2i_SSL_SESSION () from /lib/libssl.so.3
#25 0x000055acf0cb1e9b in ssl_sock_init (conn=0x7fbe098684c0, xprt_ctx=0x7fbe098684e0) at src/ssl_sock.c:5670
#26 0x000055acf0dc5817 in conn_prepare (xprt=<optimized out>, proto=<optimized out>, conn=<optimized out>) at include/haproxy/connection.h:284
#27 connect_server (s=0x7fbe0992a7a0) at src/backend.c:1630
#28 back_try_conn_req (s=s@entry=0x7fbe0992a7a0) at src/backend.c:1988
#29 0x000055acf0d503b8 in process_stream (t=<optimized out>, context=0x7fbe0992a7a0, state=<optimized out>) at src/stream.c:2339
#30 0x000055acf0e35bd5 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:632
#31 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#32 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#33 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#34 0x00007fbe5aca1bc2 in start (p=0x7fbe4f97c090) at src/thread/pthread_create.c:207
#35 0x00007fbe5aca3f30 in __clone () at src/thread/x86_64/clone.s:22
Backtrace stopped: frame did not save the PC

Thread 1 (LWP 2888 "haproxy"):
#0  __wake (priv=128, cnt=1, addr=0x7fbe5ace5fe0 <__malloc_lock>) at ./arch/x86_64/syscall_arch.h:31
#1  __unlock (l=l@entry=0x7fbe5ace5fe0 <__malloc_lock>) at src/thread/__lock.c:59
#2  0x00007fbe5ac727a5 in unlock () at src/malloc/mallocng/glue.h:78
#3  __libc_malloc_impl (n=40) at src/malloc/mallocng/malloc.c:378
#4  0x00007fbe5a9185a2 in CRYPTO_zalloc () from /lib/libcrypto.so.3
#5  0x00007fbe5a91a407 in ?? () from /lib/libcrypto.so.3
#6  0x00007fbe5aa79370 in ?? () from /lib/libcrypto.so.3
#7  0x00007fbe5aa79860 in ?? () from /lib/libcrypto.so.3
#8  0x00007fbe5abfaa28 in ?? () from /lib/libssl.so.3
#9  0x00007fbe5abfab11 in ?? () from /lib/libssl.so.3
#10 0x00007fbe5abfac7e in ?? () from /lib/libssl.so.3
#11 0x00007fbe5abfb999 in ?? () from /lib/libssl.so.3
#12 0x00007fbe5ac1aac7 in ?? () from /lib/libssl.so.3
#13 0x00007fbe5ac0f2c4 in ?? () from /lib/libssl.so.3
#14 0x000055acf0cace0a in ssl_sock_handshake (flag=134217728, conn=<optimized out>) at src/ssl_sock.c:5918
#15 ssl_sock_io_cb (t=0x7fbe3dd05840, context=0x7fbe35c4b6d0, state=<optimized out>) at src/ssl_sock.c:6253
#16 0x000055acf0e35a20 in run_tasks_from_lists (budgets=<optimized out>) at src/task.c:596
#17 0x000055acf0e36503 in process_runnable_tasks () at src/task.c:876
#18 0x000055acf0e01e8c in run_poll_loop () at src/haproxy.c:2968
#19 0x000055acf0e024c9 in run_thread_poll_loop (data=<optimized out>) at src/haproxy.c:3167
#20 0x000055acf0ca36bb in main (argc=<optimized out>, argv=<optimized out>) at src/haproxy.c:3838
Darlelet commented 1 month ago

Thanks for the report

I see that you're running 2.8.1 which is affected by numerous bugs: http://www.haproxy.org/bugs/bugs-2.8.1.html

Please try 2.8.10 version to see if the issue persists or if it was due to a bug which was already fixed.

Thanks

wtarreau commented 1 month ago

Unfortunately, that's well known, it's the terribly bad work done on OpenSSL 3.x that strikes again. It's widely documented on OpenSSL's issue tracker, see issues 17064, 17627 or 20286 to get an idea, where people experience ratios of 80:1 between 1.1.1 and 3.x... We're currently working on measuring the impacts of the different versions up to 3.4-dev and it's still not quite bright. What I can advise at the moment:

delthas commented 1 month ago

Hi,

OK thanks. It does look very similar to your previous comment on https://github.com/openssl/openssl/issues/20286#issuecomment-1438826816

Also documented in the install manual actually https://github.com/haproxy/haproxy/blob/master/INSTALL#L234

I'll try using OpenSSL 1.1.1 first. Apparently this only requires setting SSL_INC and SSL_LIB.

delthas commented 1 month ago

OK yeah that was it. Now getting ~60% CPU usage on one thread instead of 100% CPU usage on 64 threads, so that's a x100 speed improvement. No more weird futex calls everywhere.

I'd stumbled upon your comments on OpenSSL 3 performance before, but I didn't really believe the performance to be indeed that bad until now :grinning:

Thanks.

wtarreau commented 1 month ago

Yes, we're expecting that more and more users are going to get caught by this mess over time, that's a totally weird situation. The only library offering long term support is totally broken and unusable and the working alternatives don't provide long term support. It really feels like all that's needed now is one of these alternatives to start to provide long term support so that we can say byebye to openssl that's gone too far in the wrong direction and doesn't seem able to get back to a correct situation after 4 versions.

wtarreau commented 1 month ago

Yes, we're expecting that more and more users are going to get caught by this mess over time, that's a totally weird situation. The only library offering long term support is totally broken and unusable and the working alternatives don't provide long term support. It really feels like all that's needed now is one of these alternatives to start to provide long term support so that we can say byebye to openssl that's gone too far in the wrong direction and doesn't seem able to get back to a correct situation after 4 versions.

chipitsine commented 1 month ago

just a quick question, is that mess happen on "multi-thread" model ? or "multi-process" suffers as well ?

wtarreau commented 1 month ago

It's essentially on multi-thread since it's related to how long some tiny code parts that are used thousands of times per connection remain locked, causing a huge serialization. But to be clear, these operations are not free, and even a single-threaded process has to experience their cost (albeit with no contention). This is particularly visible when you compare the performance of wolfssl (lockless) and openssl in client mode. I'm used to building h1load with wolfssl simply because it's much faster.