CI Failure (segfault) in `crypto_bench_rpbench`

[BenPope]

https://buildkite.com/redpanda/redpanda/builds/50347#0190267e-6e4f-44e6-833b-41d81908ef17

openssl_perf.hmac_sha256_1k   228352000     4.398ns     0.001ns     4.397ns     4.406ns       0.015       0.000        45.3
INFO  2024-06-17 16:58:23,425 [shard 0:main] ossl-library-context-service - ossl_context_service.cc:254 - OpenSSL Context loaded and ready
Segmentation fault on shard 0.
Backtrace:
  0x2e32b3
  0x33692a
  /lib64/libc.so.6+0x4070f
  /vectorized/lib64/libcrypto.so.3+0x212999
  /vectorized/lib64/libcrypto.so.3+0x212eae
  /vectorized/lib64/libcrypto.so.3+0x1ec24e
  /vectorized/lib64/libcrypto.so.3+0x1d5129
  /vectorized/lib64/libcrypto.so.3+0x2d6edc
  /vectorized/lib64/libcrypto.so.3+0x2d6fd2
  /vectorized/lib64/libcrypto.so.3+0x316851
  /vectorized/lib64/libcrypto.so.3+0x316a1a
  0x1b8648
  0x1bbc35
  0x1708d8
  0x17a62f
  0x2db94f
  0x2df071
  0x2dc236
  0x20d480
  0x20eab3
  0x1796f0
  /lib64/libc.so.6+0x2a087
  /lib64/libc.so.6+0x2a14a
  0x146ca4
Test Exit code 139
Decoded a Seastar backtrace:
[Backtrace #0]
void seastar::backtrace<seastar::backtrace_buffer::append_backtrace()::{lambda(seastar::frame)#1}>(seastar::backtrace_buffer::append_backtrace()::{lambda(seastar::frame)#1}&&) at /v/build/v_deps_build/seastar-prefix/src/seastar/include/seastar/util/backtrace.hh:68
 (inlined by) seastar::backtrace_buffer::append_backtrace() at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/reactor.cc:830
 (inlined by) seastar::print_with_backtrace(seastar::backtrace_buffer&, bool) at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/reactor.cc:860
 (inlined by) seastar::print_with_backtrace(char const*, bool) at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/reactor.cc:872
[Backtrace #1]
seastar::sigsegv_action() at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/reactor.cc:4194
 (inlined by) seastar::install_oneshot_signal_handler<11, (void (*)())(&seastar::sigsegv_action)>()::{lambda(int, siginfo_t*, void*)#1}::operator()(int, siginfo_t*, void*) const at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/reactor.cc:4175
 (inlined by) seastar::install_oneshot_signal_handler<11, (void (*)())(&seastar::sigsegv_action)>()::{lambda(int, siginfo_t*, void*)#1}::__invoke(int, siginfo_t*, void*) at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/reactor.cc:4171
[Backtrace #2]
/lib64/libc.so.6: ELF 64-bit LSB shared object, x86-64, version 1 (GNU/Linux), dynamically linked, interpreter /lib64/ld-linux-x86-64.so.2, BuildID[sha1]=341d2be28035b1c2546e062799b0e8598dd1d726, for GNU/Linux 3.2.0, not stripped
__GI___sigaction at :?
[Backtrace #3]
/vectorized/lib64/libcrypto.so.3: ELF 64-bit LSB shared object, x86-64, version 1 (SYSV), dynamically linked, BuildID[sha1]=76e31200ea1f23bc92917b9aca2ce30385da8957, not stripped
ossl_namemap_empty at :?
[Backtrace #4]
ossl_namemap_stored at :?
[Backtrace #5]
evp_generic_fetch at :?
[Backtrace #6]
EVP_MD_fetch at ??:?
[Backtrace #7]
ossl_prov_digest_fetch at :?
[Backtrace #8]
ossl_prov_digest_load_from_params at :?
[Backtrace #9]
hmac_set_ctx_params at hmac_prov.c:?
[Backtrace #10]
hmac_init at hmac_prov.c:?
[Backtrace #11]
crypto::hmac_ctx::impl::impl(crypto::digest_type, std::__1::basic_string_view<unsigned char, std::__1::char_traits<unsigned char> >) at /var/lib/buildkite-agent/builds/buildkite-amd64-builders-i-0d3c886432654180f-1/redpanda/redpanda/src/v/crypto/hmac.cc:56
 (inlined by) std::__1::__unique_if<crypto::hmac_ctx::impl>::__unique_single std::__1::make_unique[abi:v160004]<crypto::hmac_ctx::impl, crypto::digest_type&, std::__1::basic_string_view<unsigned char, std::__1::char_traits<unsigned char> > >(crypto::digest_type&, std::__1::basic_string_view<unsigned char, std::__1::char_traits<unsigned char> >&&) at /vectorized/llvm/bin/../include/c++/v1/__memory/unique_ptr.h:686
 (inlined by) crypto::hmac_ctx::hmac_ctx(crypto::digest_type, std::__1::basic_string_view<char, std::__1::char_traits<char> >) at /var/lib/buildkite-agent/builds/buildkite-amd64-builders-i-0d3c886432654180f-1/redpanda/redpanda/src/v/crypto/hmac.cc:135
[Backtrace #12]
crypto::hmac(crypto::digest_type, std::__1::basic_string_view<char, std::__1::char_traits<char> >, std::__1::basic_string_view<char, std::__1::char_traits<char> >) at /var/lib/buildkite-agent/builds/buildkite-amd64-builders-i-0d3c886432654180f-1/redpanda/redpanda/src/v/crypto/hmac.cc:186
[Backtrace #13]
test_openssl_perf_hmac_sha512_1k::run()::{lambda(seastar::basic_sstring<char, unsigned int, 15u, true> const&)#1}::operator()(seastar::basic_sstring<char, unsigned int, 15u, true> const&) const at /var/lib/buildkite-agent/builds/buildkite-amd64-builders-i-0d3c886432654180f-1/redpanda/redpanda/src/v/crypto/tests/crypto_bench.cc:246
 (inlined by) unsigned long test_body<test_openssl_perf_hmac_sha512_1k::run()::{lambda(seastar::basic_sstring<char, unsigned int, 15u, true> const&)#1}>(unsigned long, test_openssl_perf_hmac_sha512_1k::run()::{lambda(seastar::basic_sstring<char, unsigned int, 15u, true> const&)#1}) at /var/lib/buildkite-agent/builds/buildkite-amd64-builders-i-0d3c886432654180f-1/redpanda/redpanda/src/v/crypto/tests/crypto_bench.cc:147
 (inlined by) test_openssl_perf_hmac_sha512_1k::run() at /var/lib/buildkite-agent/builds/buildkite-amd64-builders-i-0d3c886432654180f-1/redpanda/redpanda/src/v/crypto/tests/crypto_bench.cc:244
 (inlined by) auto perf_tests::internal::concrete_performance_test<test_openssl_perf_hmac_sha512_1k>::run_test<int&>(int&) at /vectorized/include/seastar/testing/perf_tests.hh:249
 (inlined by) auto perf_tests::internal::concrete_performance_test<test_openssl_perf_hmac_sha512_1k>::do_single_run()::{lambda((auto:1&&)...)#2}::operator()<int>(int&&) const::{lambda((auto:1&&)...)#2}::operator()<int>(int&&) const at /vectorized/include/seastar/testing/perf_tests.hh:292
 (inlined by) perf_tests::internal::(anonymous namespace)::do_if_constexpr_<false, perf_tests::internal::concrete_performance_test<test_openssl_perf_hmac_sha512_1k>::do_single_run()::{lambda((auto:1&&)...)#2}::operator()<int>(int&&) const::{lambda((auto:1&&)...)#1}, perf_tests::internal::concrete_performance_test<test_openssl_perf_hmac_sha512_1k>::do_single_run()::{lambda((auto:1&&)...)#2}::operator()<int>(int&&) const::{lambda((auto:1&&)...)#2}>::operator()() const at /vectorized/include/seastar/testing/perf_tests.hh:225
 (inlined by) auto perf_tests::internal::concrete_performance_test<test_openssl_perf_hmac_sha512_1k>::do_single_run()::{lambda((auto:1&&)...)#2}::operator()<int>(int&&) const at /vectorized/include/seastar/testing/perf_tests.hh:286
 (inlined by) perf_tests::internal::(anonymous namespace)::do_if_constexpr_<false, perf_tests::internal::concrete_performance_test<test_openssl_perf_hmac_sha512_1k>::do_single_run()::{lambda((auto:1&&)...)#1}, perf_tests::internal::concrete_performance_test<test_openssl_perf_hmac_sha512_1k>::do_single_run()::{lambda((auto:1&&)...)#2}>::operator()() const at /vectorized/include/seastar/testing/perf_tests.hh:225
 (inlined by) perf_tests::internal::concrete_performance_test<test_openssl_perf_hmac_sha512_1k>::do_single_run() at /vectorized/include/seastar/testing/perf_tests.hh:265
[Backtrace #14]
perf_tests::internal::performance_test::do_run(perf_tests::internal::config const&)::$_0::operator()() const at /v/build/v_deps_build/seastar-prefix/src/seastar/tests/perf/perf_tests.cc:305
 (inlined by) decltype (((std::declval<perf_tests::internal::performance_test::do_run(perf_tests::internal::config const&)::$_0&>)())()) std::__1::__invoke[abi:v160004]<perf_tests::internal::performance_test::do_run(perf_tests::internal::config const&)::$_0&>(perf_tests::internal::performance_test::do_run(perf_tests::internal::config const&)::$_0&) at /vectorized/llvm/bin/../include/c++/v1/__functional/invoke.h:394
 (inlined by) std::__1::invoke_result<perf_tests::internal::performance_test::do_run(perf_tests::internal::config const&)::$_0&>::type std::__1::invoke[abi:v160004]<perf_tests::internal::performance_test::do_run(perf_tests::internal::config const&)::$_0&>(perf_tests::internal::performance_test::do_run(perf_tests::internal::config const&)::$_0&) at /vectorized/llvm/bin/../include/c++/v1/__functional/invoke.h:539
 (inlined by) auto seastar::internal::future_invoke<perf_tests::internal::performance_test::do_run(perf_tests::internal::config const&)::$_0&, seastar::internal::monostate>(perf_tests::internal::performance_test::do_run(perf_tests::internal::config const&)::$_0&, seastar::internal::monostate&&) at /v/build/v_deps_build/seastar-prefix/src/seastar/include/seastar/core/future.hh:1172
 (inlined by) seastar::future<void>::then_impl_nrvo<perf_tests::internal::performance_test::do_run(perf_tests::internal::config const&)::$_0, seastar::future<perf_tests::internal::performance_test::run_result> >(perf_tests::internal::performance_test::do_run(perf_tests::internal::config const&)::$_0&&)::{lambda(seastar::internal::promise_base_with_type<perf_tests::internal::performance_test::run_result>&&, perf_tests::internal::performance_test::do_run(perf_tests::internal::config const&)::$_0&, seastar::future_state<seastar::internal::monostate>&&)#1}::operator()(seastar::internal::promise_base_with_type<perf_tests::internal::performance_test::run_result>&&, perf_tests::internal::performance_test::do_run(perf_tests::internal::config const&)::$_0&, seastar::future_state<seastar::internal::monostate>&&) const::{lambda()#1}::operator()() const at /v/build/v_deps_build/seastar-prefix/src/seastar/include/seastar/core/future.hh:1475
 (inlined by) void seastar::futurize<seastar::future<perf_tests::internal::performance_test::run_result> >::satisfy_with_result_of<seastar::future<void>::then_impl_nrvo<perf_tests::internal::performance_test::do_run(perf_tests::internal::config const&)::$_0, seastar::future<perf_tests::internal::performance_test::run_result> >(perf_tests::internal::performance_test::do_run(perf_tests::internal::config const&)::$_0&&)::{lambda(seastar::internal::promise_base_with_type<perf_tests::internal::performance_test::run_result>&&, perf_tests::internal::performance_test::do_run(perf_tests::internal::config const&)::$_0&, seastar::future_state<seastar::internal::monostate>&&)#1}::operator()(seastar::internal::promise_base_with_type<perf_tests::internal::performance_test::run_result>&&, perf_tests::internal::performance_test::do_run(perf_tests::internal::config const&)::$_0&, seastar::future_state<seastar::internal::monostate>&&) const::{lambda()#1}>(seastar::internal::promise_base_with_type<perf_tests::internal::performance_test::run_result>&&, perf_tests::internal::performance_test::do_run(perf_tests::internal::config const&)::$_0&&) at /v/build/v_deps_build/seastar-prefix/src/seastar/include/seastar/core/future.hh:2007
 (inlined by) seastar::future<void>::then_impl_nrvo<perf_tests::internal::performance_test::do_run(perf_tests::internal::config const&)::$_0, seastar::future<perf_tests::internal::performance_test::run_result> >(perf_tests::internal::performance_test::do_run(perf_tests::internal::config const&)::$_0&&)::{lambda(seastar::internal::promise_base_with_type<perf_tests::internal::performance_test::run_result>&&, perf_tests::internal::performance_test::do_run(perf_tests::internal::config const&)::$_0&, seastar::future_state<seastar::internal::monostate>&&)#1}::operator()(seastar::internal::promise_base_with_type<perf_tests::internal::performance_test::run_result>&&, perf_tests::internal::performance_test::do_run(perf_tests::internal::config const&)::$_0&, seastar::future_state<seastar::internal::monostate>&&) const at /v/build/v_deps_build/seastar-prefix/src/seastar/include/seastar/core/future.hh:1471
 (inlined by) seastar::continuation<seastar::internal::promise_base_with_type<perf_tests::internal::performance_test::run_result>, perf_tests::internal::performance_test::do_run(perf_tests::internal::config const&)::$_0, seastar::future<void>::then_impl_nrvo<perf_tests::internal::performance_test::do_run(perf_tests::internal::config const&)::$_0, seastar::future<perf_tests::internal::performance_test::run_result> >(perf_tests::internal::performance_test::do_run(perf_tests::internal::config const&)::$_0&&)::{lambda(seastar::internal::promise_base_with_type<perf_tests::internal::performance_test::run_result>&&, perf_tests::internal::performance_test::do_run(perf_tests::internal::config const&)::$_0&, seastar::future_state<seastar::internal::monostate>&&)#1}, void>::run_and_dispose() at /v/build/v_deps_build/seastar-prefix/src/seastar/include/seastar/core/future.hh:748
[Backtrace #15]
seastar::reactor::run_tasks(seastar::reactor::task_queue&) at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/reactor.cc:2792
 (inlined by) seastar::reactor::run_some_tasks() at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/reactor.cc:3254
[Backtrace #16]
seastar::reactor::do_run() at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/reactor.cc:3437
[Backtrace #17]
seastar::reactor::run() at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/reactor.cc:3312
[Backtrace #18]
seastar::app_template::run_deprecated(int, char**, std::__1::function<void ()>&&) at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/app-template.cc:276
[Backtrace #19]
seastar::app_template::run(int, char**, std::__1::function<seastar::future<int> ()>&&) at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/app-template.cc:167
 (inlined by) seastar::app_template::run(int, char**, std::__1::function<seastar::future<void> ()>&&) at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/app-template.cc:182
[Backtrace #20]
main at /v/build/v_deps_build/seastar-prefix/src/seastar/tests/perf/perf_tests.cc:431
[Backtrace #21]
__libc_start_call_main at ??:?
[Backtrace #22]
__libc_start_main_alias_2 at :?
[Backtrace #23]
_start at ??:?

JIRA Link: CORE-4207

[github-actions[bot]]

This issue hasn't seen activity in 3 months. If you want to keep it open, post a comment or remove the stale label – otherwise this will be closed in two weeks.