redpanda-data / redpanda

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!
https://redpanda.com
9.46k stars 579 forks source link

CI Failure (Failed to load 'fips) in `gtest_ossl_context_service_rpunit` #19868

Closed BenPope closed 2 months ago

BenPope commented 3 months ago

https://buildkite.com/redpanda/redpanda/builds/50341#019024b9-2446-4e37-b527-b680943cc975

DEBUG 2024-06-17 07:23:42,751 ossl-library-context-service - ossl_context_service.cc:80 - Attempting to load OpenSSL config file /var/lib/buildkite-agent/builds/buildkite-arm64-builders-i-00ffe222fc7279749-1/redpanda/redpanda/vbuild/release/clang/src/v/crypto/tests/test/openssl_conf.cnf
/var/lib/buildkite-agent/builds/buildkite-arm64-builders-i-00ffe222fc7279749-1/redpanda/redpanda/src/v/crypto/tests/ossl_context_service_test.cc:79: Failure
Expected: co_await svc.invoke_on_all(&crypto::ossl_context_service::start) doesn't throw an exception.
  Actual: it throws crypto::exception with description "Failed to load 'fips' provider{{{310378599: error:12800067:DSO support routines::could not load the shared library}{310378599: error:12800067:DSO support routines::could not load the shared library}{126353445: error:07880025:common libcrypto routines::reason(524325)}}}".

JIRA Link: CORE-4206

BenPope commented 3 months ago

Also: https://buildkite.com/redpanda/redpanda/builds/50287#0190167c-60d3-4445-b2d3-f623942dfce2

INFO  2024-06-14 13:56:39,762 [shard 0:main] ossl-library-context-service - ossl_context_service.cc:254 - OpenSSL Context loaded and ready
ERROR 2024-06-14 13:56:39,763 [shard 0:main] seastar - Exiting on unhandled exception: crypto::internal::ossl_error (Failed to initialize HMAC-SHA512: {{{50856198: error:03080106:digital envelope routines::passed invalid argument}}})
Test Exit code 1
michael-redpanda commented 2 months ago

I believe this was caused by the test not looking for the provider in the right spot and has been addressed. Looking through some of the current failures in buildkite doesn't appear to show this anymore.