search

redpanda-data / redpanda

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!
https://redpanda.com
9.51k stars 580 forks source link

CI Failure (`SSL routines::application data after close notify`) in `RpkRedpandaStartTest.test_rpc_tls_start` #20316

Closed vbotbuildovich closed 2 months ago

vbotbuildovich commented 3 months ago

https://buildkite.com/redpanda/redpanda/builds/50784

Module: rptest.tests.rpk_start_test
Class: RpkRedpandaStartTest
Method: test_rpc_tls_start
test_id:    RpkRedpandaStartTest.test_rpc_tls_start
status:     FAIL
run time:   32.340 seconds

<BadLogLines nodes=docker-rp-17(1) example="ERROR 2024-06-27 07:25:10,855 [shard 0:main] rpc - server.cc:159 - Error[applying protocol] remote address: 192.168.215.26:59768 - std::__1::system_error (error OpenSSL:167772451, Error occurred during SSL shutdown: [error:0A000123:SSL routines::application data after close notify]: error:0A000123:SSL routines::application data after close notify)">
Traceback (most recent call last):
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/ducktape/tests/runner_client.py", line 184, in _do_run
    data = self.run_test()
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/ducktape/tests/runner_client.py", line 276, in run_test
    return self.test_context.function(self.test)
  File "/root/tests/rptest/services/cluster.py", line 190, in wrapped
    redpanda.raise_on_bad_logs(
  File "/root/tests/rptest/services/redpanda.py", line 1570, in raise_on_bad_logs
    lsearcher.search_logs(_searchable_nodes)
  File "/root/tests/rptest/services/utils.py", line 197, in search_logs
    raise BadLogLines(bad_loglines)
rptest.services.utils.BadLogLines: <BadLogLines nodes=docker-rp-17(1) example="ERROR 2024-06-27 07:25:10,855 [shard 0:main] rpc - server.cc:159 - Error[applying protocol] remote address: 192.168.215.26:59768 - std::__1::system_error (error OpenSSL:167772451, Error occurred during SSL shutdown: [error:0A000123:SSL routines::application data after close notify]: error:0A000123:SSL routines::application data after close notify)">

JIRA Link: CORE-4601

michael-redpanda commented 3 months ago

Probably an error that should be ignored/properly handled

bharathv commented 3 months ago

@michael-redpanda There is also this variant

<BadLogLines nodes=docker-rp-17(1) example="ERROR 2024-06-27 21:56:37,575 [shard 0:main] rpc - transport.cc:127 - Error dispatching client reads to {host: docker-rp-13, port: 33145}: std::__1::system_error (error OpenSSL:1074528519, System error during SSL read: error:400C0107:lib(128)::operation fail)">
Traceback (most recent call last):
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/ducktape/tests/runner_client.py", line 184, in _do_run
    data = self.run_test()
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/ducktape/tests/runner_client.py", line 276, in run_test
    return self.test_context.function(self.test)
  File "/root/tests/rptest/services/cluster.py", line 190, in wrapped
    redpanda.raise_on_bad_logs(
  File "/root/tests/rptest/services/redpanda.py", line 1570, in raise_on_bad_logs
    lsearcher.search_logs(_searchable_nodes)
  File "/root/tests/rptest/services/utils.py", line 197, in search_logs
    raise BadLogLines(bad_loglines)
rptest.services.utils.BadLogLines: <BadLogLines nodes=docker-rp-17(1) example="ERROR 2024-06-27 21:56:37,575 [shard 0:main] rpc - transport.cc:127 - Error dispatching client reads to {host: docker-rp-13, port: 33145}: std::__1::system_error (error OpenSSL:1074528519, System error during SSL read: error:400C0107:lib(128)::operation fail)">

does it need a separate ticker or can we link it here? https://buildkite.com/redpanda/redpanda/builds/50834#01905b82-8010-4da7-baef-6356bc965565

michael-redpanda commented 3 months ago

Thanks @bharathv it's all probably the same thing even on different tests.

does it need a separate ticker

I'd say no. There's already a few for this specific issue

michael-redpanda commented 2 months ago

I believe this may have been fixed by https://github.com/redpanda-data/seastar/pull/126. It was merged into the tree via https://github.com/redpanda-data/vtools/pull/2881 ~2 weeks ago so right after this issue was created. Closing as probably already fixed.

piyushredpanda commented 2 months ago

@michael-redpanda: Looks like a test run on Sunday failed: https://ci-artifacts.dev.vectorized.cloud/vtools/15612/0190b042-bd80-40cd-b210-67bbb0496604/vbuild/ducktape/results/2024-07-14--001/report.html

michael-redpanda commented 2 months ago

Automatically closing issue to match current state of CORE-4601