CI Failure (key symptom) in `RandomNodeOperationsTest.test_node_operations`

vbotbuildovich commented 3 months ago

https://buildkite.com/redpanda/vtools/builds/15626

Module: rptest.tests.random_node_operations_test
Class: RandomNodeOperationsTest
Method: test_node_operations
Arguments: {
    "num_to_upgrade": 0,
    "enable_failures": false,
    "with_tiered_storage": true
}

test_id:    RandomNodeOperationsTest.test_node_operations
status:     FAIL
run time:   3649.864 seconds

<BadLogLines nodes=ip-172-31-11-25(1) example="ERROR 2024-07-15 10:44:14,725 [shard 1:au  ] archival - [fiber413 kafka/tp-workload-compaction/14] - ntp_archiver_service.cc:1276 - failed to upload segment "8bbdd4a1-dcfb-4d69-b387-ef00022a1e50/kafka/tp-workload-compaction/14_43/45019-164496-602219-2-v1.log.5": seastar::nested_exception (seastar::nested_exception)">
Traceback (most recent call last):
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/ducktape/tests/runner_client.py", line 184, in _do_run
    data = self.run_test()
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/ducktape/tests/runner_client.py", line 276, in run_test
    return self.test_context.function(self.test)
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/ducktape/mark/_mark.py", line 535, in wrapper
    return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs)
  File "/home/ubuntu/redpanda/tests/rptest/services/cluster.py", line 190, in wrapped
    redpanda.raise_on_bad_logs(
  File "/home/ubuntu/redpanda/tests/rptest/services/redpanda.py", line 1576, in raise_on_bad_logs
    lsearcher.search_logs(_searchable_nodes)
  File "/home/ubuntu/redpanda/tests/rptest/services/utils.py", line 197, in search_logs
    raise BadLogLines(bad_loglines)
rptest.services.utils.BadLogLines: <BadLogLines nodes=ip-172-31-11-25(1) example="ERROR 2024-07-15 10:44:14,725 [shard 1:au  ] archival - [fiber413 kafka/tp-workload-compaction/14] - ntp_archiver_service.cc:1276 - failed to upload segment "8bbdd4a1-dcfb-4d69-b387-ef00022a1e50/kafka/tp-workload-compaction/14_43/45019-164496-602219-2-v1.log.5": seastar::nested_exception (seastar::nested_exception)">

JIRA Link: CORE-5633

vbotbuildovich commented 3 months ago

*https://buildkite.com/redpanda/vtools/builds/15639

vbotbuildovich commented 2 months ago

*https://buildkite.com/redpanda/vtools/builds/16173

piyushredpanda commented 3 weeks ago

Closing older-bot-filed CI issues as we transition to a more reliable system.

redpanda-data / redpanda

CI Failure (key symptom) in `RandomNodeOperationsTest.test_node_operations` #21424