redpanda-data / redpanda

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!
https://redpanda.com
9.44k stars 579 forks source link

CI Failure (key symptom) in `NodesDecommissioningTest.test_recycle_all_nodes` #22717

Open vbotbuildovich opened 1 month ago

vbotbuildovich commented 1 month ago

https://buildkite.com/redpanda/vtools/builds/16156

Module: rptest.tests.nodes_decommissioning_test
Class: NodesDecommissioningTest
Method: test_recycle_all_nodes
Arguments: {
    "auto_assign_node_id": true
}
test_id:    NodesDecommissioningTest.test_recycle_all_nodes
status:     FAIL
run time:   229.154 seconds

TimeoutError('error waiting for consistent view of the cluster')
Traceback (most recent call last):
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/ducktape/tests/runner_client.py", line 184, in _do_run
    data = self.run_test()
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/ducktape/tests/runner_client.py", line 276, in run_test
    return self.test_context.function(self.test)
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/ducktape/mark/_mark.py", line 535, in wrapper
    return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs)
  File "/home/ubuntu/redpanda/tests/rptest/services/cluster.py", line 105, in wrapped
    r = f(self, *args, **kwargs)
  File "/home/ubuntu/redpanda/tests/rptest/tests/nodes_decommissioning_test.py", line 1073, in test_recycle_all_nodes
    wait_until(cluster_view_is_consistent, 60, 1,
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/ducktape/utils/util.py", line 57, in wait_until
    raise TimeoutError(err_msg() if callable(err_msg) else err_msg) from last_exception
ducktape.errors.TimeoutError: error waiting for consistent view of the cluster

JIRA Link: CORE-6783

vbotbuildovich commented 1 month ago

*https://buildkite.com/redpanda/vtools/builds/16168

vbotbuildovich commented 1 month ago

*https://buildkite.com/redpanda/vtools/builds/16274