redpanda-data / redpanda

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!
https://redpanda.com
9.41k stars 577 forks source link

CI Failure (key symptom) in `PartitionBalancerTest.test_transfer_controller_leadership` #22804

Open vbotbuildovich opened 1 month ago

vbotbuildovich commented 1 month ago

https://buildkite.com/redpanda/vtools/builds/16331

Module: rptest.tests.partition_balancer_test
Class: PartitionBalancerTest
Method: test_transfer_controller_leadership
test_id:    PartitionBalancerTest.test_transfer_controller_leadership
status:     FAIL
run time:   94.974 seconds

TimeoutError('Redpanda node ducktape-node-15-vastly-unified-mako failed to stop in 30 seconds')
Traceback (most recent call last):
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/ducktape/tests/runner_client.py", line 184, in _do_run
    data = self.run_test()
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/ducktape/tests/runner_client.py", line 276, in run_test
    return self.test_context.function(self.test)
  File "/home/ubuntu/redpanda/tests/rptest/services/cluster.py", line 221, in wrapped
    self.redpanda.stop()
  File "/home/ubuntu/redpanda/tests/rptest/services/redpanda.py", line 3782, in stop
    self.for_nodes(self.nodes, lambda n: self.stop_node(n, **kwargs))
  File "/home/ubuntu/redpanda/tests/rptest/services/redpanda.py", line 1494, in for_nodes
    return list(executor.map(cb, nodes))
  File "/usr/lib/python3.10/concurrent/futures/_base.py", line 621, in result_iterator
    yield _result_or_cancel(fs.pop())
  File "/usr/lib/python3.10/concurrent/futures/_base.py", line 319, in _result_or_cancel
    return fut.result(timeout)
  File "/usr/lib/python3.10/concurrent/futures/_base.py", line 458, in result
    return self.__get_result()
  File "/usr/lib/python3.10/concurrent/futures/_base.py", line 403, in __get_result
    raise self._exception
  File "/usr/lib/python3.10/concurrent/futures/thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/home/ubuntu/redpanda/tests/rptest/services/redpanda.py", line 3782, in <lambda>
    self.for_nodes(self.nodes, lambda n: self.stop_node(n, **kwargs))
  File "/home/ubuntu/redpanda/tests/rptest/services/redpanda.py", line 3814, in stop_node
    wait_until(
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/ducktape/utils/util.py", line 57, in wait_until
    raise TimeoutError(err_msg() if callable(err_msg) else err_msg) from last_exception
ducktape.errors.TimeoutError: Redpanda node ducktape-node-15-vastly-unified-mako failed to stop in 30 seconds

JIRA Link: CORE-6831

vbotbuildovich commented 1 month ago

*https://buildkite.com/redpanda/vtools/builds/16383

vbotbuildovich commented 1 month ago

*https://buildkite.com/redpanda/vtools/builds/16435