redpanda-data / redpanda

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!
https://redpanda.com
9.32k stars 573 forks source link

CI Failure (key symptom) in `RedpandaUpgradeTest.test_workloads_through_releases` #17508

Open vbotbuildovich opened 4 months ago

vbotbuildovich commented 4 months ago

https://buildkite.com/redpanda/redpanda/builds/47058

Module: rptest.tests.workload_upgrade_runner_test
Class: RedpandaUpgradeTest
Method: test_workloads_through_releases
Arguments: {
    "cloud_storage_type": 1
}
test_id:    RedpandaUpgradeTest.test_workloads_through_releases
status:     FAIL
run time:   1207.481 seconds

Exception('ProducerConsumerWorkload failed at 1711698516.5564673 - 2024-03-29 07:48:36\nTraceback (most recent call last):\n\n  File "/root/tests/rptest/tests/workload_upgrade_runner_test.py", line 96, in _exec_workload_method\n    result = getattr(self.workload, method_name)(*args)\n\n  File "/root/tests/rptest/tests/workload_producer_consumer.py", line 95, in on_cluster_upgraded\n    quiesce_uploads(self.ctx.redpanda, [self.topic.name], 120)\n\n  File "/root/tests/rptest/utils/si_utils.py", line 730, in quiesce_uploads\n    raise RuntimeError(f"Found 0 partitions for topic \'{topic_name}\'")\n\nRuntimeError: Found 0 partitions for topic \'topic-ProducerConsumerWorkload-a5ffa83c-b53f-4b42-80a5-9d35b6d3057b\'\n')
Traceback (most recent call last):
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/ducktape/tests/runner_client.py", line 184, in _do_run
    data = self.run_test()
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/ducktape/tests/runner_client.py", line 276, in run_test
    return self.test_context.function(self.test)
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/ducktape/mark/_mark.py", line 535, in wrapper
    return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs)
  File "/root/tests/rptest/services/cluster.py", line 104, in wrapped
    r = f(self, *args, **kwargs)
  File "/root/tests/rptest/tests/workload_upgrade_runner_test.py", line 324, in test_workloads_through_releases
    raise Exception("\n".join(concat_error))
Exception: ProducerConsumerWorkload failed at 1711698516.5564673 - 2024-03-29 07:48:36
Traceback (most recent call last):

  File "/root/tests/rptest/tests/workload_upgrade_runner_test.py", line 96, in _exec_workload_method
    result = getattr(self.workload, method_name)(*args)

  File "/root/tests/rptest/tests/workload_producer_consumer.py", line 95, in on_cluster_upgraded
    quiesce_uploads(self.ctx.redpanda, [self.topic.name], 120)

  File "/root/tests/rptest/utils/si_utils.py", line 730, in quiesce_uploads
    raise RuntimeError(f"Found 0 partitions for topic '{topic_name}'")

RuntimeError: Found 0 partitions for topic 'topic-ProducerConsumerWorkload-a5ffa83c-b53f-4b42-80a5-9d35b6d3057b'

JIRA Link: CORE-1954

vbotbuildovich commented 4 months ago

*https://buildkite.com/redpanda/vtools/builds/12774

vbotbuildovich commented 2 months ago

*https://buildkite.com/redpanda/vtools/builds/14625

vbotbuildovich commented 1 month ago

*https://buildkite.com/redpanda/vtools/builds/15625

vbotbuildovich commented 1 month ago

*https://buildkite.com/redpanda/vtools/builds/15665

vbotbuildovich commented 1 month ago

*https://buildkite.com/redpanda/vtools/builds/15839