redpanda-data / redpanda

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!
https://redpanda.com
9.39k stars 577 forks source link

CI Failure (key symptom) in `HighThroughputTest.test_add_and_decommission` #19924

Open vbotbuildovich opened 2 months ago

vbotbuildovich commented 2 months ago

https://buildkite.com/redpanda/vtools/builds/14661

Module: rptest.redpanda_cloud_tests.high_throughput_test
Class: HighThroughputTest
Method: test_add_and_decommission
test_id:    HighThroughputTest.test_add_and_decommission
status:     FAIL
run time:   3.540 seconds

HTTPError('500 Server Error: Internal Server Error for url: https://cloud-api.ppd.cloud.redpanda.com/api/v1/workflows/network-cluster')
Traceback (most recent call last):
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/ducktape/tests/runner_client.py", line 177, in _do_run
    self.test = self.test_context.cls(self.test_context)
  File "/home/ubuntu/redpanda/tests/rptest/redpanda_cloud_tests/high_throughput_test.py", line 242, in __init__
    super(HighThroughputTest, self).__init__(test_context=test_ctx,
  File "/home/ubuntu/redpanda/tests/rptest/utils/test_mixins.py", line 29, in __init__
    super().__init__(**kwargs)
  File "/home/ubuntu/redpanda/tests/rptest/tests/redpanda_cloud_test.py", line 25, in __init__
    self.redpanda = make_redpanda_cloud_service(test_context)
  File "/home/ubuntu/redpanda/tests/rptest/services/redpanda.py", line 5082, in make_redpanda_cloud_service
    return RedpandaServiceCloud(context,
  File "/home/ubuntu/redpanda/tests/rptest/services/redpanda.py", line 1684, in __init__
    cluster_id = self._cloud_cluster.create(superuser=self._superuser)
  File "/home/ubuntu/redpanda/tests/rptest/services/redpanda_cloud.py", line 925, in create
    self._create_new_cluster()
  File "/home/ubuntu/redpanda/tests/rptest/services/redpanda_cloud.py", line 665, in _create_new_cluster
    r = self.cloudv2._http_post(
  File "/home/ubuntu/redpanda/tests/rptest/services/provider_clients/rpcloud_client.py", line 105, in _http_post
    _r = self._handle_error(resp)
  File "/home/ubuntu/redpanda/tests/rptest/services/provider_clients/rpcloud_client.py", line 20, in _handle_error
    raise e
  File "/home/ubuntu/redpanda/tests/rptest/services/provider_clients/rpcloud_client.py", line 15, in _handle_error
    response.raise_for_status()
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/requests/models.py", line 941, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://cloud-api.ppd.cloud.redpanda.com/api/v1/workflows/network-cluster

JIRA Link: CORE-4248

vbotbuildovich commented 1 month ago

*https://buildkite.com/redpanda/vtools/builds/15568