search

redpanda-data / redpanda

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!
https://redpanda.com
9.16k stars 561 forks source link

CI Failure (`TooManyBuckets`) in `TieredStorageCacheStressTest.garbage_objects_test` #17485

Open vbotbuildovich opened 3 months ago

vbotbuildovich commented 3 months ago

https://buildkite.com/redpanda/vtools/builds/12531

Module: rptest.scale_tests.tiered_storage_cache_stress_test
Class: TieredStorageCacheStressTest
Method: garbage_objects_test
test_id:    TieredStorageCacheStressTest.garbage_objects_test
status:     FAIL
run time:   12.380 seconds

ClientError('An error occurred (TooManyBuckets) when calling the CreateBucket operation: You have attempted to create more buckets than allowed')
Traceback (most recent call last):
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/ducktape/tests/runner_client.py", line 184, in _do_run
    data = self.run_test()
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/ducktape/tests/runner_client.py", line 269, in run_test
    return self.test_context.function(self.test)
  File "/home/ubuntu/redpanda/tests/rptest/services/cluster.py", line 104, in wrapped
    r = f(self, *args, **kwargs)
  File "/home/ubuntu/redpanda/tests/rptest/scale_tests/tiered_storage_cache_stress_test.py", line 441, in garbage_objects_test
    self.run_test_with_cache_prefilled(
  File "/home/ubuntu/redpanda/tests/rptest/scale_tests/tiered_storage_cache_stress_test.py", line 394, in run_test_with_cache_prefilled
    self.redpanda.start(clean_nodes=False)
  File "/home/ubuntu/redpanda/tests/rptest/services/redpanda.py", line 2635, in start
    self.start_si()
  File "/home/ubuntu/redpanda/tests/rptest/services/redpanda.py", line 3095, in start_si
    self.cloud_storage_client.create_bucket(
  File "/home/ubuntu/redpanda/tests/rptest/archival/s3_client.py", line 145, in create_bucket
    raise err
  File "/home/ubuntu/redpanda/tests/rptest/archival/s3_client.py", line 137, in create_bucket
    res = self._cli.create_bucket(
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/botocore/client.py", line 530, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/botocore/client.py", line 964, in _make_api_call
    raise error_class(parsed_response, operation_name)
botocore.exceptions.ClientError: An error occurred (TooManyBuckets) when calling the CreateBucket operation: You have attempted to create more buckets than allowed

JIRA Link: CORE-2267

vbotbuildovich commented 2 months ago

*https://buildkite.com/redpanda/vtools/builds/12745

vbotbuildovich commented 2 months ago

https://buildkite.com/redpanda/vtools/builds/13013 https://buildkite.com/redpanda/vtools/builds/13061 *https://buildkite.com/redpanda/vtools/builds/13066

vbotbuildovich commented 3 weeks ago

https://buildkite.com/redpanda/vtools/builds/13189 https://buildkite.com/redpanda/vtools/builds/13191