redpanda-data / redpanda

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!
https://redpanda.com
9.33k stars 574 forks source link

CI Failure (`TooManyBuckets`) in `TieredStorageCacheStressTest.streaming_cache_test` #17486

Closed vbotbuildovich closed 1 month ago

vbotbuildovich commented 5 months ago

https://buildkite.com/redpanda/vtools/builds/12531 https://buildkite.com/redpanda/vtools/builds/12531 https://buildkite.com/redpanda/vtools/builds/12531 https://buildkite.com/redpanda/vtools/builds/12531 https://buildkite.com/redpanda/vtools/builds/12531 https://buildkite.com/redpanda/vtools/builds/12531

Module: rptest.scale_tests.tiered_storage_cache_stress_test
Class: TieredStorageCacheStressTest
Method: streaming_cache_test
Arguments: {
    "limit_mode": "both",
    "log_segment_size": 1048576
}
test_id:    TieredStorageCacheStressTest.streaming_cache_test
status:     FAIL
run time:   11.538 seconds

ClientError('An error occurred (TooManyBuckets) when calling the CreateBucket operation: You have attempted to create more buckets than allowed')
Traceback (most recent call last):
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/ducktape/tests/runner_client.py", line 184, in _do_run
    data = self.run_test()
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/ducktape/tests/runner_client.py", line 269, in run_test
    return self.test_context.function(self.test)
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/ducktape/mark/_mark.py", line 481, in wrapper
    return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs)
  File "/home/ubuntu/redpanda/tests/rptest/services/cluster.py", line 104, in wrapped
    r = f(self, *args, **kwargs)
  File "/home/ubuntu/redpanda/tests/rptest/scale_tests/tiered_storage_cache_stress_test.py", line 234, in streaming_cache_test
    self.redpanda.start()
  File "/home/ubuntu/redpanda/tests/rptest/services/redpanda.py", line 2635, in start
    self.start_si()
  File "/home/ubuntu/redpanda/tests/rptest/services/redpanda.py", line 3095, in start_si
    self.cloud_storage_client.create_bucket(
  File "/home/ubuntu/redpanda/tests/rptest/archival/s3_client.py", line 145, in create_bucket
    raise err
  File "/home/ubuntu/redpanda/tests/rptest/archival/s3_client.py", line 137, in create_bucket
    res = self._cli.create_bucket(
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/botocore/client.py", line 530, in _api_call
    return self._make_api_call(operation_name, kwargs)
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/botocore/client.py", line 964, in _make_api_call
    raise error_class(parsed_response, operation_name)
botocore.exceptions.ClientError: An error occurred (TooManyBuckets) when calling the CreateBucket operation: You have attempted to create more buckets than allowed

JIRA Link: CORE-2235

vbotbuildovich commented 4 months ago

https://buildkite.com/redpanda/vtools/builds/12745 https://buildkite.com/redpanda/vtools/builds/12745 https://buildkite.com/redpanda/vtools/builds/12745 https://buildkite.com/redpanda/vtools/builds/12745 https://buildkite.com/redpanda/vtools/builds/12745 https://buildkite.com/redpanda/vtools/builds/12745

vbotbuildovich commented 4 months ago

https://buildkite.com/redpanda/vtools/builds/13013 https://buildkite.com/redpanda/vtools/builds/13013 https://buildkite.com/redpanda/vtools/builds/13013 https://buildkite.com/redpanda/vtools/builds/13013 https://buildkite.com/redpanda/vtools/builds/13013 https://buildkite.com/redpanda/vtools/builds/13013 https://buildkite.com/redpanda/vtools/builds/13061 https://buildkite.com/redpanda/vtools/builds/13061 https://buildkite.com/redpanda/vtools/builds/13061 https://buildkite.com/redpanda/vtools/builds/13061 https://buildkite.com/redpanda/vtools/builds/13061 https://buildkite.com/redpanda/vtools/builds/13061 https://buildkite.com/redpanda/vtools/builds/13066 https://buildkite.com/redpanda/vtools/builds/13066 https://buildkite.com/redpanda/vtools/builds/13066 https://buildkite.com/redpanda/vtools/builds/13066 https://buildkite.com/redpanda/vtools/builds/13066 https://buildkite.com/redpanda/vtools/builds/13066

vbotbuildovich commented 2 months ago

https://buildkite.com/redpanda/vtools/builds/13189 https://buildkite.com/redpanda/vtools/builds/13189 https://buildkite.com/redpanda/vtools/builds/13189 https://buildkite.com/redpanda/vtools/builds/13189 https://buildkite.com/redpanda/vtools/builds/13189 https://buildkite.com/redpanda/vtools/builds/13189 https://buildkite.com/redpanda/vtools/builds/13191 https://buildkite.com/redpanda/vtools/builds/13191 https://buildkite.com/redpanda/vtools/builds/13191 https://buildkite.com/redpanda/vtools/builds/13191 https://buildkite.com/redpanda/vtools/builds/13191 https://buildkite.com/redpanda/vtools/builds/13191

michael-redpanda commented 1 month ago

Automatically closing issue to match current state of CORE-2235