search

redpanda-data / redpanda

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!
https://redpanda.com
9.63k stars 585 forks source link

CI Failure (Node has unexpectedly many objects 100 > 50) in `TieredStorageCacheStressTest.garbage_objects_test` #20576

Closed vbotbuildovich closed 1 month ago

vbotbuildovich commented 4 months ago

https://buildkite.com/redpanda/vtools/builds/14881 https://buildkite.com/redpanda/vtools/builds/14990 https://buildkite.com/redpanda/vtools/builds/14997

Module: rptest.scale_tests.tiered_storage_cache_stress_test
Class: TieredStorageCacheStressTest
Method: garbage_objects_test
test_id:    TieredStorageCacheStressTest.garbage_objects_test
status:     FAIL
run time:   79.008 seconds

AssertionError('Node ip-172-31-7-154 has unexpectedly many objects 100 > 50')
Traceback (most recent call last):
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/ducktape/tests/runner_client.py", line 184, in _do_run
    data = self.run_test()
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/ducktape/tests/runner_client.py", line 276, in run_test
    return self.test_context.function(self.test)
  File "/home/ubuntu/redpanda/tests/rptest/services/cluster.py", line 105, in wrapped
    r = f(self, *args, **kwargs)
  File "/home/ubuntu/redpanda/tests/rptest/scale_tests/tiered_storage_cache_stress_test.py", line 502, in garbage_objects_test
    self.run_test_with_cache_prefilled(
  File "/home/ubuntu/redpanda/tests/rptest/scale_tests/tiered_storage_cache_stress_test.py", line 464, in run_test_with_cache_prefilled
    assert usage[
AssertionError: Node ip-172-31-7-154 has unexpectedly many objects 100 > 50

JIRA Link: CORE-4861

vbotbuildovich commented 4 months ago

https://buildkite.com/redpanda/vtools/builds/15217 https://buildkite.com/redpanda/vtools/builds/15241

vbotbuildovich commented 4 months ago

https://buildkite.com/redpanda/vtools/builds/15217 https://buildkite.com/redpanda/vtools/builds/15241

vbotbuildovich commented 4 months ago

*https://buildkite.com/redpanda/vtools/builds/15322

vbotbuildovich commented 2 months ago

*https://buildkite.com/redpanda/vtools/builds/16409

piyushredpanda commented 1 month ago

Closing older-bot-filed CI issues as we transition to a more reliable system.