redpanda-data / redpanda

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!
https://redpanda.com
9.21k stars 564 forks source link

CI Failure (RuntimeError("Object storage scrub detected fatal anomalies of type {'ntpr_bad_deltas'}")) in `rptest.tests.workload_upgrade_runner_test.RedpandaUpgradeTest.test_workloads_through_releases` #11841

Closed vshtokman closed 1 year ago

vshtokman commented 1 year ago

https://buildkite.com/redpanda/vtools/builds/8306#01890e37-4e3c-4410-8295-fb5937d43c23

test_id: rptest.tests.workload_upgrade_runner_test.RedpandaUpgradeTest.test_workloads_through_releases status: FAIL run time: 13 minutes 2.028 seconds

    RuntimeError("Object storage scrub detected fatal anomalies of type {'ntpr_bad_deltas'}")
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/dist-packages/ducktape/tests/runner_client.py", line 135, in run
    data = self.run_test()
  File "/usr/local/lib/python3.10/dist-packages/ducktape/tests/runner_client.py", line 227, in run_test
    return self.test_context.function(self.test)
  File "/home/ubuntu/redpanda/tests/rptest/utils/mode_checks.py", line 63, in f
    return func(*args, **kwargs)
  File "/home/ubuntu/redpanda/tests/rptest/services/cluster.py", line 159, in wrapped
    self.redpanda.stop_and_scrub_object_storage()
  File "/home/ubuntu/redpanda/tests/rptest/services/redpanda.py", line 3708, in stop_and_scrub_object_storage
    raise RuntimeError(
RuntimeError: Object storage scrub detected fatal anomalies of type {'ntpr_bad_deltas'}
VladLazar commented 1 year ago

Raced with https://github.com/redpanda-data/redpanda/issues/11842