redpanda-data / redpanda

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!
https://redpanda.com
9.69k stars 591 forks source link

Datalake in Random Node Operations test #24179

Open mmaslankaprv opened 5 days ago

mmaslankaprv commented 5 days ago

Enabling Iceberg in Random Node Operations test to validate its correctness in face of failures and node operations.

Backports Required

Release Notes

mmaslankaprv commented 5 days ago

/dt

mmaslankaprv commented 4 days ago

/dt

vbotbuildovich commented 4 days ago

ducktape was retried in https://buildkite.com/redpanda/redpanda/builds/58327#01934945-6ead-458a-ba3d-adba5f914e44 ducktape was retried in https://buildkite.com/redpanda/redpanda/builds/58327#01934945-6eb2-4f74-9a10-550455d20848 ducktape was retried in https://buildkite.com/redpanda/redpanda/builds/58552#019353bc-a1d1-4417-9900-2757680edc34

vbotbuildovich commented 3 days ago

non flaky failures in https://buildkite.com/redpanda/redpanda/builds/58436#01934df0-96ea-4560-ba1b-870db0bfc356:

"rptest.tests.cluster_features_test.FeaturesMultiNodeTest.test_license_upload_and_query"

non flaky failures in https://buildkite.com/redpanda/redpanda/builds/58436#01934df0-96e8-41bd-8f4b-6ee6b32e663a:

"rptest.tests.random_node_operations_test.RandomNodeOperationsTest.test_node_operations.enable_failures=False.mixed_versions=False.with_tiered_storage=False.with_iceberg=False"

non flaky failures in https://buildkite.com/redpanda/redpanda/builds/58552#019353c1-7090-41da-8ba7-f1e471cd82d8:

"rptest.tests.random_node_operations_test.RandomNodeOperationsTest.test_node_operations.enable_failures=False.mixed_versions=True.with_tiered_storage=False.with_iceberg=True.cloud_storage_type=CloudStorageType.S3"
"rptest.tests.random_node_operations_test.RandomNodeOperationsTest.test_node_operations.enable_failures=True.mixed_versions=True.with_tiered_storage=False.with_iceberg=True.cloud_storage_type=CloudStorageType.S3"

non flaky failures in https://buildkite.com/redpanda/redpanda/builds/58552#019353c1-708f-4c06-9d59-8837cd3d0c6f:

"rptest.tests.random_node_operations_test.RandomNodeOperationsTest.test_node_operations.enable_failures=False.mixed_versions=True.with_tiered_storage=False.with_iceberg=False.cloud_storage_type=CloudStorageType.S3"
"rptest.tests.random_node_operations_test.RandomNodeOperationsTest.test_node_operations.enable_failures=True.mixed_versions=True.with_tiered_storage=False.with_iceberg=False.cloud_storage_type=CloudStorageType.S3"

non flaky failures in https://buildkite.com/redpanda/redpanda/builds/58552#019353c1-7092-4e64-a734-d79e9a173300:

"rptest.tests.random_node_operations_test.RandomNodeOperationsTest.test_node_operations.enable_failures=False.mixed_versions=True.with_tiered_storage=True.with_iceberg=False.cloud_storage_type=CloudStorageType.S3"
"rptest.tests.random_node_operations_test.RandomNodeOperationsTest.test_node_operations.enable_failures=True.mixed_versions=True.with_tiered_storage=True.with_iceberg=False.cloud_storage_type=CloudStorageType.S3"

non flaky failures in https://buildkite.com/redpanda/redpanda/builds/58552#019353c1-708c-48c5-ab8b-3ed16be62d0c:

"rptest.tests.random_node_operations_test.RandomNodeOperationsTest.test_node_operations.enable_failures=False.mixed_versions=True.with_tiered_storage=True.with_iceberg=True.cloud_storage_type=CloudStorageType.S3"
"rptest.tests.random_node_operations_test.RandomNodeOperationsTest.test_node_operations.enable_failures=True.mixed_versions=True.with_tiered_storage=True.with_iceberg=True.cloud_storage_type=CloudStorageType.S3"
vbotbuildovich commented 3 days ago

Retry command for Build#58436

please wait until all jobs are finished before running the slash command

/ci-repeat 1
tests/rptest/tests/cluster_features_test.py::FeaturesMultiNodeTest.test_license_upload_and_query
tests/rptest/tests/random_node_operations_test.py::RandomNodeOperationsTest.test_node_operations@{"enable_failures":false,"mixed_versions":false,"with_iceberg":false,"with_tiered_storage":false}
vbotbuildovich commented 2 days ago

Retry command for Build#58552

please wait until all jobs are finished before running the slash command

/ci-repeat 1
tests/rptest/tests/random_node_operations_test.py::RandomNodeOperationsTest.test_node_operations@{"cloud_storage_type":1,"enable_failures":false,"mixed_versions":true,"with_iceberg":true,"with_tiered_storage":false}
tests/rptest/tests/random_node_operations_test.py::RandomNodeOperationsTest.test_node_operations@{"cloud_storage_type":1,"enable_failures":true,"mixed_versions":true,"with_iceberg":true,"with_tiered_storage":false}
tests/rptest/tests/random_node_operations_test.py::RandomNodeOperationsTest.test_node_operations@{"cloud_storage_type":1,"enable_failures":false,"mixed_versions":true,"with_iceberg":false,"with_tiered_storage":false}
tests/rptest/tests/random_node_operations_test.py::RandomNodeOperationsTest.test_node_operations@{"cloud_storage_type":1,"enable_failures":true,"mixed_versions":true,"with_iceberg":false,"with_tiered_storage":false}
tests/rptest/tests/random_node_operations_test.py::RandomNodeOperationsTest.test_node_operations@{"cloud_storage_type":1,"enable_failures":false,"mixed_versions":true,"with_iceberg":false,"with_tiered_storage":true}
tests/rptest/tests/random_node_operations_test.py::RandomNodeOperationsTest.test_node_operations@{"cloud_storage_type":1,"enable_failures":true,"mixed_versions":true,"with_iceberg":false,"with_tiered_storage":true}
tests/rptest/tests/random_node_operations_test.py::RandomNodeOperationsTest.test_node_operations@{"cloud_storage_type":1,"enable_failures":false,"mixed_versions":true,"with_iceberg":true,"with_tiered_storage":true}
tests/rptest/tests/random_node_operations_test.py::RandomNodeOperationsTest.test_node_operations@{"cloud_storage_type":1,"enable_failures":true,"mixed_versions":true,"with_iceberg":true,"with_tiered_storage":true}