redpanda-data / redpanda

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!
https://redpanda.com
9.16k stars 559 forks source link

CI Failure (key symptom) in `PartitionBalancerScaleTest.test_node_operations_at_scale` #19916

Closed vbotbuildovich closed 1 week ago

vbotbuildovich commented 2 weeks ago

https://buildkite.com/redpanda/vtools/builds/14734

Module: rptest.scale_tests.partition_balancer_scale_test
Class: PartitionBalancerScaleTest
Method: test_node_operations_at_scale
Arguments: {
    "type": "many_partitions"
}
test_id:    PartitionBalancerScaleTest.test_node_operations_at_scale
status:     FAIL
run time:   682.226 seconds

<BadLogLines nodes=ip-172-31-9-236(3) example="WARN  2024-06-15 00:51:28,757 [shard 3:main] seastar_memory - oversized allocation: 458752 bytes. This is non-fatal, but could lead to latency and/or fragmentation issues. Please report: at 0x851625b 0x82072eb 0x821245f 0x83b29e3 0x83b8b0f 0x83b07af 0x83444e7 0x82d2f57 0x831afe3 0x8258b9f /opt/redpanda/lib/libc.so.6+0x96797 /opt/redpanda/lib/libc.so.6+0x101b4b">
Traceback (most recent call last):
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/ducktape/tests/runner_client.py", line 184, in _do_run
    data = self.run_test()
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/ducktape/tests/runner_client.py", line 276, in run_test
    return self.test_context.function(self.test)
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/ducktape/mark/_mark.py", line 535, in wrapper
    return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs)
  File "/home/ubuntu/redpanda/tests/rptest/services/cluster.py", line 190, in wrapped
    redpanda.raise_on_bad_logs(
  File "/home/ubuntu/redpanda/tests/rptest/services/redpanda.py", line 1565, in raise_on_bad_logs
    lsearcher.search_logs(_searchable_nodes)
  File "/home/ubuntu/redpanda/tests/rptest/services/utils.py", line 197, in search_logs
    raise BadLogLines(bad_loglines)
rptest.services.utils.BadLogLines: <BadLogLines nodes=ip-172-31-9-236(3) example="WARN  2024-06-15 00:51:28,757 [shard 3:main] seastar_memory - oversized allocation: 458752 bytes. This is non-fatal, but could lead to latency and/or fragmentation issues. Please report: at 0x851625b 0x82072eb 0x821245f 0x83b29e3 0x83b8b0f 0x83b07af 0x83444e7 0x82d2f57 0x831afe3 0x8258b9f /opt/redpanda/lib/libc.so.6+0x96797 /opt/redpanda/lib/libc.so.6+0x101b4b">

JIRA Link: CORE-4256

travisdowns commented 1 week ago

{"duplicate": "https://github.com/redpanda-data/redpanda/issues/18480"}