r/consensus_utils: use chunked vector when extracting configurations

redpanda-data / redpanda

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!

https://redpanda.com

9.65k stars 589 forks source link

r/consensus_utils: use chunked vector when extracting configurations #24002

Closed mmaslankaprv closed 1 week ago

mmaslankaprv commented 1 week ago

When extracting configurations from a range of batches the configuration vector may grow pretty large. Replaced std::vector with chunked_vector to prevent large allocations.

Backports Required

[ ] none - not a bug fix
[ ] none - this is a backport
[ ] none - issue does not exist in previous branches
[ ] none - papercut/not impactful enough to backport
[x] v24.2.x
[x] v24.1.x
[ ] v23.3.x

Release Notes

Improvements

fixed large allocation in Raft implementation

vbotbuildovich commented 1 week ago

the below tests from https://buildkite.com/redpanda/redpanda/builds/57583#0192fc00-bb4e-418f-8721-9817631ddb78 have failed and will be retried

catalog_schema_manager_rpunit

vbotbuildovich commented 1 week ago

ducktape was retried in https://buildkite.com/redpanda/redpanda/builds/57583#0192fc5e-2d26-4059-9bf1-e8d6c1e118a6 ducktape was retried in https://buildkite.com/redpanda/redpanda/builds/57583#0192fc5c-4332-4b4d-be9f-57bc8f8a520d

vbotbuildovich commented 1 week ago

/backport v24.2.x

vbotbuildovich commented 1 week ago

/backport v24.1.x