Node-local core assignment: rebalancing - Githubissues

redpanda-data / redpanda

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!

https://redpanda.com

9.12k stars 556 forks source link

Node-local core assignment: rebalancing #19864

Closed ztlpn closed 1 day ago

ztlpn commented 1 week ago

Introduce rebalancing partitions across cores triggered by the following events:

core count change (only increase currently supported)
partition replica removal from the node
manually triggerred with admin API

Backports Required

[x] none - not a bug fix
[ ] none - this is a backport
[ ] none - issue does not exist in previous branches
[ ] none - papercut/not impactful enough to backport
[ ] v24.1.x
[ ] v23.3.x
[ ] v23.2.x

Release Notes

Features

If the node_local_core_assignment flag is enabled, Redpanda will try to maintain balanced distribution of partition replicas across cores.