redpanda-data / redpanda

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!
https://redpanda.com
9.58k stars 582 forks source link

raft: reduce polling in automatic leadership rebalancing #2031

Open dotnwat opened 3 years ago

dotnwat commented 3 years ago

We currently lack the proper notification mechanism in the leaders table to wake-up the leadership rebalance service in cases where enough leadership change has occurred that it would make sense to run the balancer before the normal polling timeout occurs.

JIRA Link: CORE-714

emaxerrno commented 3 years ago

Could we do exponential back off with a limit of say 1 minute. So at most once a minute