search

segmentio / kafka-go

Kafka library in Go
MIT License
7.49k stars 774 forks source link

KIP-392: Allow consumers to fetch from closest replica #984

Open Pryz opened 2 years ago

Pryz commented 2 years ago

Describe the solution you would like

In version 2.4.0, Kafka introduced the ability for consumers to fetch data from a replica instead of a partition leader. While we already support the ability to consume data from a leader in the same AZ, leaders might move due to diverse Kafka events. KIP-392, while potentially introducing some latency, helps managing the data flow.

Supporting documentation

https://cwiki.apache.org/confluence/display/KAFKA/KIP-392%3A+Allow+consumers+to+fetch+from+closest+replica

petedannemann commented 2 years ago

@rhansen2 do you mind if I take a stab at this? Our team was looking to utilize this feature soon.

rhansen2 commented 2 years ago

Hi @petedannemann thanks for your interesting in contributing!

Feel free to get started on this!