Kafka MirrorMaker 2.0 support for automatic failover

siddhi-io / siddhi-io-kafka

Extension that can be used to receive events from a Kafka cluster and to publish events to a Kafka cluster

https://siddhi-io.github.io/siddhi-io-kafka/

Apache License 2.0

18 stars 50 forks source link

Kafka MirrorMaker 2.0 support for automatic failover #148

Open Manasha11 opened 2 years ago

Manasha11 commented 2 years ago

Description: When using MirrorMaker 2.0 in a multi region deployment, add support to automatically calculate the correct offset using RemoteClientUtil [1] in case it needs to failover to the target cluster.

[1] https://cwiki.apache.org/confluence/display/KAFKA/KIP-382%3A+MirrorMaker+2.0#KIP382:MirrorMaker2.0-RemoteClusterUtils