search

helpshift / ekaf

A minimal, high-performance Kafka client in Erlang.
https://engineering.helpshift.com
Other
165 stars 50 forks source link

Multiple broker configuration #53

Open turtleDeng opened 7 years ago

turtleDeng commented 7 years ago

Support multiple broker configuration?

bosky101 commented 7 years ago

Do you mean almost like different clients?

Unfortunately this is not possible right now. But open to create work arounds.

~B

On 29-Nov-2017, at 12:28 PM, turtleDeng notifications@github.com wrote:

Support multiple broker configuration?

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub, or mute the thread.

turtleDeng commented 7 years ago

{ekaf_bootstrap_broker, [{"xx.xx.xx.x1", 9091}, {"xx.xx.xx.x2", 9091}] }?

bosky101 commented 6 years ago

If you are looking for producing to two different kafka clusters - that functionality does not exists at the moment.

If you simply looking for fail over - I recommend using a dns setting that round robins between the two hosts - and then putting that host. In any case - any of the hosts can be placed to get metadata.

It should be trivial to attempt to connect to either one of the hosts, happy to see any pull request on the same to make this a list of brokers.

On Thu, Nov 30, 2017 at 9:24 AM, turtleDeng notifications@github.com wrote:

{ekaf_bootstrap_broker, [{"xx.xx.xx.x1", 9091}, {"xx.xx.xx.x2", 9091}] }?

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/helpshift/ekaf/issues/53#issuecomment-348062582, or mute the thread https://github.com/notifications/unsubscribe-auth/AABh-BVzLmU37thS0sOo8mSSXI9T0O23ks5s7hHwgaJpZM4QugTw .