wix-incubator / kafka-connect-s3

A Kafka-Connect Sink for S3 with no Hadoop dependencies.
Other
57 stars 45 forks source link

Kafka 0.10.0 and 0.10.1 are protocol-incompatible #20

Open RobinDaugherty opened 7 years ago

RobinDaugherty commented 7 years ago

With my PR #19 I moved the version of Kafka to 0.10.1.1. But I found that my production Kafka cluster was running 0.10.0.1, which has a consumer API that is incompatible with client 0.10.1.1. (I opened an SO question about the issue.)

So at this point, the master branch has Kafka 0.10.1.1, which does not seem to work with any version of Kafka prior to 0.10.1.0.

There's currently no way to allow selection of the version of Kafka. Might there be a standard mechanism for allowing this? Multiple pom.xml files, one for each version of Kafka?

guptaanamika commented 7 years ago

Is any Java client present for Kafka Connect. As my project is running on distrubuted mode but more runtime registration of new connectors , rest apis are there but no java client. Just want to be sure if exist before i build a new one.