logstash6.6 with Kafka Client Version 0.8 input

logstash-plugins / logstash-input-kafka

Kafka input for Logstash

Apache License 2.0

139 stars 122 forks source link

logstash6.6 with Kafka Client Version 0.8 input #312

Closed rp-happiestbaby closed 5 years ago

rp-happiestbaby commented 5 years ago

Hi, Im having problem with logstash-6.6 to connect to Kafka Client Version 0.8 There is no flag to set Kafka Client Version. How do i do this ?

Version: 6.6
Operating System: ubuntu16.04

jsvd commented 5 years ago

hi @rp-happiestbaby, when you say kafka client version 0.8 do you mean the kafka broker is version 0.8?

Current versions of the kafka input plugin ship with kafka client version 2.1, and they can't connect to such an older version of the broker. The oldest version of kafka brokers we can connect to is 0.9, and you can install the kafka input plugin for that version with bin/logstash-plugin install --version "4.0.0" logstash-input-kafka

rp-happiestbaby commented 5 years ago

hi @jsvd , yes kafka broker is version 0.8, I need to install elasticsearch 6.6 and use logstash to consume from kafka broker version 0.8 and write to elasticsearch. What version plugin or/and logstash can i use ?

Thanks in advance Thanks for response