joekiller / logstash-kafka

Kafka plugin for Logstash
Apache License 2.0
206 stars 63 forks source link

How to set fetch.message.max.bytes #23

Closed ctx0104 closed 10 years ago

ctx0104 commented 10 years ago

Hi Joe,

First off, thank you for creating this wonderful module :)

I just wanted to ask how can I set the kafka option "fetch.message.max.bytes" for the input? It doesn't seem to be exposed in the input config. The messages that I fetch from the Kafka broker is much larger than what the default consumer can receive so I unfortunately need to configure this option.

Any help would be much appreciated. Thanks again for the great work.

joekiller commented 10 years ago

Should be good now. Set fetch_message_max_bytes in your config. Enjoy!

ctx0104 commented 10 years ago

Fantastic!! Much appreciated. Thanks :)