search

doujiang24 / lua-resty-kafka

Lua kafka client driver for the Openresty based on the cosocket API
BSD 3-Clause "New" or "Revised" License
801 stars 274 forks source link

buffered messages send to kafka err: MessageSizeTooLarge #45

Closed leon2035 closed 7 years ago

leon2035 commented 7 years ago

2016/12/22 22:32:33 [error] 13413#0: *378703 [lua] producer.lua:258: buffered messages send to kafka err: MessageSizeTooLarge, retryable: false, topic: ns-source-wimonitor, partition_id: 2, length: 111, context: ngx.timer, client: 120.237.52.234, server: 0.0.0.0:443

I have got a error from error.log. should i increase the message size? and what should i do?

doujiang24 commented 7 years ago

@centralman Maybe you shoud config max.message.bytes on the kafka side? http://kafka.apache.org/documentation.html#producerconfigs

leon2035 commented 7 years ago

Thanks a lot. I'm a beginner to kafka.