does it support batching ?

kaltura / nginx-kafka-log-module

Send Kafka messages from Nginx

BSD 2-Clause "Simplified" License

65 stars 22 forks source link

does it support batching ? #14

Open notshivansh opened 1 year ago

notshivansh commented 1 year ago

Does kafka module use batching, while sending data. Moreover, the parameter kafka_log_kafka_buffer_max_messages have any role in batching ?

erankor commented 1 year ago

Yes, this module uses librdkafka, message batching is implemented there. The parameter kafka_log_kafka_buffer_max_messages is translated to librdkafka's queue.buffering.max.messages, which is the maximum number of messages in the output queue. By default, messages can wait in the queue up to 1 sec, before they are sent (queue.buffering.max.ms)