search

brg-liuwei / ngx_kafka_module

nginx kafka module, send post log data to kafka cluster
Other
177 stars 64 forks source link

Options to Set Kafka Producer Configs #16

Open dhuadaar opened 7 years ago

dhuadaar commented 7 years ago

Is there any support to tweak the producer configurations. Kafka Producers has many tweakable parameters like compression, max_retries, retry_backoff_ms, required_acks, ack_timeout_ms, max_queued_messages, min_queued_messages, linger_ms block_on_queue_full, max_request_size, sync, delivery_reports

brg-liuwei commented 7 years ago

This module is depends on librdkafka, and those parameters can be set by librdkafka api when initializing kafka producer. So, the solution is to pass those parameters via nginx config file(eg: nginx.conf), and to invoke api of librdkafka with those arguments.

To support those options is with great significant, however, unfortunately, I'm really busy in works those times so... these development jobs would be delayed in some times... Oh, would you like to contribute a pull request for this feature and I am really really appreciated that. :)