Support exactly once delivery

fluent / fluent-plugin-kafka

Kafka input and output plugin for Fluentd

Other

303 stars 176 forks source link

Support exactly once delivery #219

Closed jaynblue closed 5 years ago

jaynblue commented 6 years ago

Recently, Ruby-Kafa support Exactly-Once delivery feature. (https://github.com/zendesk/ruby-kafka/pull/608)

We have to implement this great feature.

producer = kafka.producer(idempotent: true)
producer.produce('Testing', topic: 'test')
producer.deliver_messages

producer = kafka.async_producer(idempotent: true)
producer.produce('Testing 2', topic: 'test')

Thanks!

repeatedly commented 5 years ago

v0.8.0 uses ruby-kafka v0.7 or later so adding parameter for idempotent seems to resolve this problem.