search

ppat / storm-rabbitmq

A library of tools for interacting with RabbitMQ from Storm.
MIT License
126 stars 77 forks source link

About Trident #14

Closed damacheng009 closed 10 years ago

damacheng009 commented 10 years ago

Can you support Trident spout?

ppat commented 10 years ago

RabbitMQ and Trident do not play well together as RabbitMQ does not meet the requirements of Trident. RabbitMQ does not provide the ability to batch ACK a group of messages in an atomic fashion.

If you do not care about reliability, you can use the Unanchored RabbitMQ Spout in non-transactional Trident topologies. But you are giving up all guarantees around delivery at that point.

If guaranteed delivery is important to you in Trident, I think you should consider Kafka.

On Jun 16, 2014, at 9:25 PM, damacheng009 notifications@github.com wrote:

Can you support Trident spout?

— Reply to this email directly or view it on GitHub.

cloudbow commented 9 years ago

Ppat, Can't we save the delivery tags in a list and then do an atomic operation of getting from the list and acking each individually?

ppat commented 9 years ago

I believe you need to ack an entire batch in atomic fashion. Not individually. Having said, if you have an implementation that works, pull requests are welcome (please follow the coding style within the project).

On Aug 13, 2015, at 10:40 AM, arung notifications@github.com wrote:

Ppat, Can't we save the delivery tags in a list and then do an atomic operation of getting from the list and acking each individually?

— Reply to this email directly or view it on GitHub.