search

ricbra / rabbitmq-cli-consumer

Consume RabbitMQ messages into any cli program
MIT License
247 stars 49 forks source link

Scalability #48

Open ne0c0de opened 7 years ago

ne0c0de commented 7 years ago

I found this project while i was searching about scalability of RabbitMQ consumers based on que length.

For instance, if there's a certain amount of message is waiting in que, increase the consumer count for that specific que and when the messages are processed decrease the consumer count to previous amount.

I know it's not the feature of the current version but may be in the future?

andrefigueira commented 7 years ago

Hi @ne0c0de

I'm not the project owner, but I've recently asked the same thing, except since the original article mentioned that "supervisord" would monitor processes, I think that's the place the scalable option should be as currently, this consumer doesn't do anything in terms of counting and spawning workers.

I've researched what I could use and found https://github.com/collective/mr.rubber however haven't tried it yet.

Hope this helps.