Automattic / kue

Kue is a priority job queue backed by redis, built for node.js.
http://automattic.github.io/kue
MIT License
9.46k stars 867 forks source link

Kue.js Worker process... #1175

Open Anirudh0509 opened 6 years ago

Anirudh0509 commented 6 years ago

I am trying to replace AWS SQS with Kue.js in a node application. My concern is, if there are n no of items added in a queue. How many items in the queue will be processed concurrently?? Is it like.... processor will process the each item one at a time or in bulk?? Also if the queue.process() is called for the same queue from two or more different places. how will the processing be done. Kindly suggest

pc-jedi commented 6 years ago

queue.process will usually process just one at a time. To process more in parallel (which only works if your job is asynchronous) see the following: Processing Concurrency

nocaseguy commented 6 years ago

Hey @Anirudh0509 Check this out: https://github.com/dungbx/sqs-taskqueue We are using it on production to process million of message daily.