Automattic / kue

Kue is a priority job queue backed by redis, built for node.js.
http://automattic.github.io/kue
MIT License
9.45k stars 862 forks source link

Issue with kue singleton instance #1226

Closed manasa-ei closed 5 years ago

manasa-ei commented 5 years ago

I have created a singleton kue instance with ioredis cluster client. On singleton instance I am trying to process from 2 topics. After some time it is failiing with too many cluster redirections where as it is working good with only ioredis.

Sample code is given here: https://github.com/manasmishra/redis-cluster-ioredis-kue

Error is as below: at Timeout._onTimeout (/Users/manasamishra/xlabprojects/manas-fork/redis-cluster-ioredis/node_modules/standard-as-callback/built/index.js:6:17) at ontimeout (timers.js:425:11) at tryOnTimeout (timers.js:289:5) at listOnTimeout (timers.js:252:5) at Timer.processTimers (timers.js:212:10) /Users/manasamishra/xlabprojects/manas-fork/redis-cluster-ioredis/node_modules/standard-as-callback/built/index.js:7 throw e; ^

Error: Too many Cluster redirections. Last error: Error: Connection is closed. at Cluster.handleError (/Users/manasamishra/xlabprojects/manas-fork/redis-cluster-ioredis/node_modules/ioredis/built/cluster/index.js:532:38) at Command.command.reject (/Users/manasamishra/xlabprojects/manas-fork/redis-cluster-ioredis/node_modules/ioredis/built/cluster/index.js:411:23) at Redis.flushQueue (/Users/manasamishra/xlabprojects/manas-fork/redis-cluster-ioredis/node_modules/ioredis/built/redis.js:399:30) at close (/Users/manasamishra/xlabprojects/manas-fork/redis-cluster-ioredis/node_modules/ioredis/built/redis/event_handler.js:102:14) at Socket. (/Users/manasamishra/xlabprojects/manas-fork/redis-cluster-ioredis/node_modules/ioredis/built/redis/event_handler.js:69:20) at Object.onceWrapper (events.js:273:13) at Socket.emit (events.js:182:13) at TCP._handle.close (net.js:606:12) Emitted 'error' event at: at Worker. (/Users/manasamishra/xlabprojects/manas-fork/redis-cluster-ioredis/node_modules/kue/lib/kue.js:342:12) at Worker.emit (events.js:182:13) at Worker.error (/Users/manasamishra/xlabprojects/manas-fork/redis-cluster-ioredis/node_modules/kue/lib/queue/worker.js:104:8) at /Users/manasamishra/xlabprojects/manas-fork/redis-cluster-ioredis/node_modules/kue/lib/queue/worker.js:85:20 at /Users/manasamishra/xlabprojects/manas-fork/redis-cluster-ioredis/node_modules/kue/lib/queue/worker.js:279:14 at tryCatcher (/Users/manasamishra/xlabprojects/manas-fork/redis-cluster-ioredis/node_modules/standard-as-callback/built/utils.js:11:23) at promise.then (/Users/manasamishra/xlabprojects/manas-fork/redis-cluster-ioredis/node_modules/standard-as-callback/built/index.js:31:51) at process._tickCallback (internal/process/next_tick.js:68:7)