mosquito-cr / mosquito

A background task runner for crystal applications supporting periodic (CRON) and manually queued jobs
MIT License
227 stars 24 forks source link

Crash - ERR too many keys to fetch, please use SCAN #137

Closed robacarp closed 5 months ago

robacarp commented 5 months ago

I'm not sure what happened that all-of-a-sudden caused this to pop-up, but I'm getting intermittent crashes on several workers this morning. Some of them have ?? all over in the stack traces, but this one dropped real line numbers:

Unhandled exception in spawn: ERR too many keys to fetch, please use SCAN (Redis::Error) from lib/redis/src/parser.cr:54:9 in 'read' from lib/redis/src/connection.cr:406:7 in 'read' from lib/redis/src/connection.cr:357:18 in 'run' from lib/redis/src/connection.cr:351:5 in 'run' from lib/redis/src/client.cr:67:24 in 'run' from lib/redis/src/commands.cr:40:7 in 'keys' from lib/redis/src/client.cr:53:5 in 'keys' from lib/mosquito/src/mosquito/redis_backend.cr:132:9 in 'list_queues' --- this is the source of the problem, but it's not in 'list_queues' as the stack trace says. from lib/mosquito/src/mosquito/runners/queue_list.cr:14:28 in 'fetch' from lib/mosquito/src/mosquito/runners/overseer.cr:54:9 in 'tick' from lib/mosquito/src/mosquito/runners/overseer.cr:46:9 in 'run' from lib/mosquito/src/mosquito/runner.cr:36:9 in '->' from /Users/robert/.asdf/installs/crystal/1.11.2/src/fiber.cr:146:11 in 'run' from /Users/robert/.asdf/installs/crystal/1.11.2/src/fiber.cr:98:34 in '->'