HangfireIO / Hangfire

An easy way to perform background job processing in .NET and .NET Core applications. No Windows Service or separate process required
https://www.hangfire.io
Other
9.43k stars 1.7k forks source link

hangfire error shut many of my applications down after one error #2443

Open MostafaSDesoky opened 2 months ago

MostafaSDesoky commented 2 months ago

hello i'm using hangfire server with different prefixes for my applications and suddenly I had this issue and it shut down all of my applications at one time

this was in one client ` Description: The process was terminated due to an unhandled exception. Exception Info: StackExchange.Redis.RedisTimeoutException: The message timed out in the backlog attempting to send because no connection became available, command=EXEC, timeout: 5000, outbound: 0KiB, inbound: 0KiB, next: HGETALL Hangfire_Prod_V3job:2fcd70bd-e678-4dea-9dc0-fc5501cd728a, inst: 0, qu: 9, qs: 44, aw: True, bw: WritingMessage, rs: ReadAsync, ws: Flushed, in: 0, in-pipe: 0, out-pipe: 0, last-in: 2, cur-in: 0, sync-ops: 28224, async-ops: 0, serverEndpoint: 172.200.217.240:6379, conn-sec: 1471.7, aoc: 0, mc: 1/1/0, mgr: 10 of 10 available, clientName: vm-iis-2(SE.Redis-v2.6.122.38350), IOCP: (Busy=0,Free=1000,Min=1,Max=1000), WORKER: (Busy=3,Free=32764,Min=8,Max=32767), POOL: (Threads=7,QueuedItems=0,CompletedItems=90110,Timers=14), v: 2.6.122.38350 (Please take a look at this article for some common client-side issues that can cause timeouts: https://stackexchange.github.io/StackExchange.Redis/Timeouts)

`

and this in another one

exception code = '0xe0434352'. First 30KB characters of captured stdout and stderr logs: Unhandled exception. StackExchange.Redis.RedisTimeoutException: Timeout performing UNWATCH (5000ms), next: HGETALL Hangfire_Prod_v4recurring-job:New Auto Create, inst: 0, qu: 0, qs: 4, aw: False, bw: Inactive, rs: ReadAsync, ws: Idle, in: 0, in-pipe: 0, out-pipe: 0, last-in: 2, cur-in: 0, sync-ops: 4, async-ops: 0, serverEndpoint: 172.200.217.240:6379, conn-sec: n/a, aoc: 0, mc: 1/1/0, mgr: 10 of 10 available, clientName: vm-iis-2(SE.Redis-v2.6.122.38350), IOCP: (Busy=0,Free=1000,Min=1,Max=1000), WORKER: (Busy=0,Free=32767,Min=8,Max=32767), POOL: (Threads=4,QueuedItems=0,CompletedItems=76,Timers=3), v: 2.6.122.38350 (Please take a look at this article for some common client-side issues that can cause timeouts: https://stackexchange.github.io/StackExchange.Redis/Timeouts)