Shards get stuck with their status stuck as "5" (DISCONNECTED) in rare instances

LakeYS / Discord-Trivia-Bot

TriviaBot: Play trivia in Discord! Powered by discord.js and OpenTDB, with 24 categories and three modes of play.

http://lakeys.net/triviabot/

Apache License 2.0

84 stars 39 forks source link

Shards get stuck with their status stuck as "5" (DISCONNECTED) in rare instances #175

Closed LakeYS closed 4 years ago

LakeYS commented 4 years ago

Marked as CRITICAL as this results in major service disruptions.

Similar effect to #160. This appears to occur in batches, affecting multiple shards simultaneously in a single instance.

This can be tested with the following command:

manager.broadcastEval("console.log(client.shard.id, client.status);");

Hack fix that resolves the issue when the corresponding shard ID is used: manager.broadcastEval("if(client.shard.id === 0) process.exit();");

LakeYS commented 4 years ago

https://status.discordapp.com/incidents/vs0q8cvycg46

Result after the recent outage:

LakeYS commented 4 years ago

No-longer able to replicate with no further cases in recent memory. Additional logging has been added in a31d3c1. Will monitor for any further issues.