search

hackclub / sinerider

💖 A game about love and graphing, built by teenagers.
https://sinerider.com
GNU Affero General Public License v3.0
568 stars 47 forks source link

Instrument backend to detect if the system is down and alert on Slack if so #560

Open grymmy opened 1 year ago

grymmy commented 1 year ago

Description

Send telemetry from one or more backend services to fullstory such that we can detect situations where the backend is experiencing instability or downtime, preferably via some sort of slack msg/alert. @maxwofford has referred me to relevant documentation on how to send custom events & hook up fullstory / Slack integration.

Screenshots

No response

Additional information

No response

grymmy commented 1 year ago

At minimum we should instrument:

  1. Enough signals to detect that the overall system is functioning as expected (submissions are being responded to w/ a reasonable distribution of correct/invalid/error results)
  2. A signal that records the amount of time each tweet submission takes to be responded to