Closed itsderek23 closed 6 years ago
We ran an experiment for this, collecting data from a number of apps.
Based on the sample size, only 1% of deploys showed a visible change in app health following a deploy. This would be a high signal-to-noise ratio for a chat bot - for every 100 "deploy ok" messages, there would be just 1 "deploy bad" message.
Watching monitoring data after a deploy can be as boring. An automated health check that kicks off following a deploy, surfacing any issues, would address this.
Basic idea:
This would leverage some of the logic in #1.
Inspired by the GitHub Haystack bot.