Use Visual Testing Tool to Monitor Production

[pjhill]

Description

Platform needs a solution for monitoring production for visual differences. Platform needs to detect issues in production before other stakeholders receive complaints.

Recent Events

Recently images failed to load in production, but did not appear to throw other errors that we could detect with existing AWS Canaries / Synthetic Monitoring. Platform wants to be able to detect previously undefined issues in production with visual testing / monitoring.

Assumptions

• There are 43,800 minutes in a month.
• We want to leverage Puppeteer and AWS Canaries to capture the screen shots for evaluation.
• We want to use Percy. (Percy can be used to visually test in our CI/CD pipeline and having Percy perform double duty makes sense).

Questions

• How frequently should this monitoring occur?
• Where are issues reported to? (#oncall / PagerDuty)
• Does the layer

[pjhill]

We may still do this, so I'll leave it open in the backlog.