https://playbook.cio.gov
Playbook Reference: PLAY 12 No1-8) Monitor system-level resource utilization in real time
Monitor system performance in real-time (e.g. response time, latency, throughput, and error rates)
Ensure monitoring can measure median, 95th percentile, and 98th percentile performance
Create automated alerts based on this monitoring
Track concurrent users in real-time, and monitor user behaviors in the aggregate to determine how well the service meets user needs
Publish metrics internally
Publish metrics externally
Use an experimentation tool that supports multivariate testing in production
https://playbook.cio.gov Playbook Reference: PLAY 12 No1-8) Monitor system-level resource utilization in real time Monitor system performance in real-time (e.g. response time, latency, throughput, and error rates) Ensure monitoring can measure median, 95th percentile, and 98th percentile performance Create automated alerts based on this monitoring Track concurrent users in real-time, and monitor user behaviors in the aggregate to determine how well the service meets user needs Publish metrics internally Publish metrics externally Use an experimentation tool that supports multivariate testing in production