Open cristinaleonr opened 9 months ago
Checks for 1% of traffic:
Download performance closely matches the full test.
Bytes sent top out at about 250MB.
Stable number of client-side errors over the past week.
Stable number of ndt7 download errors.
Global NDT test rate also stable.
Alerts firing unrelated to launch.
Checks for 10% of traffic:
Download performance (last 7 days) closely matches the full test.
Bytes sent (last 7 days) top out at about 250MB.
Stable number of client-side errors over the past week.
Stable number of ndt7 download errors (last 15 days).
Global NDT test rate also stable (last 15 days).
Alerts firing unrelated to launch.
Checks for 30% of traffic:
Stable number of client-side errors over the past week.
Increasing number of ndt7+wss download measurer-closed-early
errors in ndt7 (expected). Other errors seem stable (last 15 days).
Granular performance comparisons at the site/metro/AS level show comparable ndt7 download performance for early-exit ("short") and full tests.
Checks for 50% of traffic:
Download performance (last 7 days) closely matches the full test.
Bytes sent (last 7 days) top out at about 250MB.
Stable number of client-side errors over the past week.
Stable number of ndt7 download errors (last 15 days).
Global NDT test rate stable (last 15 days).
Alerts firing unrelated to launch.
Granular performance comparisons (CDFs/geometric distance) at the site/metro/AS level show comparable ndt7 download performance for early-exit ("short") and full tests.
Objective:
Monitor the phased rollout of early-exit NDT.
Steps:
Rollout dashboard:
https://grafana.mlab-oti.measurementlab.net/d/W8JPPzzIz/ndt-early-exit?orgId=1
Criteria before progressing:
Rollback criteria:
Things we expect to change: