mozilla-services / telescope

A dumb auditing service
Mozilla Public License 2.0
21 stars 10 forks source link

Correct uptake-release/error-rate check #1484

Closed alexcottner closed 2 months ago

alexcottner commented 2 months ago

Problem: the uptake-release/error-rate check compares successes vs failures. However if a client succeeds in syncing a large collection, we will see 1 success for the client. If it fails, we could see thousands of failures. Meaning this isn't an apples:apples comparison.

Possible solutions:

  1. Adjust the check's logic to only count 1 status per client. (probably be easy to do with aggregation)
  2. Exclude download-error messages as this is where the duplicate errors come from. This would then require a separate check for attachment downloads.