cds-snc / notification-planning-core

Project planning for GC Notify Core Team
0 stars 0 forks source link

Refine the celery errors alert #269

Open ben851 opened 6 months ago

ben851 commented 6 months ago

Description

As a developer of notify, I only want to be alerted when there are actionable errors that are encountered in the system so that we can maintain focus on day to day work and decrease alert fatigue.

WHY are we building?

There are errors that occur in celery that do not require intervention from us (Duplicate key constraints as an example.) Currently, these alerts cause critical alarms in notification-ops, but there is nothing for us to do in these cases.

WHAT are we building?

Refine the alerts to exclude expected errors (within reason - perhaps a threshold increase)

VALUE created by our solution

Close to the business, what's the value?

Acceptance Criteria

Given some context, when (X) action occurs, then (Y) outcome is achieved.

QA Steps