search

GCTC-NTGC / gc-digital-talent

GC Digital Talent is the new recruitment platform for digital and tech jobs in the Government of Canada. // Talents numériques du GC est la nouvelle plateforme de recrutement pour les emplois numériques et technologiques au gouvernement du Canada.
https://talent.canada.ca
GNU Affero General Public License v3.0
19 stars 8 forks source link

🐛 New job notification has not been sent to all subscribers in the prod #11153

Closed brindasasi closed 2 weeks ago

brindasasi commented 1 month ago

🐛 Bug

A new job posted on Aug. 2 Friday and we have around 22k users subscribed for email notifications. I see only around 450 messages are sent out.

🦋 Expected Behaviour

All subscribers should get the appropriate emails

🕵️ Details

I believe any error in the email queue messes up the whole remaining delivery.

📋 Steps to Reproduce

Need further investigation based on prod incident.

📸 Screenshot

Add a screenshot (if possible).

🙋‍♀️ Proposed Solution

(optional) Do you have a proposed solution?

✅ Acceptance Criteria

A set of assumptions which, when tested, verify that the bug was addressed.

tristan-orourke commented 1 month ago

Rate limiting and not retrying, or we hit rate limit, or something wrong with the queue? We can check logs for failures (are they all fake emails?)