Maude (admin of Signé Laval calendar) was in a meeting with the City of Laval, and she was unable to open event details for the recent events added by Aggregator. Maude informed Gregory who was also on the call.
11:15 AM ET
Hot fix deployed into production.
Lessons learnt
What went well
We were able to do a hot fix within 4 hrs of learning about the incident.
What went wrong
This incident was embarrassing because the client discovered the bug instead of us, and has to inform us of the problem.
Where we got lucky
The incident only affected some events (new events loaded by aggregator) that were in draft mode, so it did not impact the live calendar for the general public.
Incident Report
Summary
See https://github.com/culturecreates/footlight-app/issues/681
Timeline
8 AM ET
Maude (admin of Signé Laval calendar) was in a meeting with the City of Laval, and she was unable to open event details for the recent events added by Aggregator. Maude informed Gregory who was also on the call.
11:15 AM ET
Hot fix deployed into production.
Lessons learnt
What went well
We were able to do a hot fix within 4 hrs of learning about the incident.
What went wrong
This incident was embarrassing because the client discovered the bug instead of us, and has to inform us of the problem.
Where we got lucky
The incident only affected some events (new events loaded by aggregator) that were in draft mode, so it did not impact the live calendar for the general public.
Action items
Hot fix was tested and deployed to production. https://github.com/culturecreates/footlight-app/issues/681
Process improvements