Closed sahalali closed 9 months ago
See https://github.com/culturecreates/footlight-calendar-api/issues/814
The stringification of json-ld was removed to beautify the response.
Hotfix deployed into production.
Any response change should be communicated and approved by clients before updating.
We were able to do a hotfix within a day of learning about the incident.
This incident was embarrassing because the client discovered the bug instead of us, and had to inform us of the problem.
We could then fix the issue as soon as the developer's day started.
No API response should be changed before approval from clients.
API response changes should be approved before implmentation.
@sahalali Your report looks good. Thx. I will close it.
Incident Report
Summary
See https://github.com/culturecreates/footlight-calendar-api/issues/814
Timeline
2023-11-22
The stringification of json-ld was removed to beautify the response.
2023-11-23
Hotfix deployed into production.
Lessons learned
Any response change should be communicated and approved by clients before updating.
What went well
We were able to do a hotfix within a day of learning about the incident.
What went wrong
This incident was embarrassing because the client discovered the bug instead of us, and had to inform us of the problem.
Where we got lucky
We could then fix the issue as soon as the developer's day started.
Action items
No API response should be changed before approval from clients.
Process improvements
API response changes should be approved before implmentation.