culturecreates / incident-reports

Reports on incidents in all products and services
0 stars 0 forks source link

2023-05-12 Missing containedInPlace relation #2

Closed saumier closed 9 months ago

saumier commented 1 year ago

Summary

The Footlight Console was showing events with 2 locations: Salle Odyssée and Maison de la Culture Gatineau. Both places where detected in the string "Salle Odyssée (Maison de la culture de Gatineau)" sent to the Reconciliation API. The Reconciliation Service, which is run daily on all place strings, found an exact match for both places and therefore added both placed to the Footlight Console.

Timeline

Issue detected yesterday afternoon. Problem was fixed and data updated same day.

2023-05-11 13:00

Caitlin detected the problem in Footlight Console while working on the Tout Culture website.

15:00

Gregory saw the Slack message from Caitlin, and worked on adding a relationship in Artsdata between Salle Odyssée and Maison de la Culture Gatineau. Normally this would have fixed the problem, however this did not work. Gregory then debugged the code in Artsdata Reconciliation Service and released an update in the production environment.

17:00

Gregory used Footlight Condenser to find and refresh all events taking place in Salle Odysee across all websites. The issue had begun to spread and was found in dozens of events on Ville de Gatineau, Salle Odyssee and Tout Culture web sites. All cases were fixed with a simple refresh of the event (now that the Reconciliation service was updated).

Lessons learnt

  1. The "containedInPlace" property is critical to the Reconciliation Service working as expected. Without this property relating places contained in other places, it is possible that both places match. Example is "Place des arts" and "Cinquieme Salle - Place des Arts".
  2. Even though 2 places were added, there was no negative impact and data loaded from Artsdata into CMS only had a single location. The data seems to be resilient.