[SPIKE] Basic sync process logging and monitoring

[OlgaPotiagalova]

The assumption is that synchronization data between new BR and COLIN is a temporary solution, however it might still be in place after the MVP release for some period of time. We are looking for a straightforward solution to track and alert on sync failures without a full-scale development effort. The goal is to have a basic setup that captures essential error information and provides quick notification. This could be as simple as utilizing existing tools and configuring log entries

Log for each instance of data sync : status, type of change/update, timestamp, error. Logs/instances recorded should be easy to retrieve and review Alert in case of sync failure based on specific log entries or failed codes, with applied thresholds.

Approach

• [x] Create a query to track the discrepancies SELECT b.identifier, f.filing_type, f.id FROM public.filings f LEFT JOIN public.colin_event_ids c on f.id = c.filing_id JOIN public.businesses b on b.id = f.business_id WHERE c.filing_id is null AND f.filing_type not in ('lear_epoch', 'adminFreeze', 'courtOrder', 'registrarsNotation', 'registrarsOrder') AND f.status = 'COMPLETED' AND b.legal_type not in ('SP', 'GP', 'CP')
• [x] Setup the query to run on a schedule
• [x] Create a workflow to pickup the output of the query and send an email notification to interested parties
• Subject of the email
• Recipients
• Schedule

[OlgaPotiagalova]

Title: Sync Failure Notification Recipients: Riyaz, Vysakh, Vikas, Olga Schedule: daily at 6 am