orcfax / Incidents

A repository to triage and report issues in Orcfax network operations
1 stars 0 forks source link

INCIDENT 005 | Self-signed SSL certificate expiry #5

Open Christian-MK opened 10 months ago

Christian-MK commented 10 months ago

Trigger

Date

2023-10-27

Summary

the self-signed security socket layer (SSL) certificate used by the COOP publication services expired prior to a routine publication. This prevented the 08:00 UTC publication from executing.

Status

Resolved

Assessment

Monitoring caught the issue and a resolution was implemented with certificate renewal.

Additional Notes

Monitoring caught the issue quickly, and was able to initiate a new publication by 08:25 UTC.

The self-signed SSL certificate must be renewed every 30 days. the current certificate has a validity window of:

Not Before: Oct 27 15:21:25 2023 GMT
Not After : Nov 26 15:21:25 2023 GMT 

Technical improvements

  1. Specific monitoring for self-signed SSL certificate validity will be implemented.
  2. Certificate renewal alerts will be implemented.

Documentation improvements

  1. Renewal events have been well documented in pre-prod testing, because of this the monitoring team was well equipped to respond timely to the error. Methods for resolving this issue on Mainnet have been documented.
Christian-MK commented 9 months ago

Removal of citations