search

cagov / odi-engineering

California Office of Digital Innovation engineering documentation
MIT License
2 stars 0 forks source link

Document Aug 11 covid19 publishing failure #87

Closed zakiya closed 1 year ago

zakiya commented 2 years ago

Since our Slack history isn't permanent, please document what happened, troubleshooting steps, and how the issue was resolved.

carterm commented 2 years ago

CDT accidentally deleted fa-cdt-covid19-d-001 on August 10th. Because the service name had a -d- in it, and it was on the CDT/ODI Development resource group, they thought it was safe to delete.

Azure has an Activity log panel associated with resource groups where Delete website activities can be discovered.

Unfortunately, Azure has no way to store site owner/description information in the resource (unlike AWS) so it there is no way to add documentation to discourage accidental deletes.

carterm commented 2 years ago

CDT was able to manually recreate the resource, but settings/source connections had to be manually configured. This site appears to be functioning normally.

zakiya commented 2 years ago

Was it moved to a different resource group and/or renamed? I'd like to minimize the chance of it happening again.

zakiya commented 2 years ago

@carterm Can you answer the question above?

carterm commented 2 years ago

It was not moved. Still in the CDT/ODI Development resource group. Renaming and moving might break links/relations.