Rename Azure resources and restructure GitHub workflows

tjementum commented 3 months ago

Summary & Motivation

Introduce major changes to the naming and structure of Azure resources and GitHub workflows, requiring all resources to be deleted and recreated.

The current structure had 3 deployment units: cluster, environment, and shared, where shared only had an Azure Container Registry (ACR). Going forward, each environment has its own container registry (ACR), so only environment (Production, Staging) and clusters (West EU, East US) are needed.

Also, the naming of Azure resources has been updated to use the following formula: uniquePrefix-environment-locationAcronym-name. Examples include:

uniquePrefix (2-6 characters): e.g., pp, ppdemo
environment (max 5 characters): e.g., prod, dev, qa, stage
locationAcronym (max 4 characters): e.g., weu, eus2
name (for some resources like storage accounts there is a max of 24 characters, so depending on the length of uniquePrefix this allows for 9-13 characters)

There are a couple of exceptions:

Azure Storage Accounts, Azure Container Apps, etc., do not allow - in names
Child resources like Azure Container Apps (ACA) and SQL databases are not prefixed, as ACA has a limit of 32 characters, making names too cryptic

Examples of cluster-specific resources:

Resource Group: ppdemo-stage-weu, ppdemo-prod-eus2
SQL Server: ppdemo-stage-weu, ppdemo-prod-eus2
SQL Server database: account-management, back-office
Azure Container App Environment: ppdemo-stage-weu, ppdemo-prod-eus2
Azure Container Apps: account-management-api, back-office-worker
Managed Identity: ppdemo-stage-weu-account-management, ppdemo-prod-eus2-back-office
Key Vault: ppdemo-stage-weu, ppdemo-prod-eus2
Virtual Network: ppdemo-stage-weu, ppdemo-prod-eus2
Communication Service: ppdemo-stage-weu, ppdemo-prod-eus2
Storage Accounts: ppdemostageeuwacctmgmt, ppdemostageweudiagnostic

Examples of environment-specific resources:

Application Insights: ppdemo-stage, ppdemo-prod
Log Analytics workspace: ppdemo-stage, ppdemo-prod
Container Registry: ppdemostage, ppdemoprod

All Bicep scripts have been updated, and the deployment names used by Azure have been streamlined to be very clear.

Update GitHub workflows to reflect the new structure with only cluster and environment. Also, update GitHub workflows by combining the two reusable workflows: "Deploy container" workflow and "Publish Container". Now the publish container is done as part of Deploy to staging. This simplifies and speeds up the workflow, requiring fewer logins to Azure and ACR, and provides a clearer visual overview in GitHub: Build and Test > Staging > Production.

All Bash scripts used to deploy have been updated to reflect the new changes. Likewise, the configure-continuous-deployments CLI command has been updated to reflect the simplified setup (one less GitHub environment, UNIQUE_CLUSTER_PREFIX has been changed to UNIQUE_PREFIX and CONTAINER_REGISTRY_NAME has been dropped as it's not dynamic).

Delete unused or unmaintained Bicep modules, including Azure Service Bus, SQL Server Elastic Pool, Private Endpoints, etc. Delete the shared environment with Azure Container Registry.

Update README with new naming conventions for Azure resources and describe how multiple self-contained systems work together.