Single tech/databricks 295 remove subnet

[jsburckhardt]

Type of PR

• [ ] Documentation changes
• [x] Code changes
• [ ] Test changes
• [ ] CI-CD changes
• [ ] GitHub Template changes

Purpose

• Remove subnets from the whitelist in Storage Account and Key Vault

Does this introduce a breaking change?

• [ ] Yes
• [x] No

Author pre-publish checklist:

• [ ] Added test to prove my fix is effective or new feature works
• [x] No PII in logs
• [ ] Made corresponding changes to the documentation

Validation steps

• create environment variables:

  export DEPLOYMENT_PREFIX=nsns03
  export AZURE_SUBSCRIPTION_ID=6d4b6e53-2dbe-4f3c-9bd5-7dfba89d7edc
  export AZURE_RESOURCE_GROUP_NAME=nsns-lumos-rg-03
  export DELETE_RESOURCE_GROUP=true

• deploy sample 2

  cd sample2_enterprise_azure_databricks_environment/
  ./deploy.sh

• validate Storage Account does not have subnets in the whitelist network

• validate Key Vault does not have subnets in the whitelist network

• deploy sample 3

  cd ../sample3_cluster_provisioning_and_data_access/
  # provide local access to the storage account to upload sample data
  az storage account network-rule add --resource-group "$AZURE_RESOURCE_GROUP_NAME" --account-name "${DEPLOYMENT_PREFIX}asa01" --ip-address "$(curl -s ifconfig.me)" --output none
  # deploy
  ./deploy.sh
  # remove local access to the storage account 
  az storage account network-rule remove --resource-group "$AZURE_RESOURCE_GROUP_NAME" --account-name "${DEPLOYMENT_PREFIX}asa01" --ip-address "$(curl -s ifconfig.me)" --output none

• access ADB and run the notebooks in their respective clusters.

  • Validate access to Key Vault

  • Validate access to Storage Account

• delete resources

  cd ../sample2_enterprise_azure_databricks_environment/
  ./destroy.sh

Issues Closed or Referenced

• Closes #295