databrickslabs / ucx

Automated migrations to Unity Catalog
Other
217 stars 75 forks source link

[BUG]: migrate-locations command - Subscription ID error #1632

Closed heydil closed 4 months ago

heydil commented 4 months ago

Is there an existing issue for this?

Current Behavior

Encountering an error when attempting to run the migrate-locations command. The command throws the following error message:

ValueError: Please enter subscription id to scan storage accounts in.

I've reviewed the documentation on GitHub and included the subscription ID flag while running the command. However, this doesn't seem to resolve the issue.

image

Generated the azure_storage_account_info.csv file using principal-prefix-access command, and run both migrate-credentials and validate-external-locations commands successfully.

Expected Behavior

According to the documentation, the migrate-locations command should not prompt for a subscription ID. It should be able to identify the relevant subscription itself. Additionally, should successfully create the external location in the Databricks workspace.

Steps To Reproduce

  1. Configured Databricks profile: Added the subscription ID and set auth_type=azure_cli.
  2. Installed and configured Azure CLI via az-login.
  3. Verified the external location exists in the dashboard/hive_metastore.ucx.external_locations table. image
  4. Generated the azure_storage_account_info.csv file using the principal-prefix-access command.
  5. Successfully executed migrate-credentials command. image
  6. Successfully ran databricks labs ucx validate-external-locations, which created the TF file. image
  7. Used the same Databricks configuration file (~/.databrickscfg) throughout the entire process.

Cloud

Azure

Operating System

Windows

Version

latest via Databricks CLI

Relevant log output

ERROR [src/databricks/labs/ucx.migrate-locations] ValueError: Please enter subscription id to scan storage accounts in.
gregorymiguel commented 4 months ago

Hi @heydil They are fixing this issue here #1619.

nkvuong commented 4 months ago

closed by #1619