github-actions[bot]
commented
3 days ago ❌ test_running_real_assessment_job_ext_hms: databricks.labs.blueprint.parallel.ManyError: Detected 16 failures: Unknown: assess_CLOUD_ENV_service_principals: run failed with error message (1m57.319s)
``` databricks.labs.blueprint.parallel.ManyError: Detected 16 failures: Unknown: assess_CLOUD_ENV_service_principals: run failed with error message Unexpected user error while preparing the cluster for the job. Cause: RESOURCE_DOES_NOT_EXIST: Can't find a cluster policy with id: 00140323ADB75B65., Unknown: assess_clusters: run failed with error message Unexpected user error while preparing the cluster for the job. Cause: RESOURCE_DOES_NOT_EXIST: Can't find a cluster policy with id: 00140323ADB75B65., Unknown: assess_dashboards: run failed with error message Unexpected user error while preparing the cluster for the job. Cause: RESOURCE_DOES_NOT_EXIST: Can't find a cluster policy with id: 00140323ADB75B65., Unknown: assess_global_init_scripts: run failed with error message Unexpected user error while preparing the cluster for the job. Cause: RESOURCE_DOES_NOT_EXIST: Can't find a cluster policy with id: 00140323ADB75B65., Unknown: assess_incompatible_submit_runs: run failed with error message Unexpected user error while preparing the cluster for the job. Cause: RESOURCE_DOES_NOT_EXIST: Can't find a cluster policy with id: 00140323ADB75B65., Unknown: assess_jobs: run failed with error message Unexpected user error while preparing the cluster for the job. Cause: RESOURCE_DOES_NOT_EXIST: Can't find a cluster policy with id: 00140323ADB75B65., Unknown: assess_pipelines: run failed with error message Unexpected user error while preparing the cluster for the job. Cause: RESOURCE_DOES_NOT_EXIST: Can't find a cluster policy with id: 00140323ADB75B65., Unknown: assess_workflows: run failed with error message Unexpected user error while preparing the cluster for the job. Cause: RESOURCE_DOES_NOT_EXIST: Can't find a cluster policy with id: 00140323ADB75B65., Unknown: crawl_cluster_policies: run failed with error message Unexpected user error while preparing the cluster for the job. Cause: RESOURCE_DOES_NOT_EXIST: Can't find a cluster policy with id: 00140323ADB75B65., Unknown: crawl_groups: run failed with error message Unexpected user error while preparing the cluster for the job. Cause: RESOURCE_DOES_NOT_EXIST: Can't find a cluster policy with id: 00140323ADB75B65., Unknown: crawl_mounts: run failed with error message Unexpected user error while preparing the cluster for the job. Cause: RESOURCE_DOES_NOT_EXIST: Can't find a cluster policy with id: 00140323ADB75B65., Unknown: crawl_tables: run failed with error message Unexpected user error while preparing the cluster for the job. Cause: RESOURCE_DOES_NOT_EXIST: Can't find a cluster policy with id: 00140323ADB75B65., Unknown: crawl_udfs: run failed with error message Unexpected user error while preparing the cluster for the job. Cause: RESOURCE_DOES_NOT_EXIST: Can't find a cluster policy with id: 00140323ADB75B65., Unknown: parse_logs: run failed with error message Unexpected user error while preparing the cluster for the job. Cause: RESOURCE_DOES_NOT_EXIST: Can't find a cluster policy with id: 00140323ADB75B65., Unknown: setup_tacl: run failed with error message Unexpected user error while preparing the cluster for the job. Cause: RESOURCE_DOES_NOT_EXIST: Can't find a cluster policy with id: 00140323ADB75B65., Unknown: workspace_listing: run failed with error message Unexpected user error while preparing the cluster for the job. Cause: RESOURCE_DOES_NOT_EXIST: Can't find a cluster policy with id: 00140323ADB75B65. [gw3] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python 05:07 INFO [tests.integration.conftest] Dashboard Created ucx_DdQH3_ra78a57ccb: https://DATABRICKS_HOST/sql/dashboards/ea85fe69-dfe0-4117-8192-29d8b5a585b8 05:07 INFO [tests.integration.conftest] Dashboard Created ucx_DAzMd_ra78a57ccb: https://DATABRICKS_HOST/sql/dashboards/16697a05-66c7-46d8-821f-43a6d0d8ca03 05:07 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.k4sl/config.yml) doesn't exist. 05:07 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:07 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:07 INFO [databricks.labs.ucx.install] Fetching installations... 05:07 INFO [databricks.labs.ucx.installer.policy] Setting up an external metastore 05:07 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:07 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:07 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:07 INFO [databricks.labs.ucx.install] Installing UCX v0.49.1+1320241113050716 05:07 INFO [databricks.labs.ucx.install] Creating ucx schemas... 05:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 05:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental 05:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 05:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy 05:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 05:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 05:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 05:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 05:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 05:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 05:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 05:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 05:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 05:08 INFO [databricks.labs.ucx.install] Creating dashboards... 05:08 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 05:08 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 05:08 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 05:08 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress... 05:08 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:08 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:08 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:08 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:08 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 05:08 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:08 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main... 05:08 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:08 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:08 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:08 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:08 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:08 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:08 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:08 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.k4sl/README for the next steps. 05:08 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/954052104405946 05:08 INFO [databricks.labs.ucx.installer.workflows] Started assessment job: https://DATABRICKS_HOST#job/954052104405946/runs/895871531088781 05:08 DEBUG [databricks.labs.ucx.installer.workflows] Waiting for completion of assessment job: https://DATABRICKS_HOST#job/954052104405946/runs/895871531088781 05:08 INFO [databricks.labs.ucx.installer.workflows] ---------- REMOTE LOGS -------------- 05:08 WARNING [databricks.labs.ucx.installer.workflows] Cannot fetch logs as folder /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.k4sl/logs/assessment does not exist 05:08 INFO [databricks.labs.ucx.installer.workflows] ---------- END REMOTE LOGS ---------- 05:07 INFO [tests.integration.conftest] Dashboard Created ucx_DdQH3_ra78a57ccb: https://DATABRICKS_HOST/sql/dashboards/ea85fe69-dfe0-4117-8192-29d8b5a585b8 05:07 INFO [tests.integration.conftest] Dashboard Created ucx_DAzMd_ra78a57ccb: https://DATABRICKS_HOST/sql/dashboards/16697a05-66c7-46d8-821f-43a6d0d8ca03 05:07 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.k4sl/config.yml) doesn't exist. 05:07 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:07 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:07 INFO [databricks.labs.ucx.install] Fetching installations... 05:07 INFO [databricks.labs.ucx.installer.policy] Setting up an external metastore 05:07 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:07 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:07 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:07 INFO [databricks.labs.ucx.install] Installing UCX v0.49.1+1320241113050716 05:07 INFO [databricks.labs.ucx.install] Creating ucx schemas... 05:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 05:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental 05:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 05:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy 05:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 05:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 05:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 05:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 05:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 05:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 05:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 05:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 05:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 05:08 INFO [databricks.labs.ucx.install] Creating dashboards... 05:08 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 05:08 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 05:08 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 05:08 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress... 05:08 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:08 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:08 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:08 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:08 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 05:08 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:08 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main... 05:08 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:08 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:08 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:08 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:08 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:08 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:08 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:08 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.k4sl/README for the next steps. 05:08 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/954052104405946 05:08 INFO [databricks.labs.ucx.installer.workflows] Started assessment job: https://DATABRICKS_HOST#job/954052104405946/runs/895871531088781 05:08 DEBUG [databricks.labs.ucx.installer.workflows] Waiting for completion of assessment job: https://DATABRICKS_HOST#job/954052104405946/runs/895871531088781 05:08 INFO [databricks.labs.ucx.installer.workflows] ---------- REMOTE LOGS -------------- 05:08 WARNING [databricks.labs.ucx.installer.workflows] Cannot fetch logs as folder /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.k4sl/logs/assessment does not exist 05:08 INFO [databricks.labs.ucx.installer.workflows] ---------- END REMOTE LOGS ---------- 05:08 INFO [databricks.labs.ucx.install] Deleting UCX v0.49.1+1320241113050716 from https://DATABRICKS_HOST 05:08 INFO [databricks.labs.ucx.install] Deleting inventory database dummy_sf2ia 05:08 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=918414297691294, as it is no longer needed 05:08 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=623620151831449, as it is no longer needed 05:08 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=763574043154087, as it is no longer needed 05:08 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=75233069681440, as it is no longer needed 05:08 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=332971472558465, as it is no longer needed 05:08 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1051198138656235, as it is no longer needed 05:08 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=329414483581813, as it is no longer needed 05:08 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=550998314862287, as it is no longer needed 05:08 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=729584434720434, as it is no longer needed 05:08 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=396536185105164, as it is no longer needed 05:08 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1088448686759280, as it is no longer needed 05:08 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=591026581394966, as it is no longer needed 05:08 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=954052104405946, as it is no longer needed 05:08 INFO [databricks.labs.ucx.install] Deleting cluster policy 05:08 ERROR [databricks.labs.ucx.install] UCX Policy already deleted 05:08 INFO [databricks.labs.ucx.install] Deleting secret scope 05:08 INFO [databricks.labs.ucx.install] UnInstalling UCX complete [gw3] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python ```Running from nightly #265
❌ test_running_real_assessment_job_ext_hms: databricks.labs.blueprint.parallel.ManyError: Detected 16 failures: Unknown: assess_CLOUD_ENV_service_principals: ImportError: cannot import name 'InvalidState' from 'databricks.sdk.errors' (/databricks/python/lib/python3.12/site-packages/databricks/sdk/errors/__init__.py), Unknown: assess_clusters: ImportError: cannot import name 'InvalidState' from 'databricks.sdk.errors' (/databricks/python/lib/python3.12/site-packages/databricks/sdk/errors/__init__.py), Unknown: assess_dashboards: ImportError: cannot import name 'InvalidState' from 'databricks.sdk.errors' (/databricks/python/lib/python3.12/site-packages/databricks/sdk/errors/__init__.py), Unknown: assess_global_init_scripts: ImportError: cannot import name 'InvalidState' from 'databricks.sdk.errors' (/databricks/python/lib/python3.12/site-packages/databricks/sdk/errors/__init__.py), Unknown: assess_incompatible_submit_runs: ImportError: cannot import name 'InvalidState' from 'databricks.sdk.errors' (/databricks/python/lib/python3.12/site-packages/databricks/sdk/errors/__init__.py), Unknown: assess_jobs: ImportError: cannot import name 'InvalidState' from 'databricks.sdk.errors' (/databricks/python/lib/python3.12/site-packages/databricks/sdk/errors/__init__.py), Unknown: assess_pipelines: ImportError: cannot import name 'InvalidState' from 'databricks.sdk.errors' (/databricks/python/lib/python3.12/site-packages/databricks/sdk/errors/__init__.py), Unknown: assess_workflows: ImportError: cannot import name 'InvalidState' from 'databricks.sdk.errors' (/databricks/python/lib/python3.12/site-packages/databricks/sdk/errors/__init__.py), Unknown: crawl_cluster_policies: ImportError: cannot import name 'InvalidState' from 'databricks.sdk.errors' (/databricks/python/lib/python3.12/site-packages/databricks/sdk/errors/__init__.py), Unknown: crawl_groups: ImportError: cannot import name 'InvalidState' from 'databricks.sdk.errors' (/databricks/python/lib/python3.12/site-packages/databricks/sdk/errors/__init__.py), Unknown: crawl_mounts: ImportError: cannot import name 'InvalidState' from 'databricks.sdk.errors' (/databricks/python/lib/python3.12/site-packages/databricks/sdk/errors/__init__.py), Unknown: crawl_tables: ImportError: cannot import name 'InvalidState' from 'databricks.sdk.errors' (/databricks/python/lib/python3.12/site-packages/databricks/sdk/errors/__init__.py), Unknown: crawl_udfs: ImportError: cannot import name 'InvalidState' from 'databricks.sdk.errors' (/databricks/python/lib/python3.12/site-packages/databricks/sdk/errors/__init__.py), Unknown: parse_logs: ImportError: cannot import name 'InvalidState' from 'databricks.sdk.errors' (/databricks/python/lib/python3.12/site-packages/databricks/sdk/errors/__init__.py), Unknown: setup_tacl: ImportError: cannot import name 'InvalidState' from 'databricks.sdk.errors' (/databricks/python/lib/python3.12/site-packages/databricks/sdk/errors/__init__.py), Unknown: workspace_listing: ImportError: cannot import name 'InvalidState' from 'databricks.sdk.errors' (/databricks/python/lib/python3.12/site-packages/databricks/sdk/errors/__init__.py) (15m23.538s)
``` databricks.labs.blueprint.parallel.ManyError: Detected 16 failures: Unknown: assess_CLOUD_ENV_service_principals: ImportError: cannot import name 'InvalidState' from 'databricks.sdk.errors' (/databricks/python/lib/python3.12/site-packages/databricks/sdk/errors/__init__.py), Unknown: assess_clusters: ImportError: cannot import name 'InvalidState' from 'databricks.sdk.errors' (/databricks/python/lib/python3.12/site-packages/databricks/sdk/errors/__init__.py), Unknown: assess_dashboards: ImportError: cannot import name 'InvalidState' from 'databricks.sdk.errors' (/databricks/python/lib/python3.12/site-packages/databricks/sdk/errors/__init__.py), Unknown: assess_global_init_scripts: ImportError: cannot import name 'InvalidState' from 'databricks.sdk.errors' (/databricks/python/lib/python3.12/site-packages/databricks/sdk/errors/__init__.py), Unknown: assess_incompatible_submit_runs: ImportError: cannot import name 'InvalidState' from 'databricks.sdk.errors' (/databricks/python/lib/python3.12/site-packages/databricks/sdk/errors/__init__.py), Unknown: assess_jobs: ImportError: cannot import name 'InvalidState' from 'databricks.sdk.errors' (/databricks/python/lib/python3.12/site-packages/databricks/sdk/errors/__init__.py), Unknown: assess_pipelines: ImportError: cannot import name 'InvalidState' from 'databricks.sdk.errors' (/databricks/python/lib/python3.12/site-packages/databricks/sdk/errors/__init__.py), Unknown: assess_workflows: ImportError: cannot import name 'InvalidState' from 'databricks.sdk.errors' (/databricks/python/lib/python3.12/site-packages/databricks/sdk/errors/__init__.py), Unknown: crawl_cluster_policies: ImportError: cannot import name 'InvalidState' from 'databricks.sdk.errors' (/databricks/python/lib/python3.12/site-packages/databricks/sdk/errors/__init__.py), Unknown: crawl_groups: ImportError: cannot import name 'InvalidState' from 'databricks.sdk.errors' (/databricks/python/lib/python3.12/site-packages/databricks/sdk/errors/__init__.py), Unknown: crawl_mounts: ImportError: cannot import name 'InvalidState' from 'databricks.sdk.errors' (/databricks/python/lib/python3.12/site-packages/databricks/sdk/errors/__init__.py), Unknown: crawl_tables: ImportError: cannot import name 'InvalidState' from 'databricks.sdk.errors' (/databricks/python/lib/python3.12/site-packages/databricks/sdk/errors/__init__.py), Unknown: crawl_udfs: ImportError: cannot import name 'InvalidState' from 'databricks.sdk.errors' (/databricks/python/lib/python3.12/site-packages/databricks/sdk/errors/__init__.py), Unknown: parse_logs: ImportError: cannot import name 'InvalidState' from 'databricks.sdk.errors' (/databricks/python/lib/python3.12/site-packages/databricks/sdk/errors/__init__.py), Unknown: setup_tacl: ImportError: cannot import name 'InvalidState' from 'databricks.sdk.errors' (/databricks/python/lib/python3.12/site-packages/databricks/sdk/errors/__init__.py), Unknown: workspace_listing: ImportError: cannot import name 'InvalidState' from 'databricks.sdk.errors' (/databricks/python/lib/python3.12/site-packages/databricks/sdk/errors/__init__.py) [gw6] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python 05:06 INFO [tests.integration.conftest] Dashboard Created ucx_DpZPB_ra78a57c67: https://DATABRICKS_HOST/sql/dashboards/bc59541e-74d1-4171-a49f-448cf493030e 05:06 INFO [tests.integration.conftest] Dashboard Created ucx_DREHG_ra78a57c67: https://DATABRICKS_HOST/sql/dashboards/b2fe1a28-45f6-4707-a24e-ebb538e8cab8 05:06 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.a4X2/config.yml) doesn't exist. 05:06 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:06 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:06 INFO [databricks.labs.ucx.install] Fetching installations... 05:06 INFO [databricks.labs.ucx.installer.policy] Setting up an external metastore 05:06 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:06 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:10 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:10 INFO [databricks.labs.ucx.install] Installing UCX v0.49.1+1020241112051050 05:10 INFO [databricks.labs.ucx.install] Creating ucx schemas... 05:10 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 05:10 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 05:10 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy 05:10 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental 05:10 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 05:10 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 05:10 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 05:10 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 05:11 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 05:11 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 05:11 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 05:11 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 05:11 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 05:14 INFO [databricks.labs.ucx.install] Creating dashboards... 05:14 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 05:14 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 05:14 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 05:14 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress... 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main... 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.a4X2/README for the next steps. 05:14 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/37254605489178 05:14 INFO [databricks.labs.ucx.installer.workflows] Started assessment job: https://DATABRICKS_HOST#job/37254605489178/runs/95389356298218 05:14 DEBUG [databricks.labs.ucx.installer.workflows] Waiting for completion of assessment job: https://DATABRICKS_HOST#job/37254605489178/runs/95389356298218 05:21 INFO [databricks.labs.ucx.installer.workflows] ---------- REMOTE LOGS -------------- 05:21 WARNING [databricks.labs.ucx.installer.workflows] Cannot fetch logs as folder /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.a4X2/logs/assessment does not exist 05:21 INFO [databricks.labs.ucx.installer.workflows] ---------- END REMOTE LOGS ---------- 05:06 INFO [tests.integration.conftest] Dashboard Created ucx_DpZPB_ra78a57c67: https://DATABRICKS_HOST/sql/dashboards/bc59541e-74d1-4171-a49f-448cf493030e 05:06 INFO [tests.integration.conftest] Dashboard Created ucx_DREHG_ra78a57c67: https://DATABRICKS_HOST/sql/dashboards/b2fe1a28-45f6-4707-a24e-ebb538e8cab8 05:06 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.a4X2/config.yml) doesn't exist. 05:06 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:06 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:06 INFO [databricks.labs.ucx.install] Fetching installations... 05:06 INFO [databricks.labs.ucx.installer.policy] Setting up an external metastore 05:06 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:06 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:10 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:10 INFO [databricks.labs.ucx.install] Installing UCX v0.49.1+1020241112051050 05:10 INFO [databricks.labs.ucx.install] Creating ucx schemas... 05:10 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 05:10 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 05:10 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy 05:10 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental 05:10 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 05:10 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 05:10 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 05:10 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 05:11 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 05:11 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 05:11 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 05:11 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 05:11 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 05:14 INFO [databricks.labs.ucx.install] Creating dashboards... 05:14 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 05:14 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 05:14 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 05:14 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress... 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main... 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.a4X2/README for the next steps. 05:14 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/37254605489178 05:14 INFO [databricks.labs.ucx.installer.workflows] Started assessment job: https://DATABRICKS_HOST#job/37254605489178/runs/95389356298218 05:14 DEBUG [databricks.labs.ucx.installer.workflows] Waiting for completion of assessment job: https://DATABRICKS_HOST#job/37254605489178/runs/95389356298218 05:21 INFO [databricks.labs.ucx.installer.workflows] ---------- REMOTE LOGS -------------- 05:21 WARNING [databricks.labs.ucx.installer.workflows] Cannot fetch logs as folder /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.a4X2/logs/assessment does not exist 05:21 INFO [databricks.labs.ucx.installer.workflows] ---------- END REMOTE LOGS ---------- 05:21 INFO [databricks.labs.ucx.install] Deleting UCX v0.49.1+1020241112051050 from https://DATABRICKS_HOST 05:21 INFO [databricks.labs.ucx.install] Deleting inventory database dummy_s4qja 05:21 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=338477512033184, as it is no longer needed 05:21 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=635443392938814, as it is no longer needed 05:21 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=907236380127905, as it is no longer needed 05:21 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=182003173388770, as it is no longer needed 05:21 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=757068275348552, as it is no longer needed 05:21 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=420352026749638, as it is no longer needed 05:21 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=832571309769051, as it is no longer needed 05:21 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=42146361002385, as it is no longer needed 05:21 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=374961209915942, as it is no longer needed 05:21 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=799735299395736, as it is no longer needed 05:21 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=37254605489178, as it is no longer needed 05:21 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=709544506125265, as it is no longer needed 05:21 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=753654068991649, as it is no longer needed 05:21 INFO [databricks.labs.ucx.install] Deleting cluster policy 05:21 INFO [databricks.labs.ucx.install] Deleting secret scope 05:21 INFO [databricks.labs.ucx.install] UnInstalling UCX complete [gw6] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python ```Running from nightly #264