search

databrickslabs / ucx

Automated migrations to Unity Catalog
Other
237 stars 83 forks source link

Test failure: `test_running_real_assessment_job` #2637

Closed github-actions[bot] closed 1 month ago

github-actions[bot] commented 2 months ago
❌ test_running_real_assessment_job: databricks.labs.blueprint.parallel.ManyError: Detected 13 failures: Unknown: assess_CLOUD_ENV_service_principals: run failed with error message (13m55.085s) ``` databricks.labs.blueprint.parallel.ManyError: Detected 13 failures: Unknown: assess_CLOUD_ENV_service_principals: run failed with error message Could not reach driver of cluster DATABRICKS_CLUSTER_ID., Unknown: assess_clusters: run failed with error message Execution context '8126861808976743476' in cluster 'DATABRICKS_CLUSTER_ID' is not found., Unknown: assess_global_init_scripts: run failed with error message Could not reach driver of cluster DATABRICKS_CLUSTER_ID., Unknown: assess_incompatible_submit_runs: run failed with error message Execution context '2784189346210220447' in cluster 'DATABRICKS_CLUSTER_ID' is not found., Unknown: assess_jobs: run failed with error message Could not reach driver of cluster DATABRICKS_CLUSTER_ID., Unknown: assess_pipelines: run failed with error message Could not reach driver of cluster DATABRICKS_CLUSTER_ID., Unknown: crawl_cluster_policies: run failed with error message Could not reach driver of cluster DATABRICKS_CLUSTER_ID., Unknown: crawl_groups: run failed with error message Could not reach driver of cluster DATABRICKS_CLUSTER_ID., Unknown: crawl_mounts: run failed with error message Could not reach driver of cluster DATABRICKS_CLUSTER_ID., Unknown: crawl_tables: run failed with error message Could not reach driver of cluster DATABRICKS_CLUSTER_ID., Unknown: parse_logs: run failed with error message Cluster 'DATABRICKS_CLUSTER_ID' was terminated. Reason: USER_REQUEST (SUCCESS). Parameters: username:0a330eb5-dd51-4d97-b6e4-c474356b1d5d., Unknown: setup_tacl: run failed with error message Could not reach driver of cluster TEST_LEGACY_TABLE_ACL_CLUSTER_ID., Unknown: workspace_listing: run failed with error message Execution context '320163264727090671' in cluster 'DATABRICKS_CLUSTER_ID' is not found. [gw4] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-rhfn-ra78a52f0f@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-rhfn-ra78a52f0f@example.com')], entitlements=[], external_id=None, groups=[], id='7776748777860127', name=Name(family_name=None, given_name='sdk-rhfn-ra78a52f0f@example.com'), roles=[], schemas=[, ], user_name='sdk-rhfn-ra78a52f0f@example.com') 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx-5CIw-ra78a52f0f: https://DATABRICKS_HOST#setting/accounts/groups/949509652981835 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx-5CIw-ra78a52f0f', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='949509652981835', members=[ComplexValue(display='sdk-rhfn-ra78a52f0f@example.com', primary=None, ref='Users/7776748777860127', type=None, value='7776748777860127')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx-5CIw-ra78a52f0f: https://accounts.CLOUD_ENVdatabricks.net/users/groups/622591673668951/members 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx-5CIw-ra78a52f0f', entitlements=[], external_id=None, groups=[], id='622591673668951', members=[ComplexValue(display='sdk-rhfn-ra78a52f0f@example.com', primary=None, ref='Users/7776748777860127', type=None, value='7776748777860127')], meta=None, roles=[], schemas=[]) 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/000F202DB90280B7 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='000F202DB90280B7') 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 000F202DB90280B7 [group_name admins CAN_USE] -> [group_name ucx-5CIw-ra78a52f0f CAN_USE] 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sdiie: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sdiie 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sdiie', metastore_id=None, name='ucx_sdiie', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 05:07 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.NGWz/config.yml) doesn't exist. 05:07 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:07 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:07 INFO [databricks.labs.ucx.install] Fetching installations... 05:07 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:07 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:15 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:15 INFO [databricks.labs.ucx.install] Installing UCX v0.36.1+420240914051504 05:15 INFO [databricks.labs.ucx.install] Creating ucx schemas... 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 05:15 INFO [databricks.labs.ucx.install] Creating dashboards... 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 05:15 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 05:15 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 05:15 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.NGWz/README for the next steps. 05:15 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/248814344209277 05:15 INFO [databricks.labs.ucx.installer.workflows] Started assessment job: https://DATABRICKS_HOST#job/248814344209277/runs/219586368358351 05:15 DEBUG [databricks.labs.ucx.installer.workflows] Waiting for completion of assessment job: https://DATABRICKS_HOST#job/248814344209277/runs/219586368358351 05:20 INFO [databricks.labs.ucx.installer.workflows] ---------- REMOTE LOGS -------------- 05:20 WARNING [databricks.labs.ucx.installer.workflows] Cannot fetch logs as folder /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.NGWz/logs/assessment does not exist 05:20 INFO [databricks.labs.ucx.installer.workflows] ---------- END REMOTE LOGS ---------- 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-rhfn-ra78a52f0f@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-rhfn-ra78a52f0f@example.com')], entitlements=[], external_id=None, groups=[], id='7776748777860127', name=Name(family_name=None, given_name='sdk-rhfn-ra78a52f0f@example.com'), roles=[], schemas=[, ], user_name='sdk-rhfn-ra78a52f0f@example.com') 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx-5CIw-ra78a52f0f: https://DATABRICKS_HOST#setting/accounts/groups/949509652981835 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx-5CIw-ra78a52f0f', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='949509652981835', members=[ComplexValue(display='sdk-rhfn-ra78a52f0f@example.com', primary=None, ref='Users/7776748777860127', type=None, value='7776748777860127')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx-5CIw-ra78a52f0f: https://accounts.CLOUD_ENVdatabricks.net/users/groups/622591673668951/members 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx-5CIw-ra78a52f0f', entitlements=[], external_id=None, groups=[], id='622591673668951', members=[ComplexValue(display='sdk-rhfn-ra78a52f0f@example.com', primary=None, ref='Users/7776748777860127', type=None, value='7776748777860127')], meta=None, roles=[], schemas=[]) 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/000F202DB90280B7 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='000F202DB90280B7') 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 000F202DB90280B7 [group_name admins CAN_USE] -> [group_name ucx-5CIw-ra78a52f0f CAN_USE] 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sdiie: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sdiie 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sdiie', metastore_id=None, name='ucx_sdiie', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 05:07 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.NGWz/config.yml) doesn't exist. 05:07 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:07 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:07 INFO [databricks.labs.ucx.install] Fetching installations... 05:07 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:07 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:15 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:15 INFO [databricks.labs.ucx.install] Installing UCX v0.36.1+420240914051504 05:15 INFO [databricks.labs.ucx.install] Creating ucx schemas... 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 05:15 INFO [databricks.labs.ucx.install] Creating dashboards... 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 05:15 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 05:15 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 05:15 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.NGWz/README for the next steps. 05:15 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/248814344209277 05:15 INFO [databricks.labs.ucx.installer.workflows] Started assessment job: https://DATABRICKS_HOST#job/248814344209277/runs/219586368358351 05:15 DEBUG [databricks.labs.ucx.installer.workflows] Waiting for completion of assessment job: https://DATABRICKS_HOST#job/248814344209277/runs/219586368358351 05:20 INFO [databricks.labs.ucx.installer.workflows] ---------- REMOTE LOGS -------------- 05:20 WARNING [databricks.labs.ucx.installer.workflows] Cannot fetch logs as folder /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.NGWz/logs/assessment does not exist 05:20 INFO [databricks.labs.ucx.installer.workflows] ---------- END REMOTE LOGS ---------- 05:20 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster_policy permissions fixtures 05:20 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster_policy permissions fixture: 000F202DB90280B7 [group_name admins CAN_USE] -> [group_name ucx-5CIw-ra78a52f0f CAN_USE] 05:20 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster policy fixtures 05:20 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster policy fixture: CreatePolicyResponse(policy_id='000F202DB90280B7') 05:20 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while cluster policy CreatePolicyResponse(policy_id='000F202DB90280B7') teardown: Can't find a cluster policy with id: 000F202DB90280B7. 05:20 INFO [databricks.labs.ucx.install] Deleting UCX v0.36.1+420240914051504 from https://DATABRICKS_HOST 05:20 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_sdiie 05:20 INFO [databricks.labs.ucx.install] Deleting jobs 05:20 INFO [databricks.labs.ucx.install] Deleting migrate-external-hiveserde-tables-in-place-experimental job_id=685448053360681. 05:20 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=176194213641268. 05:20 INFO [databricks.labs.ucx.install] Deleting scan-tables-in-mounts-experimental job_id=983302929786690. 05:20 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=980659115804231. 05:20 INFO [databricks.labs.ucx.install] Deleting failing job_id=677469321941345. 05:20 INFO [databricks.labs.ucx.install] Deleting migrate-data-reconciliation job_id=834753686913060. 05:20 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=822215908213796. 05:20 INFO [databricks.labs.ucx.install] Deleting migrate-external-tables-ctas job_id=791219352068986. 05:20 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=1112731250011593. 05:20 INFO [databricks.labs.ucx.install] Deleting assessment job_id=248814344209277. 05:20 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=1084042355917653. 05:20 INFO [databricks.labs.ucx.install] Deleting experimental-workflow-linter job_id=537986913842542. 05:20 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=322793241209833. 05:20 INFO [databricks.labs.ucx.install] Deleting cluster policy 05:20 ERROR [databricks.labs.ucx.install] UCX Policy already deleted 05:20 INFO [databricks.labs.ucx.install] Deleting secret scope 05:20 INFO [databricks.labs.ucx.install] UnInstalling UCX complete 05:20 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace user fixtures 05:20 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='sdk-rhfn-ra78a52f0f@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-rhfn-ra78a52f0f@example.com')], entitlements=[], external_id=None, groups=[], id='7776748777860127', name=Name(family_name=None, given_name='sdk-rhfn-ra78a52f0f@example.com'), roles=[], schemas=[, ], user_name='sdk-rhfn-ra78a52f0f@example.com') 05:20 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 account group fixtures 05:20 DEBUG [databricks.labs.ucx.mixins.fixtures] removing account group fixture: Group(display_name='ucx-5CIw-ra78a52f0f', entitlements=[], external_id=None, groups=[], id='622591673668951', members=[ComplexValue(display='sdk-rhfn-ra78a52f0f@example.com', primary=None, ref='Users/7776748777860127', type=None, value='7776748777860127')], meta=None, roles=[], schemas=[]) 05:20 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace group fixtures 05:20 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace group fixture: Group(display_name='ucx-5CIw-ra78a52f0f', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='949509652981835', members=[ComplexValue(display='sdk-rhfn-ra78a52f0f@example.com', primary=None, ref='Users/7776748777860127', type=None, value='7776748777860127')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 05:20 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 05:20 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 05:20 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 schema fixtures 05:20 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sdiie', metastore_id=None, name='ucx_sdiie', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw4] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```

Running from nightly #195

JCZuurmond commented 2 months ago

Not failing anymore

JCZuurmond commented 1 month ago

Failed again today: https://github.com/databrickslabs/ucx/actions/runs/11007362115/job/30563142660

ericvergnaud commented 1 month ago

Fixed by PR #2696

JCZuurmond commented 1 month ago

Flaky today: https://github.com/databrickslabs/ucx/actions/runs/11138147198/job/30952699394

JCZuurmond commented 1 month ago

Considering: https://github.com/databrickslabs/ucx/issues/2769#issuecomment-2382605470

github-actions[bot] commented 1 month ago
❌ test_running_real_assessment_job: AssertionError: assert False (19m41.818s) ``` AssertionError: assert False + where False = validate_step('assessment') + where validate_step = .validate_step + where = .deployed_workflows [gw4] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python 05:07 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.7jh7/config.yml) doesn't exist. 05:07 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:07 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:07 INFO [databricks.labs.ucx.install] Fetching installations... 05:07 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:07 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:15 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:15 INFO [databricks.labs.ucx.install] Installing UCX v0.38.1+3520241004051508 05:15 INFO [databricks.labs.ucx.install] Creating ucx schemas... 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 05:15 INFO [databricks.labs.ucx.install] Creating dashboards... 05:15 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 05:15 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 05:15 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.7jh7/README for the next steps. 05:15 INFO [tests.integration.conftest] Dashboard Created ucx_DnpN5_ra78a55237: https://DATABRICKS_HOST/sql/dashboards/69d57180-c043-415c-a3ed-4081a4c01ddf 05:15 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/99355109678006 05:15 INFO [databricks.labs.ucx.installer.workflows] Started assessment job: https://DATABRICKS_HOST#job/99355109678006/runs/622042823792144 05:15 DEBUG [databricks.labs.ucx.installer.workflows] Waiting for completion of assessment job: https://DATABRICKS_HOST#job/99355109678006/runs/622042823792144 05:26 INFO [databricks.labs.ucx.installer.workflows] Completed assessment job run 622042823792144 with state: RunResultState.SUCCESS_WITH_FAILURES (The job run succeeded with 18 failed tasks) 05:26 INFO [databricks.labs.ucx.installer.workflows] Completed assessment job run 622042823792144 duration: 0:10:18.875000 (2024-10-04 05:15:35.202000+00:00 thru 2024-10-04 05:25:54.077000+00:00) 05:26 DEBUG [databricks.labs.ucx.installer.workflows] Validating assessment workflow: https://DATABRICKS_HOST#job/99355109678006 05:07 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.7jh7/config.yml) doesn't exist. 05:07 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:07 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:07 INFO [databricks.labs.ucx.install] Fetching installations... 05:07 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:07 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:15 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:15 INFO [databricks.labs.ucx.install] Installing UCX v0.38.1+3520241004051508 05:15 INFO [databricks.labs.ucx.install] Creating ucx schemas... 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 05:15 INFO [databricks.labs.ucx.install] Creating dashboards... 05:15 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 05:15 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 05:15 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.7jh7/README for the next steps. 05:15 INFO [tests.integration.conftest] Dashboard Created ucx_DnpN5_ra78a55237: https://DATABRICKS_HOST/sql/dashboards/69d57180-c043-415c-a3ed-4081a4c01ddf 05:15 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/99355109678006 05:15 INFO [databricks.labs.ucx.installer.workflows] Started assessment job: https://DATABRICKS_HOST#job/99355109678006/runs/622042823792144 05:15 DEBUG [databricks.labs.ucx.installer.workflows] Waiting for completion of assessment job: https://DATABRICKS_HOST#job/99355109678006/runs/622042823792144 05:26 INFO [databricks.labs.ucx.installer.workflows] Completed assessment job run 622042823792144 with state: RunResultState.SUCCESS_WITH_FAILURES (The job run succeeded with 18 failed tasks) 05:26 INFO [databricks.labs.ucx.installer.workflows] Completed assessment job run 622042823792144 duration: 0:10:18.875000 (2024-10-04 05:15:35.202000+00:00 thru 2024-10-04 05:25:54.077000+00:00) 05:26 DEBUG [databricks.labs.ucx.installer.workflows] Validating assessment workflow: https://DATABRICKS_HOST#job/99355109678006 05:26 INFO [databricks.labs.ucx.install] Deleting UCX v0.38.1+3520241004051508 from https://DATABRICKS_HOST 05:26 INFO [databricks.labs.ucx.install] Deleting inventory database dummy_sk46t 05:26 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=18248160930835, as it is no longer needed 05:26 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=947889344959538, as it is no longer needed 05:26 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1111291471153076, as it is no longer needed 05:26 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=779626353515013, as it is no longer needed 05:26 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=692070606740706, as it is no longer needed 05:26 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=546446220393008, as it is no longer needed 05:26 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=99355109678006, as it is no longer needed 05:26 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=778566893844004, as it is no longer needed 05:26 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=704356106058493, as it is no longer needed 05:26 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=496573729535947, as it is no longer needed 05:26 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=995363685035234, as it is no longer needed 05:26 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=648111086743136, as it is no longer needed 05:26 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=830396851899270, as it is no longer needed 05:26 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=456874563821959, as it is no longer needed 05:26 INFO [databricks.labs.ucx.install] Deleting cluster policy 05:26 INFO [databricks.labs.ucx.install] Deleting secret scope 05:26 INFO [databricks.labs.ucx.install] UnInstalling UCX complete [gw4] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python ```

Running from nightly #217

github-actions[bot] commented 1 month ago
❌ test_running_real_assessment_job: AssertionError: assert False (16m56.026s) ``` AssertionError: assert False + where False = validate_step('assessment') + where validate_step = .validate_step + where = .deployed_workflows [gw5] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python 05:06 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.sF2d/config.yml) doesn't exist. 05:06 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:06 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:06 INFO [databricks.labs.ucx.install] Fetching installations... 05:06 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:06 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:14 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:14 INFO [databricks.labs.ucx.install] Installing UCX v0.39.1+None20241005051434 05:14 INFO [databricks.labs.ucx.install] Creating ucx schemas... 05:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 05:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 05:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 05:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 05:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 05:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 05:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 05:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 05:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 05:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 05:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 05:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 05:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 05:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental 05:14 INFO [databricks.labs.ucx.install] Creating dashboards... 05:14 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 05:14 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 05:14 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.sF2d/README for the next steps. 05:15 INFO [tests.integration.conftest] Dashboard Created ucx_DRm8f_ra78a5529b: https://DATABRICKS_HOST/sql/dashboards/e8c950e3-1941-4523-a4b1-aa1ce8e79422 05:15 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/319665516669555 05:15 INFO [databricks.labs.ucx.installer.workflows] Started assessment job: https://DATABRICKS_HOST#job/319665516669555/runs/621120553408047 05:15 DEBUG [databricks.labs.ucx.installer.workflows] Waiting for completion of assessment job: https://DATABRICKS_HOST#job/319665516669555/runs/621120553408047 05:23 INFO [databricks.labs.ucx.installer.workflows] Completed assessment job run 621120553408047 with state: RunResultState.SUCCESS_WITH_FAILURES (The job run succeeded with 18 failed tasks) 05:23 INFO [databricks.labs.ucx.installer.workflows] Completed assessment job run 621120553408047 duration: 0:07:45.293000 (2024-10-05 05:15:07.551000+00:00 thru 2024-10-05 05:22:52.844000+00:00) 05:23 DEBUG [databricks.labs.ucx.installer.workflows] Validating assessment workflow: https://DATABRICKS_HOST#job/319665516669555 05:06 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.sF2d/config.yml) doesn't exist. 05:06 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:06 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:06 INFO [databricks.labs.ucx.install] Fetching installations... 05:06 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:06 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:14 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:14 INFO [databricks.labs.ucx.install] Installing UCX v0.39.1+None20241005051434 05:14 INFO [databricks.labs.ucx.install] Creating ucx schemas... 05:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 05:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 05:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 05:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 05:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 05:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 05:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 05:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 05:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 05:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 05:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 05:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 05:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 05:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental 05:14 INFO [databricks.labs.ucx.install] Creating dashboards... 05:14 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 05:14 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 05:14 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.sF2d/README for the next steps. 05:15 INFO [tests.integration.conftest] Dashboard Created ucx_DRm8f_ra78a5529b: https://DATABRICKS_HOST/sql/dashboards/e8c950e3-1941-4523-a4b1-aa1ce8e79422 05:15 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/319665516669555 05:15 INFO [databricks.labs.ucx.installer.workflows] Started assessment job: https://DATABRICKS_HOST#job/319665516669555/runs/621120553408047 05:15 DEBUG [databricks.labs.ucx.installer.workflows] Waiting for completion of assessment job: https://DATABRICKS_HOST#job/319665516669555/runs/621120553408047 05:23 INFO [databricks.labs.ucx.installer.workflows] Completed assessment job run 621120553408047 with state: RunResultState.SUCCESS_WITH_FAILURES (The job run succeeded with 18 failed tasks) 05:23 INFO [databricks.labs.ucx.installer.workflows] Completed assessment job run 621120553408047 duration: 0:07:45.293000 (2024-10-05 05:15:07.551000+00:00 thru 2024-10-05 05:22:52.844000+00:00) 05:23 DEBUG [databricks.labs.ucx.installer.workflows] Validating assessment workflow: https://DATABRICKS_HOST#job/319665516669555 05:23 INFO [databricks.labs.ucx.install] Deleting UCX v0.39.1+None20241005051434 from https://DATABRICKS_HOST 05:23 INFO [databricks.labs.ucx.install] Deleting inventory database dummy_slq6q 05:23 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=278521232287173, as it is no longer needed 05:23 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=124397522916973, as it is no longer needed 05:23 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=319665516669555, as it is no longer needed 05:23 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=840434533617358, as it is no longer needed 05:23 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=407888890344474, as it is no longer needed 05:23 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=191638023536136, as it is no longer needed 05:23 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=448775080917733, as it is no longer needed 05:23 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=768846484985053, as it is no longer needed 05:23 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=151158213573792, as it is no longer needed 05:23 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=407167125010687, as it is no longer needed 05:23 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1013020370077093, as it is no longer needed 05:23 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1105265142192176, as it is no longer needed 05:23 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=286096051382609, as it is no longer needed 05:23 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=472513288030925, as it is no longer needed 05:23 INFO [databricks.labs.ucx.install] Deleting cluster policy 05:23 INFO [databricks.labs.ucx.install] Deleting secret scope 05:23 INFO [databricks.labs.ucx.install] UnInstalling UCX complete [gw5] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python ```

Running from nightly #218