Test failure: `test_running_real_assessment_job_ext_hms`

❌ test_running_real_assessment_job_ext_hms: databricks.sdk.errors.platform.ResourceDoesNotExist: Can't find a cluster policy with id: 0008BBC772016A1F. (12m47.876s)

``` databricks.sdk.errors.platform.ResourceDoesNotExist: Can't find a cluster policy with id: 0008BBC772016A1F. [gw1] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 08:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-igbl-ra78a4e21d@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-igbl-ra78a4e21d@example.com')], entitlements=[], external_id=None, groups=[], id='3763833613312521', name=Name(family_name=None, given_name='sdk-igbl-ra78a4e21d@example.com'), roles=[], schemas=[, ], user_name='sdk-igbl-ra78a4e21d@example.com') 08:06 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx-qByR-ra78a4e21d: https://DATABRICKS_HOST#setting/accounts/groups/243682788875904 08:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx-qByR-ra78a4e21d', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='243682788875904', members=[ComplexValue(display='sdk-igbl-ra78a4e21d@example.com', primary=None, ref='Users/3763833613312521', type=None, value='3763833613312521')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 08:06 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx-qByR-ra78a4e21d: https://accounts.CLOUD_ENVdatabricks.net/users/groups/494206836903254/members 08:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx-qByR-ra78a4e21d', entitlements=[], external_id=None, groups=[], id='494206836903254', members=[ComplexValue(display='sdk-igbl-ra78a4e21d@example.com', primary=None, ref='Users/3763833613312521', type=None, value='3763833613312521')], meta=None, roles=[], schemas=[]) 08:06 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/0006C9F3234A4F91 08:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='0006C9F3234A4F91') 08:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 0006C9F3234A4F91 [group_name admins CAN_USE] -> [group_name ucx-qByR-ra78a4e21d CAN_USE] 08:06 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s7wy1: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s7wy1 08:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s7wy1', metastore_id=None, name='ucx_s7wy1', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 08:06 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.phPf/config.yml) doesn't exist. 08:06 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 08:06 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 08:06 INFO [databricks.labs.ucx.install] Fetching installations... 08:06 INFO [databricks.labs.ucx.installer.policy] Setting up an external metastore 08:06 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 08:06 DEBUG [tests.integration.conftest] Waiting for clusters to start... 08:06 DEBUG [tests.integration.conftest] Waiting for clusters to start... 08:06 INFO [databricks.labs.ucx.install] Installing UCX v0.28.3+1120240717080643 08:06 INFO [databricks.labs.ucx.install] Creating ucx schemas... 08:17 INFO [databricks.labs.ucx.install] Creating dashboards... 08:17 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 08:17 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 08:17 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 08:17 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 08:17 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 08:17 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 08:17 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 08:17 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 08:17 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 08:17 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 08:17 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 08:17 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 08:18 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 08:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 08:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-igbl-ra78a4e21d@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-igbl-ra78a4e21d@example.com')], entitlements=[], external_id=None, groups=[], id='3763833613312521', name=Name(family_name=None, given_name='sdk-igbl-ra78a4e21d@example.com'), roles=[], schemas=[, ], user_name='sdk-igbl-ra78a4e21d@example.com') 08:06 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx-qByR-ra78a4e21d: https://DATABRICKS_HOST#setting/accounts/groups/243682788875904 08:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx-qByR-ra78a4e21d', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='243682788875904', members=[ComplexValue(display='sdk-igbl-ra78a4e21d@example.com', primary=None, ref='Users/3763833613312521', type=None, value='3763833613312521')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 08:06 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx-qByR-ra78a4e21d: https://accounts.CLOUD_ENVdatabricks.net/users/groups/494206836903254/members 08:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx-qByR-ra78a4e21d', entitlements=[], external_id=None, groups=[], id='494206836903254', members=[ComplexValue(display='sdk-igbl-ra78a4e21d@example.com', primary=None, ref='Users/3763833613312521', type=None, value='3763833613312521')], meta=None, roles=[], schemas=[]) 08:06 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/0006C9F3234A4F91 08:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='0006C9F3234A4F91') 08:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 0006C9F3234A4F91 [group_name admins CAN_USE] -> [group_name ucx-qByR-ra78a4e21d CAN_USE] 08:06 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s7wy1: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s7wy1 08:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s7wy1', metastore_id=None, name='ucx_s7wy1', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 08:06 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.phPf/config.yml) doesn't exist. 08:06 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 08:06 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 08:06 INFO [databricks.labs.ucx.install] Fetching installations... 08:06 INFO [databricks.labs.ucx.installer.policy] Setting up an external metastore 08:06 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 08:06 DEBUG [tests.integration.conftest] Waiting for clusters to start... 08:06 DEBUG [tests.integration.conftest] Waiting for clusters to start... 08:06 INFO [databricks.labs.ucx.install] Installing UCX v0.28.3+1120240717080643 08:06 INFO [databricks.labs.ucx.install] Creating ucx schemas... 08:17 INFO [databricks.labs.ucx.install] Creating dashboards... 08:17 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 08:17 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 08:17 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 08:17 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 08:17 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 08:17 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 08:17 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 08:17 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 08:17 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 08:17 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 08:17 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 08:17 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 08:18 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 08:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 08:18 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster_policy permissions fixtures 08:18 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster_policy permissions fixture: 0006C9F3234A4F91 [group_name admins CAN_USE] -> [group_name ucx-qByR-ra78a4e21d CAN_USE] 08:18 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster policy fixtures 08:18 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster policy fixture: CreatePolicyResponse(policy_id='0006C9F3234A4F91') 08:18 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while cluster policy CreatePolicyResponse(policy_id='0006C9F3234A4F91') teardown: Can't find a cluster policy with id: 0006C9F3234A4F91. 08:18 INFO [databricks.labs.ucx.install] Deleting UCX v0.28.3+1120240717080643 from https://DATABRICKS_HOST 08:18 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_s7wy1 08:18 INFO [databricks.labs.ucx.install] Deleting jobs 08:18 ERROR [databricks.labs.ucx.install] No jobs present or jobs already deleted 08:18 INFO [databricks.labs.ucx.install] Deleting cluster policy 08:18 ERROR [databricks.labs.ucx.install] UCX Policy already deleted 08:18 INFO [databricks.labs.ucx.install] Deleting secret scope 08:18 INFO [databricks.labs.ucx.install] UnInstalling UCX complete 08:18 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace user fixtures 08:18 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='sdk-igbl-ra78a4e21d@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-igbl-ra78a4e21d@example.com')], entitlements=[], external_id=None, groups=[], id='3763833613312521', name=Name(family_name=None, given_name='sdk-igbl-ra78a4e21d@example.com'), roles=[], schemas=[, ], user_name='sdk-igbl-ra78a4e21d@example.com') 08:19 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 account group fixtures 08:19 DEBUG [databricks.labs.ucx.mixins.fixtures] removing account group fixture: Group(display_name='ucx-qByR-ra78a4e21d', entitlements=[], external_id=None, groups=[], id='494206836903254', members=[ComplexValue(display='sdk-igbl-ra78a4e21d@example.com', primary=None, ref='Users/3763833613312521', type=None, value='3763833613312521')], meta=None, roles=[], schemas=[]) 08:19 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace group fixtures 08:19 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace group fixture: Group(display_name='ucx-qByR-ra78a4e21d', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='243682788875904', members=[ComplexValue(display='sdk-igbl-ra78a4e21d@example.com', primary=None, ref='Users/3763833613312521', type=None, value='3763833613312521')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 08:19 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 08:19 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 08:19 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 schema fixtures 08:19 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s7wy1', metastore_id=None, name='ucx_s7wy1', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw1] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```

_{Running from nightly #129}

❌ test_running_real_assessment_job_ext_hms: databricks.sdk.errors.platform.ResourceDoesNotExist: Can't find a cluster policy with id: 0010CE64EA6C570C. (16m27.413s)

``` databricks.sdk.errors.platform.ResourceDoesNotExist: Can't find a cluster policy with id: 0010CE64EA6C570C. [gw3] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-ts2v-ra78a4e27e@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-ts2v-ra78a4e27e@example.com')], entitlements=[], external_id=None, groups=[], id='6479321332228158', name=Name(family_name=None, given_name='sdk-ts2v-ra78a4e27e@example.com'), roles=[], schemas=[, ], user_name='sdk-ts2v-ra78a4e27e@example.com') 05:06 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx-Txum-ra78a4e27e: https://DATABRICKS_HOST#setting/accounts/groups/535800512048618 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx-Txum-ra78a4e27e', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='535800512048618', members=[ComplexValue(display='sdk-ts2v-ra78a4e27e@example.com', primary=None, ref='Users/6479321332228158', type=None, value='6479321332228158')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 05:06 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx-Txum-ra78a4e27e: https://accounts.CLOUD_ENVdatabricks.net/users/groups/452171210669688/members 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx-Txum-ra78a4e27e', entitlements=[], external_id=None, groups=[], id='452171210669688', members=[ComplexValue(display='sdk-ts2v-ra78a4e27e@example.com', primary=None, ref='Users/6479321332228158', type=None, value='6479321332228158')], meta=None, roles=[], schemas=[]) 05:06 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/001B4670105C5ED2 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='001B4670105C5ED2') 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 001B4670105C5ED2 [group_name admins CAN_USE] -> [group_name ucx-Txum-ra78a4e27e CAN_USE] 05:06 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_snxmp: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_snxmp 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_snxmp', metastore_id=None, name='ucx_snxmp', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 05:06 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.rSmq/config.yml) doesn't exist. 05:06 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:06 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:06 INFO [databricks.labs.ucx.install] Fetching installations... 05:06 INFO [databricks.labs.ucx.installer.policy] Setting up an external metastore 05:06 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:06 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:13 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:13 INFO [databricks.labs.ucx.install] Installing UCX v0.28.3+1520240718051320 05:13 INFO [databricks.labs.ucx.install] Creating ucx schemas... 05:22 INFO [databricks.labs.ucx.install] Creating dashboards... 05:22 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 05:22 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 05:22 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 05:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-ts2v-ra78a4e27e@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-ts2v-ra78a4e27e@example.com')], entitlements=[], external_id=None, groups=[], id='6479321332228158', name=Name(family_name=None, given_name='sdk-ts2v-ra78a4e27e@example.com'), roles=[], schemas=[, ], user_name='sdk-ts2v-ra78a4e27e@example.com') 05:06 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx-Txum-ra78a4e27e: https://DATABRICKS_HOST#setting/accounts/groups/535800512048618 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx-Txum-ra78a4e27e', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='535800512048618', members=[ComplexValue(display='sdk-ts2v-ra78a4e27e@example.com', primary=None, ref='Users/6479321332228158', type=None, value='6479321332228158')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 05:06 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx-Txum-ra78a4e27e: https://accounts.CLOUD_ENVdatabricks.net/users/groups/452171210669688/members 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx-Txum-ra78a4e27e', entitlements=[], external_id=None, groups=[], id='452171210669688', members=[ComplexValue(display='sdk-ts2v-ra78a4e27e@example.com', primary=None, ref='Users/6479321332228158', type=None, value='6479321332228158')], meta=None, roles=[], schemas=[]) 05:06 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/001B4670105C5ED2 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='001B4670105C5ED2') 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 001B4670105C5ED2 [group_name admins CAN_USE] -> [group_name ucx-Txum-ra78a4e27e CAN_USE] 05:06 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_snxmp: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_snxmp 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_snxmp', metastore_id=None, name='ucx_snxmp', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 05:06 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.rSmq/config.yml) doesn't exist. 05:06 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:06 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:06 INFO [databricks.labs.ucx.install] Fetching installations... 05:06 INFO [databricks.labs.ucx.installer.policy] Setting up an external metastore 05:06 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:06 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:13 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:13 INFO [databricks.labs.ucx.install] Installing UCX v0.28.3+1520240718051320 05:13 INFO [databricks.labs.ucx.install] Creating ucx schemas... 05:22 INFO [databricks.labs.ucx.install] Creating dashboards... 05:22 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 05:22 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 05:22 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 05:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 05:22 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster_policy permissions fixtures 05:22 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster_policy permissions fixture: 001B4670105C5ED2 [group_name admins CAN_USE] -> [group_name ucx-Txum-ra78a4e27e CAN_USE] 05:22 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster policy fixtures 05:22 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster policy fixture: CreatePolicyResponse(policy_id='001B4670105C5ED2') 05:22 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while cluster policy CreatePolicyResponse(policy_id='001B4670105C5ED2') teardown: Can't find a cluster policy with id: 001B4670105C5ED2. 05:22 INFO [databricks.labs.ucx.install] Deleting UCX v0.28.3+1520240718051320 from https://DATABRICKS_HOST 05:22 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_snxmp 05:23 INFO [databricks.labs.ucx.install] Deleting jobs 05:23 ERROR [databricks.labs.ucx.install] No jobs present or jobs already deleted 05:23 INFO [databricks.labs.ucx.install] Deleting cluster policy 05:23 ERROR [databricks.labs.ucx.install] UCX Policy already deleted 05:23 INFO [databricks.labs.ucx.install] Deleting secret scope 05:23 INFO [databricks.labs.ucx.install] UnInstalling UCX complete 05:23 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace user fixtures 05:23 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='sdk-ts2v-ra78a4e27e@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-ts2v-ra78a4e27e@example.com')], entitlements=[], external_id=None, groups=[], id='6479321332228158', name=Name(family_name=None, given_name='sdk-ts2v-ra78a4e27e@example.com'), roles=[], schemas=[, ], user_name='sdk-ts2v-ra78a4e27e@example.com') 05:23 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 account group fixtures 05:23 DEBUG [databricks.labs.ucx.mixins.fixtures] removing account group fixture: Group(display_name='ucx-Txum-ra78a4e27e', entitlements=[], external_id=None, groups=[], id='452171210669688', members=[ComplexValue(display='sdk-ts2v-ra78a4e27e@example.com', primary=None, ref='Users/6479321332228158', type=None, value='6479321332228158')], meta=None, roles=[], schemas=[]) 05:23 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace group fixtures 05:23 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace group fixture: Group(display_name='ucx-Txum-ra78a4e27e', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='535800512048618', members=[ComplexValue(display='sdk-ts2v-ra78a4e27e@example.com', primary=None, ref='Users/6479321332228158', type=None, value='6479321332228158')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 05:23 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 05:23 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 05:23 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 schema fixtures 05:23 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_snxmp', metastore_id=None, name='ucx_snxmp', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw3] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```

_{Running from nightly #130}

❌ test_running_real_assessment_job_ext_hms: databricks.sdk.errors.platform.ResourceDoesNotExist: Can't find a cluster policy with id: 001E95862A90ED5D. (15m47.416s)

``` databricks.sdk.errors.platform.ResourceDoesNotExist: Can't find a cluster policy with id: 001E95862A90ED5D. [gw2] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-72nq-ra78a4e346@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-72nq-ra78a4e346@example.com')], entitlements=[], external_id=None, groups=[], id='8831609577696133', name=Name(family_name=None, given_name='sdk-72nq-ra78a4e346@example.com'), roles=[], schemas=[, ], user_name='sdk-72nq-ra78a4e346@example.com') 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx-AIxF-ra78a4e346: https://DATABRICKS_HOST#setting/accounts/groups/1102263086748351 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx-AIxF-ra78a4e346', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='1102263086748351', members=[ComplexValue(display='sdk-72nq-ra78a4e346@example.com', primary=None, ref='Users/8831609577696133', type=None, value='8831609577696133')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx-AIxF-ra78a4e346: https://accounts.CLOUD_ENVdatabricks.net/users/groups/611091804478468/members 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx-AIxF-ra78a4e346', entitlements=[], external_id=None, groups=[], id='611091804478468', members=[ComplexValue(display='sdk-72nq-ra78a4e346@example.com', primary=None, ref='Users/8831609577696133', type=None, value='8831609577696133')], meta=None, roles=[], schemas=[]) 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/0006EC185FCCE73C 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='0006EC185FCCE73C') 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 0006EC185FCCE73C [group_name admins CAN_USE] -> [group_name ucx-AIxF-ra78a4e346 CAN_USE] 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sutdt: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sutdt 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sutdt', metastore_id=None, name='ucx_sutdt', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 05:07 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.7V4S/config.yml) doesn't exist. 05:07 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:07 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:07 INFO [databricks.labs.ucx.install] Fetching installations... 05:07 INFO [databricks.labs.ucx.installer.policy] Setting up an external metastore 05:07 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:07 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:14 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:14 INFO [databricks.labs.ucx.install] Installing UCX v0.29.1+120240720051406 05:14 INFO [databricks.labs.ucx.install] Creating ucx schemas... 05:21 INFO [databricks.labs.ucx.install] Creating dashboards... 05:21 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 05:21 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 05:21 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-72nq-ra78a4e346@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-72nq-ra78a4e346@example.com')], entitlements=[], external_id=None, groups=[], id='8831609577696133', name=Name(family_name=None, given_name='sdk-72nq-ra78a4e346@example.com'), roles=[], schemas=[, ], user_name='sdk-72nq-ra78a4e346@example.com') 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx-AIxF-ra78a4e346: https://DATABRICKS_HOST#setting/accounts/groups/1102263086748351 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx-AIxF-ra78a4e346', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='1102263086748351', members=[ComplexValue(display='sdk-72nq-ra78a4e346@example.com', primary=None, ref='Users/8831609577696133', type=None, value='8831609577696133')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx-AIxF-ra78a4e346: https://accounts.CLOUD_ENVdatabricks.net/users/groups/611091804478468/members 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx-AIxF-ra78a4e346', entitlements=[], external_id=None, groups=[], id='611091804478468', members=[ComplexValue(display='sdk-72nq-ra78a4e346@example.com', primary=None, ref='Users/8831609577696133', type=None, value='8831609577696133')], meta=None, roles=[], schemas=[]) 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/0006EC185FCCE73C 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='0006EC185FCCE73C') 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 0006EC185FCCE73C [group_name admins CAN_USE] -> [group_name ucx-AIxF-ra78a4e346 CAN_USE] 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sutdt: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sutdt 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sutdt', metastore_id=None, name='ucx_sutdt', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 05:07 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.7V4S/config.yml) doesn't exist. 05:07 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:07 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:07 INFO [databricks.labs.ucx.install] Fetching installations... 05:07 INFO [databricks.labs.ucx.installer.policy] Setting up an external metastore 05:07 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:07 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:14 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:14 INFO [databricks.labs.ucx.install] Installing UCX v0.29.1+120240720051406 05:14 INFO [databricks.labs.ucx.install] Creating ucx schemas... 05:21 INFO [databricks.labs.ucx.install] Creating dashboards... 05:21 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 05:21 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 05:21 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 05:22 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster_policy permissions fixtures 05:22 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster_policy permissions fixture: 0006EC185FCCE73C [group_name admins CAN_USE] -> [group_name ucx-AIxF-ra78a4e346 CAN_USE] 05:22 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster policy fixtures 05:22 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster policy fixture: CreatePolicyResponse(policy_id='0006EC185FCCE73C') 05:22 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while cluster policy CreatePolicyResponse(policy_id='0006EC185FCCE73C') teardown: Can't find a cluster policy with id: 0006EC185FCCE73C. 05:22 INFO [databricks.labs.ucx.install] Deleting UCX v0.29.1+120240720051406 from https://DATABRICKS_HOST 05:22 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_sutdt 05:22 INFO [databricks.labs.ucx.install] Deleting jobs 05:22 ERROR [databricks.labs.ucx.install] No jobs present or jobs already deleted 05:22 INFO [databricks.labs.ucx.install] Deleting cluster policy 05:22 ERROR [databricks.labs.ucx.install] UCX Policy already deleted 05:22 INFO [databricks.labs.ucx.install] Deleting secret scope 05:22 INFO [databricks.labs.ucx.install] UnInstalling UCX complete 05:22 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace user fixtures 05:22 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='sdk-72nq-ra78a4e346@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-72nq-ra78a4e346@example.com')], entitlements=[], external_id=None, groups=[], id='8831609577696133', name=Name(family_name=None, given_name='sdk-72nq-ra78a4e346@example.com'), roles=[], schemas=[, ], user_name='sdk-72nq-ra78a4e346@example.com') 05:22 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 account group fixtures 05:22 DEBUG [databricks.labs.ucx.mixins.fixtures] removing account group fixture: Group(display_name='ucx-AIxF-ra78a4e346', entitlements=[], external_id=None, groups=[], id='611091804478468', members=[ComplexValue(display='sdk-72nq-ra78a4e346@example.com', primary=None, ref='Users/8831609577696133', type=None, value='8831609577696133')], meta=None, roles=[], schemas=[]) 05:22 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace group fixtures 05:22 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace group fixture: Group(display_name='ucx-AIxF-ra78a4e346', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='1102263086748351', members=[ComplexValue(display='sdk-72nq-ra78a4e346@example.com', primary=None, ref='Users/8831609577696133', type=None, value='8831609577696133')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 05:22 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 05:22 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 05:22 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 schema fixtures 05:22 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sutdt', metastore_id=None, name='ucx_sutdt', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw2] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```

_{Running from nightly #132}

@nfx not sure why this is considered a test failure... The last generated GH issue refers to this line, which I believe should not be considered an error: 05:22 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while cluster policy CreatePolicyResponse(policy_id='0006EC185FCCE73C') teardown: Can't find a cluster policy with id: 0006EC185FCCE73C. However, we also have the 2 following: 05:22 ERROR [databricks.labs.ucx.install] No jobs present or jobs already deleted and 05:22 ERROR [databricks.labs.ucx.install] UCX Policy already deleted Shoud we convert these to warnings instead ?

❌ test_running_real_assessment_job_ext_hms: TimeoutError: timed out after 0:20:00: (33m33.056s)

``` TimeoutError: timed out after 0:20:00: [gw2] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-uuxf-ra78a4e59e@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-uuxf-ra78a4e59e@example.com')], entitlements=[], external_id=None, groups=[], id='199182256305923', name=Name(family_name=None, given_name='sdk-uuxf-ra78a4e59e@example.com'), roles=[], schemas=[, ], user_name='sdk-uuxf-ra78a4e59e@example.com') 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx-kQin-ra78a4e59e: https://DATABRICKS_HOST#setting/accounts/groups/155740127022906 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx-kQin-ra78a4e59e', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='155740127022906', members=[ComplexValue(display='sdk-uuxf-ra78a4e59e@example.com', primary=None, ref='Users/199182256305923', type=None, value='199182256305923')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx-kQin-ra78a4e59e: https://accounts.CLOUD_ENVdatabricks.net/users/groups/29426128837665/members 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx-kQin-ra78a4e59e', entitlements=[], external_id=None, groups=[], id='29426128837665', members=[ComplexValue(display='sdk-uuxf-ra78a4e59e@example.com', primary=None, ref='Users/199182256305923', type=None, value='199182256305923')], meta=None, roles=[], schemas=[]) 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/00194C5AC794A3C7 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='00194C5AC794A3C7') 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 00194C5AC794A3C7 [group_name admins CAN_USE] -> [group_name ucx-kQin-ra78a4e59e CAN_USE] 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_skvsj: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_skvsj 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_skvsj', metastore_id=None, name='ucx_skvsj', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 05:07 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.J3ry/config.yml) doesn't exist. 05:07 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:07 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:07 INFO [databricks.labs.ucx.install] Fetching installations... 05:07 INFO [databricks.labs.ucx.installer.policy] Setting up an external metastore 05:07 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:07 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:15 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:15 INFO [databricks.labs.ucx.install] Installing UCX v0.29.1+1420240726051519 05:15 INFO [databricks.labs.ucx.install] Creating ucx schemas... 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 05:20 INFO [databricks.labs.ucx.install] Creating dashboards... 05:20 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 05:20 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 05:20 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 05:20 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:20 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:20 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:20 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:20 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:20 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:20 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:20 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:20 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:20 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.J3ry/README for the next steps. 05:21 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/173972722402925 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-uuxf-ra78a4e59e@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-uuxf-ra78a4e59e@example.com')], entitlements=[], external_id=None, groups=[], id='199182256305923', name=Name(family_name=None, given_name='sdk-uuxf-ra78a4e59e@example.com'), roles=[], schemas=[, ], user_name='sdk-uuxf-ra78a4e59e@example.com') 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx-kQin-ra78a4e59e: https://DATABRICKS_HOST#setting/accounts/groups/155740127022906 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx-kQin-ra78a4e59e', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='155740127022906', members=[ComplexValue(display='sdk-uuxf-ra78a4e59e@example.com', primary=None, ref='Users/199182256305923', type=None, value='199182256305923')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx-kQin-ra78a4e59e: https://accounts.CLOUD_ENVdatabricks.net/users/groups/29426128837665/members 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx-kQin-ra78a4e59e', entitlements=[], external_id=None, groups=[], id='29426128837665', members=[ComplexValue(display='sdk-uuxf-ra78a4e59e@example.com', primary=None, ref='Users/199182256305923', type=None, value='199182256305923')], meta=None, roles=[], schemas=[]) 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/00194C5AC794A3C7 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='00194C5AC794A3C7') 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 00194C5AC794A3C7 [group_name admins CAN_USE] -> [group_name ucx-kQin-ra78a4e59e CAN_USE] 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_skvsj: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_skvsj 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_skvsj', metastore_id=None, name='ucx_skvsj', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 05:07 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.J3ry/config.yml) doesn't exist. 05:07 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:07 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:07 INFO [databricks.labs.ucx.install] Fetching installations... 05:07 INFO [databricks.labs.ucx.installer.policy] Setting up an external metastore 05:07 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:07 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:15 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:15 INFO [databricks.labs.ucx.install] Installing UCX v0.29.1+1420240726051519 05:15 INFO [databricks.labs.ucx.install] Creating ucx schemas... 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 05:20 INFO [databricks.labs.ucx.install] Creating dashboards... 05:20 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 05:20 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 05:20 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 05:20 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:20 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:20 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:20 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:20 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:20 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:20 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:20 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:20 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:20 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.J3ry/README for the next steps. 05:21 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/173972722402925 05:41 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster_policy permissions fixtures 05:41 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster_policy permissions fixture: 00194C5AC794A3C7 [group_name admins CAN_USE] -> [group_name ucx-kQin-ra78a4e59e CAN_USE] 05:41 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster policy fixtures 05:41 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster policy fixture: CreatePolicyResponse(policy_id='00194C5AC794A3C7') 05:41 INFO [databricks.labs.ucx.install] Deleting UCX v0.29.1+1420240726051519 from https://DATABRICKS_HOST 05:41 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_skvsj 05:41 INFO [databricks.labs.ucx.install] Deleting jobs 05:41 INFO [databricks.labs.ucx.install] Deleting migrate-external-hiveserde-tables-in-place-experimental job_id=867140003544361. 05:41 INFO [databricks.labs.ucx.install] Deleting migrate-external-tables-ctas job_id=169570789123702. 05:41 INFO [databricks.labs.ucx.install] Deleting scan-tables-in-mounts-experimental job_id=739415107160287. 05:41 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=601991791929296. 05:41 INFO [databricks.labs.ucx.install] Deleting assessment job_id=173972722402925. 05:41 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=870248877678086. 05:41 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=1045868541025910. 05:41 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=662781521547405. 05:41 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=369698750619818. 05:41 INFO [databricks.labs.ucx.install] Deleting experimental-workflow-linter job_id=1038442567399103. 05:41 INFO [databricks.labs.ucx.install] Deleting migrate-data-reconciliation job_id=392632843218533. 05:41 INFO [databricks.labs.ucx.install] Deleting failing job_id=680256159401174. 05:41 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=189991886595295. 05:41 INFO [databricks.labs.ucx.install] Deleting cluster policy 05:41 INFO [databricks.labs.ucx.install] Deleting secret scope 05:41 INFO [databricks.labs.ucx.install] UnInstalling UCX complete 05:41 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace user fixtures 05:41 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='sdk-uuxf-ra78a4e59e@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-uuxf-ra78a4e59e@example.com')], entitlements=[], external_id=None, groups=[], id='199182256305923', name=Name(family_name=None, given_name='sdk-uuxf-ra78a4e59e@example.com'), roles=[], schemas=[, ], user_name='sdk-uuxf-ra78a4e59e@example.com') 05:41 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 account group fixtures 05:41 DEBUG [databricks.labs.ucx.mixins.fixtures] removing account group fixture: Group(display_name='ucx-kQin-ra78a4e59e', entitlements=[], external_id=None, groups=[], id='29426128837665', members=[ComplexValue(display='sdk-uuxf-ra78a4e59e@example.com', primary=None, ref='Users/199182256305923', type=None, value='199182256305923')], meta=None, roles=[], schemas=[]) 05:41 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace group fixtures 05:41 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace group fixture: Group(display_name='ucx-kQin-ra78a4e59e', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='155740127022906', members=[ComplexValue(display='sdk-uuxf-ra78a4e59e@example.com', primary=None, ref='Users/199182256305923', type=None, value='199182256305923')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 05:41 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 05:41 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 05:41 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 schema fixtures 05:41 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_skvsj', metastore_id=None, name='ucx_skvsj', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw2] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```

_{Running from nightly #138}

❌ test_running_real_assessment_job_ext_hms: TimeoutError: timed out after 0:20:00: (36m17.503s)

``` TimeoutError: timed out after 0:20:00: [gw2] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-vikw-ra78a4e602@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-vikw-ra78a4e602@example.com')], entitlements=[], external_id=None, groups=[], id='993521461544861', name=Name(family_name=None, given_name='sdk-vikw-ra78a4e602@example.com'), roles=[], schemas=[, ], user_name='sdk-vikw-ra78a4e602@example.com') 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx-mWvH-ra78a4e602: https://DATABRICKS_HOST#setting/accounts/groups/828477873261272 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx-mWvH-ra78a4e602', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='828477873261272', members=[ComplexValue(display='sdk-vikw-ra78a4e602@example.com', primary=None, ref='Users/993521461544861', type=None, value='993521461544861')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx-mWvH-ra78a4e602: https://accounts.CLOUD_ENVdatabricks.net/users/groups/765666077838306/members 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx-mWvH-ra78a4e602', entitlements=[], external_id=None, groups=[], id='765666077838306', members=[ComplexValue(display='sdk-vikw-ra78a4e602@example.com', primary=None, ref='Users/993521461544861', type=None, value='993521461544861')], meta=None, roles=[], schemas=[]) 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/001CDF556A97E15A 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='001CDF556A97E15A') 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 001CDF556A97E15A [group_name admins CAN_USE] -> [group_name ucx-mWvH-ra78a4e602 CAN_USE] 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sri4i: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sri4i 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sri4i', metastore_id=None, name='ucx_sri4i', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 05:07 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.u8FW/config.yml) doesn't exist. 05:07 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:07 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:07 INFO [databricks.labs.ucx.install] Fetching installations... 05:07 INFO [databricks.labs.ucx.installer.policy] Setting up an external metastore 05:07 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:07 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:16 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:16 INFO [databricks.labs.ucx.install] Installing UCX v0.30.1+None20240727051629 05:16 INFO [databricks.labs.ucx.install] Creating ucx schemas... 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 05:23 INFO [databricks.labs.ucx.install] Creating dashboards... 05:23 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 05:23 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 05:23 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 05:23 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:23 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:23 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:23 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:23 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:23 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:23 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:23 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:23 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:23 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:23 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.u8FW/README for the next steps. 05:23 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/915934131511175 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-vikw-ra78a4e602@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-vikw-ra78a4e602@example.com')], entitlements=[], external_id=None, groups=[], id='993521461544861', name=Name(family_name=None, given_name='sdk-vikw-ra78a4e602@example.com'), roles=[], schemas=[, ], user_name='sdk-vikw-ra78a4e602@example.com') 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx-mWvH-ra78a4e602: https://DATABRICKS_HOST#setting/accounts/groups/828477873261272 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx-mWvH-ra78a4e602', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='828477873261272', members=[ComplexValue(display='sdk-vikw-ra78a4e602@example.com', primary=None, ref='Users/993521461544861', type=None, value='993521461544861')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx-mWvH-ra78a4e602: https://accounts.CLOUD_ENVdatabricks.net/users/groups/765666077838306/members 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx-mWvH-ra78a4e602', entitlements=[], external_id=None, groups=[], id='765666077838306', members=[ComplexValue(display='sdk-vikw-ra78a4e602@example.com', primary=None, ref='Users/993521461544861', type=None, value='993521461544861')], meta=None, roles=[], schemas=[]) 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/001CDF556A97E15A 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='001CDF556A97E15A') 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 001CDF556A97E15A [group_name admins CAN_USE] -> [group_name ucx-mWvH-ra78a4e602 CAN_USE] 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sri4i: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sri4i 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sri4i', metastore_id=None, name='ucx_sri4i', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 05:07 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.u8FW/config.yml) doesn't exist. 05:07 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:07 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:07 INFO [databricks.labs.ucx.install] Fetching installations... 05:07 INFO [databricks.labs.ucx.installer.policy] Setting up an external metastore 05:07 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:07 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:16 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:16 INFO [databricks.labs.ucx.install] Installing UCX v0.30.1+None20240727051629 05:16 INFO [databricks.labs.ucx.install] Creating ucx schemas... 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 05:23 INFO [databricks.labs.ucx.install] Creating dashboards... 05:23 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 05:23 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 05:23 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 05:23 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:23 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:23 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:23 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:23 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:23 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:23 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:23 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:23 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:23 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:23 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.u8FW/README for the next steps. 05:23 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/915934131511175 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster_policy permissions fixtures 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster_policy permissions fixture: 001CDF556A97E15A [group_name admins CAN_USE] -> [group_name ucx-mWvH-ra78a4e602 CAN_USE] 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster policy fixtures 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster policy fixture: CreatePolicyResponse(policy_id='001CDF556A97E15A') 05:43 INFO [databricks.labs.ucx.install] Deleting UCX v0.30.1+None20240727051629 from https://DATABRICKS_HOST 05:43 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_sri4i 05:43 INFO [databricks.labs.ucx.install] Deleting jobs 05:43 INFO [databricks.labs.ucx.install] Deleting migrate-external-hiveserde-tables-in-place-experimental job_id=744738120213899. 05:43 INFO [databricks.labs.ucx.install] Deleting experimental-workflow-linter job_id=726172131362885. 05:43 INFO [databricks.labs.ucx.install] Deleting assessment job_id=915934131511175. 05:43 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=22398777704617. 05:43 INFO [databricks.labs.ucx.install] Deleting failing job_id=498109454892379. 05:43 INFO [databricks.labs.ucx.install] Deleting migrate-external-tables-ctas job_id=561612276704955. 05:43 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=98372425029108. 05:43 INFO [databricks.labs.ucx.install] Deleting scan-tables-in-mounts-experimental job_id=1005505183395794. 05:43 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=561974390485638. 05:43 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=97532035769952. 05:43 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=534161587493141. 05:43 INFO [databricks.labs.ucx.install] Deleting migrate-data-reconciliation job_id=246199147178707. 05:43 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=832982942001488. 05:43 INFO [databricks.labs.ucx.install] Deleting cluster policy 05:43 INFO [databricks.labs.ucx.install] Deleting secret scope 05:43 INFO [databricks.labs.ucx.install] UnInstalling UCX complete 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace user fixtures 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='sdk-vikw-ra78a4e602@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-vikw-ra78a4e602@example.com')], entitlements=[], external_id=None, groups=[], id='993521461544861', name=Name(family_name=None, given_name='sdk-vikw-ra78a4e602@example.com'), roles=[], schemas=[, ], user_name='sdk-vikw-ra78a4e602@example.com') 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 account group fixtures 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] removing account group fixture: Group(display_name='ucx-mWvH-ra78a4e602', entitlements=[], external_id=None, groups=[], id='765666077838306', members=[ComplexValue(display='sdk-vikw-ra78a4e602@example.com', primary=None, ref='Users/993521461544861', type=None, value='993521461544861')], meta=None, roles=[], schemas=[]) 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace group fixtures 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace group fixture: Group(display_name='ucx-mWvH-ra78a4e602', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='828477873261272', members=[ComplexValue(display='sdk-vikw-ra78a4e602@example.com', primary=None, ref='Users/993521461544861', type=None, value='993521461544861')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 schema fixtures 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sri4i', metastore_id=None, name='ucx_sri4i', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw2] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```

_{Running from nightly #139}

❌ test_running_real_assessment_job_ext_hms: TimeoutError: timed out after 0:20:00: (37m3.81s)

``` TimeoutError: timed out after 0:20:00: [gw0] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-yzhq-ra78a4e6ca@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-yzhq-ra78a4e6ca@example.com')], entitlements=[], external_id=None, groups=[], id='1870063932710513', name=Name(family_name=None, given_name='sdk-yzhq-ra78a4e6ca@example.com'), roles=[], schemas=[, ], user_name='sdk-yzhq-ra78a4e6ca@example.com') 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx-B3dy-ra78a4e6ca: https://DATABRICKS_HOST#setting/accounts/groups/461844984428677 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx-B3dy-ra78a4e6ca', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='461844984428677', members=[ComplexValue(display='sdk-yzhq-ra78a4e6ca@example.com', primary=None, ref='Users/1870063932710513', type=None, value='1870063932710513')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx-B3dy-ra78a4e6ca: https://accounts.CLOUD_ENVdatabricks.net/users/groups/799686983668330/members 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx-B3dy-ra78a4e6ca', entitlements=[], external_id=None, groups=[], id='799686983668330', members=[ComplexValue(display='sdk-yzhq-ra78a4e6ca@example.com', primary=None, ref='Users/1870063932710513', type=None, value='1870063932710513')], meta=None, roles=[], schemas=[]) 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/000183CFE72C4F3B 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='000183CFE72C4F3B') 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 000183CFE72C4F3B [group_name admins CAN_USE] -> [group_name ucx-B3dy-ra78a4e6ca CAN_USE] 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_stkbp: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_stkbp 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_stkbp', metastore_id=None, name='ucx_stkbp', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 05:07 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.aWWC/config.yml) doesn't exist. 05:07 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:07 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:07 INFO [databricks.labs.ucx.install] Fetching installations... 05:07 INFO [databricks.labs.ucx.installer.policy] Setting up an external metastore 05:07 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:07 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:15 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:15 INFO [databricks.labs.ucx.install] Installing UCX v0.30.1+None20240729051548 05:15 INFO [databricks.labs.ucx.install] Creating ucx schemas... 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 05:24 INFO [databricks.labs.ucx.install] Creating dashboards... 05:24 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 05:24 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 05:24 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 05:24 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:24 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:24 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:24 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:24 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:24 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:24 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:24 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:24 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:24 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:24 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.aWWC/README for the next steps. 05:24 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/326619336052560 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-yzhq-ra78a4e6ca@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-yzhq-ra78a4e6ca@example.com')], entitlements=[], external_id=None, groups=[], id='1870063932710513', name=Name(family_name=None, given_name='sdk-yzhq-ra78a4e6ca@example.com'), roles=[], schemas=[, ], user_name='sdk-yzhq-ra78a4e6ca@example.com') 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx-B3dy-ra78a4e6ca: https://DATABRICKS_HOST#setting/accounts/groups/461844984428677 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx-B3dy-ra78a4e6ca', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='461844984428677', members=[ComplexValue(display='sdk-yzhq-ra78a4e6ca@example.com', primary=None, ref='Users/1870063932710513', type=None, value='1870063932710513')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx-B3dy-ra78a4e6ca: https://accounts.CLOUD_ENVdatabricks.net/users/groups/799686983668330/members 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx-B3dy-ra78a4e6ca', entitlements=[], external_id=None, groups=[], id='799686983668330', members=[ComplexValue(display='sdk-yzhq-ra78a4e6ca@example.com', primary=None, ref='Users/1870063932710513', type=None, value='1870063932710513')], meta=None, roles=[], schemas=[]) 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/000183CFE72C4F3B 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='000183CFE72C4F3B') 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 000183CFE72C4F3B [group_name admins CAN_USE] -> [group_name ucx-B3dy-ra78a4e6ca CAN_USE] 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_stkbp: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_stkbp 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_stkbp', metastore_id=None, name='ucx_stkbp', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 05:07 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.aWWC/config.yml) doesn't exist. 05:07 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:07 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:07 INFO [databricks.labs.ucx.install] Fetching installations... 05:07 INFO [databricks.labs.ucx.installer.policy] Setting up an external metastore 05:07 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:07 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:15 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:15 INFO [databricks.labs.ucx.install] Installing UCX v0.30.1+None20240729051548 05:15 INFO [databricks.labs.ucx.install] Creating ucx schemas... 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 05:24 INFO [databricks.labs.ucx.install] Creating dashboards... 05:24 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 05:24 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 05:24 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 05:24 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:24 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:24 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:24 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:24 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:24 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:24 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:24 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:24 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:24 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:24 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.aWWC/README for the next steps. 05:24 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/326619336052560 05:44 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster_policy permissions fixtures 05:44 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster_policy permissions fixture: 000183CFE72C4F3B [group_name admins CAN_USE] -> [group_name ucx-B3dy-ra78a4e6ca CAN_USE] 05:44 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster policy fixtures 05:44 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster policy fixture: CreatePolicyResponse(policy_id='000183CFE72C4F3B') 05:44 INFO [databricks.labs.ucx.install] Deleting UCX v0.30.1+None20240729051548 from https://DATABRICKS_HOST 05:44 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_stkbp 05:44 INFO [databricks.labs.ucx.install] Deleting jobs 05:44 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=611899766109723. 05:44 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=112207900261942. 05:44 INFO [databricks.labs.ucx.install] Deleting experimental-workflow-linter job_id=343414022707725. 05:44 INFO [databricks.labs.ucx.install] Deleting migrate-data-reconciliation job_id=23744475106823. 05:44 INFO [databricks.labs.ucx.install] Deleting failing job_id=202645145867809. 05:44 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=640366293076677. 05:44 INFO [databricks.labs.ucx.install] Deleting assessment job_id=326619336052560. 05:44 INFO [databricks.labs.ucx.install] Deleting scan-tables-in-mounts-experimental job_id=970971159663365. 05:44 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=1045572361424157. 05:44 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=974104490802159. 05:44 INFO [databricks.labs.ucx.install] Deleting migrate-external-tables-ctas job_id=388522750474925. 05:44 INFO [databricks.labs.ucx.install] Deleting migrate-external-hiveserde-tables-in-place-experimental job_id=1015681910598635. 05:44 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=847240472882259. 05:44 INFO [databricks.labs.ucx.install] Deleting cluster policy 05:44 INFO [databricks.labs.ucx.install] Deleting secret scope 05:44 INFO [databricks.labs.ucx.install] UnInstalling UCX complete 05:44 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace user fixtures 05:44 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='sdk-yzhq-ra78a4e6ca@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-yzhq-ra78a4e6ca@example.com')], entitlements=[], external_id=None, groups=[], id='1870063932710513', name=Name(family_name=None, given_name='sdk-yzhq-ra78a4e6ca@example.com'), roles=[], schemas=[, ], user_name='sdk-yzhq-ra78a4e6ca@example.com') 05:44 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 account group fixtures 05:44 DEBUG [databricks.labs.ucx.mixins.fixtures] removing account group fixture: Group(display_name='ucx-B3dy-ra78a4e6ca', entitlements=[], external_id=None, groups=[], id='799686983668330', members=[ComplexValue(display='sdk-yzhq-ra78a4e6ca@example.com', primary=None, ref='Users/1870063932710513', type=None, value='1870063932710513')], meta=None, roles=[], schemas=[]) 05:44 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace group fixtures 05:44 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace group fixture: Group(display_name='ucx-B3dy-ra78a4e6ca', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='461844984428677', members=[ComplexValue(display='sdk-yzhq-ra78a4e6ca@example.com', primary=None, ref='Users/1870063932710513', type=None, value='1870063932710513')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 05:44 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 05:44 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 05:44 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 schema fixtures 05:44 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_stkbp', metastore_id=None, name='ucx_stkbp', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw0] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```

_{Running from nightly #141}

❌ test_running_real_assessment_job_ext_hms: TimeoutError: timed out after 0:20:00: (36m35.762s)

``` TimeoutError: timed out after 0:20:00: [gw2] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-8hkm-ra78a4e72e@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-8hkm-ra78a4e72e@example.com')], entitlements=[], external_id=None, groups=[], id='5024024798389468', name=Name(family_name=None, given_name='sdk-8hkm-ra78a4e72e@example.com'), roles=[], schemas=[, ], user_name='sdk-8hkm-ra78a4e72e@example.com') 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx-9R5a-ra78a4e72e: https://DATABRICKS_HOST#setting/accounts/groups/1016173663644368 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx-9R5a-ra78a4e72e', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='1016173663644368', members=[ComplexValue(display='sdk-8hkm-ra78a4e72e@example.com', primary=None, ref='Users/5024024798389468', type=None, value='5024024798389468')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx-9R5a-ra78a4e72e: https://accounts.CLOUD_ENVdatabricks.net/users/groups/979072087383227/members 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx-9R5a-ra78a4e72e', entitlements=[], external_id=None, groups=[], id='979072087383227', members=[ComplexValue(display='sdk-8hkm-ra78a4e72e@example.com', primary=None, ref='Users/5024024798389468', type=None, value='5024024798389468')], meta=None, roles=[], schemas=[]) 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/0000944DEF329454 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='0000944DEF329454') 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 0000944DEF329454 [group_name admins CAN_USE] -> [group_name ucx-9R5a-ra78a4e72e CAN_USE] 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sgawg: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sgawg 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sgawg', metastore_id=None, name='ucx_sgawg', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 05:07 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.x3Px/config.yml) doesn't exist. 05:07 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:07 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:07 INFO [databricks.labs.ucx.install] Fetching installations... 05:07 INFO [databricks.labs.ucx.installer.policy] Setting up an external metastore 05:07 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:07 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:15 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:15 INFO [databricks.labs.ucx.install] Installing UCX v0.30.1+620240730051552 05:15 INFO [databricks.labs.ucx.install] Creating ucx schemas... 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 05:23 INFO [databricks.labs.ucx.install] Creating dashboards... 05:23 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 05:23 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 05:23 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 05:23 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:23 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:23 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:23 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:23 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:23 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:23 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:23 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:23 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:23 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:23 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.x3Px/README for the next steps. 05:23 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/296737957201469 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-8hkm-ra78a4e72e@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-8hkm-ra78a4e72e@example.com')], entitlements=[], external_id=None, groups=[], id='5024024798389468', name=Name(family_name=None, given_name='sdk-8hkm-ra78a4e72e@example.com'), roles=[], schemas=[, ], user_name='sdk-8hkm-ra78a4e72e@example.com') 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx-9R5a-ra78a4e72e: https://DATABRICKS_HOST#setting/accounts/groups/1016173663644368 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx-9R5a-ra78a4e72e', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='1016173663644368', members=[ComplexValue(display='sdk-8hkm-ra78a4e72e@example.com', primary=None, ref='Users/5024024798389468', type=None, value='5024024798389468')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx-9R5a-ra78a4e72e: https://accounts.CLOUD_ENVdatabricks.net/users/groups/979072087383227/members 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx-9R5a-ra78a4e72e', entitlements=[], external_id=None, groups=[], id='979072087383227', members=[ComplexValue(display='sdk-8hkm-ra78a4e72e@example.com', primary=None, ref='Users/5024024798389468', type=None, value='5024024798389468')], meta=None, roles=[], schemas=[]) 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/0000944DEF329454 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='0000944DEF329454') 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 0000944DEF329454 [group_name admins CAN_USE] -> [group_name ucx-9R5a-ra78a4e72e CAN_USE] 05:07 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sgawg: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sgawg 05:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sgawg', metastore_id=None, name='ucx_sgawg', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 05:07 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.x3Px/config.yml) doesn't exist. 05:07 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:07 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:07 INFO [databricks.labs.ucx.install] Fetching installations... 05:07 INFO [databricks.labs.ucx.installer.policy] Setting up an external metastore 05:07 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:07 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:15 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:15 INFO [databricks.labs.ucx.install] Installing UCX v0.30.1+620240730051552 05:15 INFO [databricks.labs.ucx.install] Creating ucx schemas... 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 05:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 05:23 INFO [databricks.labs.ucx.install] Creating dashboards... 05:23 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 05:23 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 05:23 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 05:23 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:23 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:23 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:23 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:23 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:23 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:23 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:23 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:23 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:23 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:23 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.x3Px/README for the next steps. 05:23 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/296737957201469 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster_policy permissions fixtures 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster_policy permissions fixture: 0000944DEF329454 [group_name admins CAN_USE] -> [group_name ucx-9R5a-ra78a4e72e CAN_USE] 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster policy fixtures 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster policy fixture: CreatePolicyResponse(policy_id='0000944DEF329454') 05:43 INFO [databricks.labs.ucx.install] Deleting UCX v0.30.1+620240730051552 from https://DATABRICKS_HOST 05:43 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_sgawg 05:43 INFO [databricks.labs.ucx.install] Deleting jobs 05:43 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=931316834320260. 05:43 INFO [databricks.labs.ucx.install] Deleting failing job_id=140973417550189. 05:43 INFO [databricks.labs.ucx.install] Deleting migrate-external-hiveserde-tables-in-place-experimental job_id=359397429669593. 05:43 INFO [databricks.labs.ucx.install] Deleting scan-tables-in-mounts-experimental job_id=5690771498156. 05:43 INFO [databricks.labs.ucx.install] Deleting migrate-external-tables-ctas job_id=220207932828751. 05:43 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=901363733348272. 05:43 INFO [databricks.labs.ucx.install] Deleting migrate-data-reconciliation job_id=540579852084202. 05:43 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=932837320247183. 05:43 INFO [databricks.labs.ucx.install] Deleting assessment job_id=296737957201469. 05:43 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=445072095509852. 05:43 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=399487931520248. 05:43 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=1086664628619529. 05:43 INFO [databricks.labs.ucx.install] Deleting experimental-workflow-linter job_id=835624175826853. 05:43 INFO [databricks.labs.ucx.install] Deleting cluster policy 05:43 INFO [databricks.labs.ucx.install] Deleting secret scope 05:43 INFO [databricks.labs.ucx.install] UnInstalling UCX complete 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace user fixtures 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='sdk-8hkm-ra78a4e72e@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-8hkm-ra78a4e72e@example.com')], entitlements=[], external_id=None, groups=[], id='5024024798389468', name=Name(family_name=None, given_name='sdk-8hkm-ra78a4e72e@example.com'), roles=[], schemas=[, ], user_name='sdk-8hkm-ra78a4e72e@example.com') 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 account group fixtures 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] removing account group fixture: Group(display_name='ucx-9R5a-ra78a4e72e', entitlements=[], external_id=None, groups=[], id='979072087383227', members=[ComplexValue(display='sdk-8hkm-ra78a4e72e@example.com', primary=None, ref='Users/5024024798389468', type=None, value='5024024798389468')], meta=None, roles=[], schemas=[]) 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace group fixtures 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace group fixture: Group(display_name='ucx-9R5a-ra78a4e72e', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='1016173663644368', members=[ComplexValue(display='sdk-8hkm-ra78a4e72e@example.com', primary=None, ref='Users/5024024798389468', type=None, value='5024024798389468')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 schema fixtures 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sgawg', metastore_id=None, name='ucx_sgawg', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw2] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```

_{Running from nightly #142}

❌ test_running_real_assessment_job_ext_hms: TimeoutError: timed out after 0:20:00: (37m40.564s)

``` TimeoutError: timed out after 0:20:00: [gw0] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-75jm-ra78a4e793@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-75jm-ra78a4e793@example.com')], entitlements=[], external_id=None, groups=[], id='1827656653243699', name=Name(family_name=None, given_name='sdk-75jm-ra78a4e793@example.com'), roles=[], schemas=[, ], user_name='sdk-75jm-ra78a4e793@example.com') 05:06 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx-VGHr-ra78a4e793: https://DATABRICKS_HOST#setting/accounts/groups/1040028051758562 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx-VGHr-ra78a4e793', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='1040028051758562', members=[ComplexValue(display='sdk-75jm-ra78a4e793@example.com', primary=None, ref='Users/1827656653243699', type=None, value='1827656653243699')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 05:06 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx-VGHr-ra78a4e793: https://accounts.CLOUD_ENVdatabricks.net/users/groups/187182668364913/members 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx-VGHr-ra78a4e793', entitlements=[], external_id=None, groups=[], id='187182668364913', members=[ComplexValue(display='sdk-75jm-ra78a4e793@example.com', primary=None, ref='Users/1827656653243699', type=None, value='1827656653243699')], meta=None, roles=[], schemas=[]) 05:06 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/00104563EC627A46 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='00104563EC627A46') 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 00104563EC627A46 [group_name admins CAN_USE] -> [group_name ucx-VGHr-ra78a4e793 CAN_USE] 05:06 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s8oad: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s8oad 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s8oad', metastore_id=None, name='ucx_s8oad', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 05:06 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.FRqQ/config.yml) doesn't exist. 05:06 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:06 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:06 INFO [databricks.labs.ucx.install] Fetching installations... 05:07 INFO [databricks.labs.ucx.installer.policy] Setting up an external metastore 05:07 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:07 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:15 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:15 INFO [databricks.labs.ucx.install] Installing UCX v0.31.1+None20240731051512 05:15 INFO [databricks.labs.ucx.install] Creating ucx schemas... 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 05:21 INFO [databricks.labs.ucx.install] Creating dashboards... 05:21 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 05:21 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 05:21 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.FRqQ/README for the next steps. 05:22 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/688626858718236 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-75jm-ra78a4e793@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-75jm-ra78a4e793@example.com')], entitlements=[], external_id=None, groups=[], id='1827656653243699', name=Name(family_name=None, given_name='sdk-75jm-ra78a4e793@example.com'), roles=[], schemas=[, ], user_name='sdk-75jm-ra78a4e793@example.com') 05:06 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx-VGHr-ra78a4e793: https://DATABRICKS_HOST#setting/accounts/groups/1040028051758562 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx-VGHr-ra78a4e793', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='1040028051758562', members=[ComplexValue(display='sdk-75jm-ra78a4e793@example.com', primary=None, ref='Users/1827656653243699', type=None, value='1827656653243699')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 05:06 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx-VGHr-ra78a4e793: https://accounts.CLOUD_ENVdatabricks.net/users/groups/187182668364913/members 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx-VGHr-ra78a4e793', entitlements=[], external_id=None, groups=[], id='187182668364913', members=[ComplexValue(display='sdk-75jm-ra78a4e793@example.com', primary=None, ref='Users/1827656653243699', type=None, value='1827656653243699')], meta=None, roles=[], schemas=[]) 05:06 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/00104563EC627A46 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='00104563EC627A46') 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 00104563EC627A46 [group_name admins CAN_USE] -> [group_name ucx-VGHr-ra78a4e793 CAN_USE] 05:06 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s8oad: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s8oad 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s8oad', metastore_id=None, name='ucx_s8oad', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 05:06 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.FRqQ/config.yml) doesn't exist. 05:06 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:06 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:06 INFO [databricks.labs.ucx.install] Fetching installations... 05:07 INFO [databricks.labs.ucx.installer.policy] Setting up an external metastore 05:07 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:07 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:15 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:15 INFO [databricks.labs.ucx.install] Installing UCX v0.31.1+None20240731051512 05:15 INFO [databricks.labs.ucx.install] Creating ucx schemas... 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 05:21 INFO [databricks.labs.ucx.install] Creating dashboards... 05:21 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 05:21 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 05:21 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.FRqQ/README for the next steps. 05:22 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/688626858718236 05:42 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster_policy permissions fixtures 05:42 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster_policy permissions fixture: 00104563EC627A46 [group_name admins CAN_USE] -> [group_name ucx-VGHr-ra78a4e793 CAN_USE] 05:42 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster policy fixtures 05:42 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster policy fixture: CreatePolicyResponse(policy_id='00104563EC627A46') 05:42 INFO [databricks.labs.ucx.install] Deleting UCX v0.31.1+None20240731051512 from https://DATABRICKS_HOST 05:42 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_s8oad 05:42 INFO [databricks.labs.ucx.install] Deleting jobs 05:42 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=718589929413365. 05:42 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=925695495990341. 05:42 INFO [databricks.labs.ucx.install] Deleting experimental-workflow-linter job_id=70718922618376. 05:42 INFO [databricks.labs.ucx.install] Deleting migrate-external-hiveserde-tables-in-place-experimental job_id=581234751282732. 05:42 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=902443261022137. 05:42 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=423171417221153. 05:42 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=440565156748891. 05:42 INFO [databricks.labs.ucx.install] Deleting assessment job_id=688626858718236. 05:42 INFO [databricks.labs.ucx.install] Deleting migrate-external-tables-ctas job_id=748716505129515. 05:42 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=749505892134683. 05:42 INFO [databricks.labs.ucx.install] Deleting failing job_id=597530680559433. 05:42 INFO [databricks.labs.ucx.install] Deleting migrate-data-reconciliation job_id=863529845059330. 05:42 INFO [databricks.labs.ucx.install] Deleting scan-tables-in-mounts-experimental job_id=903409053480362. 05:42 INFO [databricks.labs.ucx.install] Deleting cluster policy 05:42 INFO [databricks.labs.ucx.install] Deleting secret scope 05:42 INFO [databricks.labs.ucx.install] UnInstalling UCX complete 05:42 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace user fixtures 05:42 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='sdk-75jm-ra78a4e793@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-75jm-ra78a4e793@example.com')], entitlements=[], external_id=None, groups=[], id='1827656653243699', name=Name(family_name=None, given_name='sdk-75jm-ra78a4e793@example.com'), roles=[], schemas=[, ], user_name='sdk-75jm-ra78a4e793@example.com') 05:42 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 account group fixtures 05:42 DEBUG [databricks.labs.ucx.mixins.fixtures] removing account group fixture: Group(display_name='ucx-VGHr-ra78a4e793', entitlements=[], external_id=None, groups=[], id='187182668364913', members=[ComplexValue(display='sdk-75jm-ra78a4e793@example.com', primary=None, ref='Users/1827656653243699', type=None, value='1827656653243699')], meta=None, roles=[], schemas=[]) 05:44 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while account group Group(display_name='ucx-VGHr-ra78a4e793', entitlements=[], external_id=None, groups=[], id='187182668364913', members=[ComplexValue(display='sdk-75jm-ra78a4e793@example.com', primary=None, ref='Users/1827656653243699', type=None, value='1827656653243699')], meta=None, roles=[], schemas=[]) teardown: None UNAVAILABLE 05:44 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace group fixtures 05:44 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace group fixture: Group(display_name='ucx-VGHr-ra78a4e793', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='1040028051758562', members=[ComplexValue(display='sdk-75jm-ra78a4e793@example.com', primary=None, ref='Users/1827656653243699', type=None, value='1827656653243699')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 05:44 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 05:44 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 05:44 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 schema fixtures 05:44 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s8oad', metastore_id=None, name='ucx_s8oad', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw0] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```

_{Running from nightly #143}

❌ test_running_real_assessment_job_ext_hms: TimeoutError: timed out after 0:20:00: (31m0.795s)

``` TimeoutError: timed out after 0:20:00: [gw1] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 07:19 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-wgao-ra78a4e795@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-wgao-ra78a4e795@example.com')], entitlements=[], external_id=None, groups=[], id='7694389604581111', name=Name(family_name=None, given_name='sdk-wgao-ra78a4e795@example.com'), roles=[], schemas=[, ], user_name='sdk-wgao-ra78a4e795@example.com') 07:19 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx-OJKG-ra78a4e795: https://DATABRICKS_HOST#setting/accounts/groups/612947539504250 07:19 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx-OJKG-ra78a4e795', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='612947539504250', members=[ComplexValue(display='sdk-wgao-ra78a4e795@example.com', primary=None, ref='Users/7694389604581111', type=None, value='7694389604581111')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 07:19 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx-OJKG-ra78a4e795: https://accounts.CLOUD_ENVdatabricks.net/users/groups/1097004968125353/members 07:19 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx-OJKG-ra78a4e795', entitlements=[], external_id=None, groups=[], id='1097004968125353', members=[ComplexValue(display='sdk-wgao-ra78a4e795@example.com', primary=None, ref='Users/7694389604581111', type=None, value='7694389604581111')], meta=None, roles=[], schemas=[]) 07:19 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/0005EE01298D4DCF 07:19 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='0005EE01298D4DCF') 07:19 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 0005EE01298D4DCF [group_name admins CAN_USE] -> [group_name ucx-OJKG-ra78a4e795 CAN_USE] 07:19 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_stms7: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_stms7 07:19 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_stms7', metastore_id=None, name='ucx_stms7', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:19 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.PpKP/config.yml) doesn't exist. 07:19 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 07:19 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 07:19 INFO [databricks.labs.ucx.install] Fetching installations... 07:19 INFO [databricks.labs.ucx.installer.policy] Setting up an external metastore 07:19 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 07:19 DEBUG [tests.integration.conftest] Waiting for clusters to start... 07:24 DEBUG [tests.integration.conftest] Waiting for clusters to start... 07:24 INFO [databricks.labs.ucx.install] Installing UCX v0.31.1+None20240731072419 07:24 INFO [databricks.labs.ucx.install] Creating ucx schemas... 07:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 07:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 07:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 07:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 07:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 07:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 07:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 07:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 07:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 07:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 07:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 07:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 07:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 07:27 INFO [databricks.labs.ucx.install] Creating dashboards... 07:27 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 07:27 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 07:27 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 07:27 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 07:27 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 07:27 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 07:27 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 07:27 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 07:27 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 07:27 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 07:27 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 07:27 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 07:27 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 07:27 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.PpKP/README for the next steps. 07:27 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/807983619193545 07:19 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-wgao-ra78a4e795@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-wgao-ra78a4e795@example.com')], entitlements=[], external_id=None, groups=[], id='7694389604581111', name=Name(family_name=None, given_name='sdk-wgao-ra78a4e795@example.com'), roles=[], schemas=[, ], user_name='sdk-wgao-ra78a4e795@example.com') 07:19 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx-OJKG-ra78a4e795: https://DATABRICKS_HOST#setting/accounts/groups/612947539504250 07:19 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx-OJKG-ra78a4e795', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='612947539504250', members=[ComplexValue(display='sdk-wgao-ra78a4e795@example.com', primary=None, ref='Users/7694389604581111', type=None, value='7694389604581111')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 07:19 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx-OJKG-ra78a4e795: https://accounts.CLOUD_ENVdatabricks.net/users/groups/1097004968125353/members 07:19 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx-OJKG-ra78a4e795', entitlements=[], external_id=None, groups=[], id='1097004968125353', members=[ComplexValue(display='sdk-wgao-ra78a4e795@example.com', primary=None, ref='Users/7694389604581111', type=None, value='7694389604581111')], meta=None, roles=[], schemas=[]) 07:19 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/0005EE01298D4DCF 07:19 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='0005EE01298D4DCF') 07:19 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 0005EE01298D4DCF [group_name admins CAN_USE] -> [group_name ucx-OJKG-ra78a4e795 CAN_USE] 07:19 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_stms7: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_stms7 07:19 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_stms7', metastore_id=None, name='ucx_stms7', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:19 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.PpKP/config.yml) doesn't exist. 07:19 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 07:19 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 07:19 INFO [databricks.labs.ucx.install] Fetching installations... 07:19 INFO [databricks.labs.ucx.installer.policy] Setting up an external metastore 07:19 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 07:19 DEBUG [tests.integration.conftest] Waiting for clusters to start... 07:24 DEBUG [tests.integration.conftest] Waiting for clusters to start... 07:24 INFO [databricks.labs.ucx.install] Installing UCX v0.31.1+None20240731072419 07:24 INFO [databricks.labs.ucx.install] Creating ucx schemas... 07:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 07:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 07:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 07:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 07:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 07:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 07:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 07:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 07:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 07:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 07:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 07:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 07:24 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 07:27 INFO [databricks.labs.ucx.install] Creating dashboards... 07:27 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 07:27 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 07:27 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 07:27 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 07:27 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 07:27 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 07:27 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 07:27 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 07:27 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 07:27 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 07:27 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 07:27 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 07:27 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 07:27 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.PpKP/README for the next steps. 07:27 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/807983619193545 07:47 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster_policy permissions fixtures 07:47 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster_policy permissions fixture: 0005EE01298D4DCF [group_name admins CAN_USE] -> [group_name ucx-OJKG-ra78a4e795 CAN_USE] 07:47 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster policy fixtures 07:47 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster policy fixture: CreatePolicyResponse(policy_id='0005EE01298D4DCF') 07:47 INFO [databricks.labs.ucx.install] Deleting UCX v0.31.1+None20240731072419 from https://DATABRICKS_HOST 07:47 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_stms7 07:47 INFO [databricks.labs.ucx.install] Deleting jobs 07:47 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=970219727094708. 07:47 INFO [databricks.labs.ucx.install] Deleting scan-tables-in-mounts-experimental job_id=915680526603472. 07:47 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=872127695081588. 07:47 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=805239393146740. 07:47 INFO [databricks.labs.ucx.install] Deleting assessment job_id=807983619193545. 07:47 INFO [databricks.labs.ucx.install] Deleting migrate-external-tables-ctas job_id=431975535304203. 07:47 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=886691172505853. 07:47 INFO [databricks.labs.ucx.install] Deleting migrate-external-hiveserde-tables-in-place-experimental job_id=452129230870812. 07:47 INFO [databricks.labs.ucx.install] Deleting failing job_id=534850878723637. 07:47 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=1060351367936890. 07:47 INFO [databricks.labs.ucx.install] Deleting experimental-workflow-linter job_id=897531365606152. 07:47 INFO [databricks.labs.ucx.install] Deleting migrate-data-reconciliation job_id=18261197704171. 07:47 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=1119200183517875. 07:47 INFO [databricks.labs.ucx.install] Deleting cluster policy 07:47 INFO [databricks.labs.ucx.install] Deleting secret scope 07:47 INFO [databricks.labs.ucx.install] UnInstalling UCX complete 07:47 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace user fixtures 07:47 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='sdk-wgao-ra78a4e795@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-wgao-ra78a4e795@example.com')], entitlements=[], external_id=None, groups=[], id='7694389604581111', name=Name(family_name=None, given_name='sdk-wgao-ra78a4e795@example.com'), roles=[], schemas=[, ], user_name='sdk-wgao-ra78a4e795@example.com') 07:47 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 account group fixtures 07:47 DEBUG [databricks.labs.ucx.mixins.fixtures] removing account group fixture: Group(display_name='ucx-OJKG-ra78a4e795', entitlements=[], external_id=None, groups=[], id='1097004968125353', members=[ComplexValue(display='sdk-wgao-ra78a4e795@example.com', primary=None, ref='Users/7694389604581111', type=None, value='7694389604581111')], meta=None, roles=[], schemas=[]) 07:50 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while account group Group(display_name='ucx-OJKG-ra78a4e795', entitlements=[], external_id=None, groups=[], id='1097004968125353', members=[ComplexValue(display='sdk-wgao-ra78a4e795@example.com', primary=None, ref='Users/7694389604581111', type=None, value='7694389604581111')], meta=None, roles=[], schemas=[]) teardown: None UNAVAILABLE 07:50 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace group fixtures 07:50 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace group fixture: Group(display_name='ucx-OJKG-ra78a4e795', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='612947539504250', members=[ComplexValue(display='sdk-wgao-ra78a4e795@example.com', primary=None, ref='Users/7694389604581111', type=None, value='7694389604581111')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 07:50 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 07:50 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 07:50 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 schema fixtures 07:50 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_stms7', metastore_id=None, name='ucx_stms7', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw1] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```

_{Running from nightly #143}

❌ test_running_real_assessment_job_ext_hms: databricks.labs.blueprint.parallel.ManyError: Detected 4 failures: TimeoutError: Timed out after 0:04:00 (18m42.061s)

``` databricks.labs.blueprint.parallel.ManyError: Detected 4 failures: TimeoutError: Timed out after 0:04:00 [gw4] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-y0y6-ra78a502eb@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-y0y6-ra78a502eb@example.com')], entitlements=[], external_id=None, groups=[], id='4312102820753291', name=Name(family_name=None, given_name='sdk-y0y6-ra78a502eb@example.com'), roles=[], schemas=[, ], user_name='sdk-y0y6-ra78a502eb@example.com') 05:06 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx-xB2y-ra78a502eb: https://DATABRICKS_HOST#setting/accounts/groups/139302309161969 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx-xB2y-ra78a502eb', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='139302309161969', members=[ComplexValue(display='sdk-y0y6-ra78a502eb@example.com', primary=None, ref='Users/4312102820753291', type=None, value='4312102820753291')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 05:06 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx-xB2y-ra78a502eb: https://accounts.CLOUD_ENVdatabricks.net/users/groups/684960753717171/members 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx-xB2y-ra78a502eb', entitlements=[], external_id=None, groups=[], id='684960753717171', members=[ComplexValue(display='sdk-y0y6-ra78a502eb@example.com', primary=None, ref='Users/4312102820753291', type=None, value='4312102820753291')], meta=None, roles=[], schemas=[]) 05:06 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/00159B289D705F60 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='00159B289D705F60') 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 00159B289D705F60 [group_name admins CAN_USE] -> [group_name ucx-xB2y-ra78a502eb CAN_USE] 05:06 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sxkmq: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sxkmq 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sxkmq', metastore_id=None, name='ucx_sxkmq', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 05:06 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.aIcw/config.yml) doesn't exist. 05:06 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:06 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:06 INFO [databricks.labs.ucx.install] Fetching installations... 05:06 INFO [databricks.labs.ucx.installer.policy] Setting up an external metastore 05:06 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:06 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:19 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:19 INFO [databricks.labs.ucx.install] Installing UCX v0.31.1+920240801051935 05:19 INFO [databricks.labs.ucx.install] Creating ucx schemas... 05:19 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 05:19 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 05:19 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 05:19 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 05:19 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 05:19 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 05:19 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 05:19 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 05:19 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 05:19 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 05:19 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 05:19 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 05:19 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 05:20 INFO [databricks.labs.ucx.install] Creating dashboards... 05:20 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 05:20 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 05:20 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 05:20 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 05:20 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:20 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:20 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:20 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:20 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:20 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:20 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:20 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:20 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:20 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:20 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 05:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:23 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:23 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:23 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:23 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:23 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 05:23 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:23 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:23 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:23 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:23 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:23 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:23 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:23 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:23 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:23 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:23 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:23 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 05:23 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:23 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:23 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:23 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:23 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:24 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:24 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:24 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:24 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:24 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:24 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:24 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 05:24 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:24 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:24 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:24 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:24 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:24 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:24 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:24 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 05:24 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:24 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:24 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:24 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:24 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:24 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:24 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:24 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.aIcw/dashboards') task failed: Timed out after 0:04:00 Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 609, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 954, in create_dashboard sdk_dashboard = self._ws.lakeview.create( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/dashboards.py", line 714, in create res = self._api.do('POST', '/api/2.0/lakeview/dashboards', body=body, headers=headers) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 153, in do response = retryable(self._perform)(method, File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 264, in _perform raise self._make_nicer_error(response=response, **payload) from None databricks.sdk.errors.platform.InternalError: A database error occurred during import-dashboard-new The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 59, in wrapper raise TimeoutError(f'Timed out after {timeout}') from last_err TimeoutError: Timed out after 0:04:00 05:24 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.aIcw/dashboards') task failed: Timed out after 0:04:00 Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 609, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 954, in create_dashboard sdk_dashboard = self._ws.lakeview.create( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/dashboards.py", line 714, in create res = self._api.do('POST', '/api/2.0/lakeview/dashboards', body=body, headers=headers) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 153, in do response = retryable(self._perform)(method, File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 264, in _perform raise self._make_nicer_error(response=response, **payload) from None databricks.sdk.errors.platform.InternalError: A database error occurred during import-dashboard-new The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 59, in wrapper raise TimeoutError(f'Timed out after {timeout}') from last_err TimeoutError: Timed out after 0:04:00 05:24 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.aIcw/dashboards') task failed: Timed out after 0:04:00 Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 609, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 954, in create_dashboard sdk_dashboard = self._ws.lakeview.create( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/dashboards.py", line 714, in create res = self._api.do('POST', '/api/2.0/lakeview/dashboards', body=body, headers=headers) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 153, in do response = retryable(self._perform)(method, File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 264, in _perform raise self._make_nicer_error(response=response, **payload) from None databricks.sdk.errors.platform.InternalError: A database error occurred during import-dashboard-new The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 59, in wrapper raise TimeoutError(f'Timed out after {timeout}') from last_err TimeoutError: Timed out after 0:04:00 05:24 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.aIcw/dashboards') task failed: Timed out after 0:04:00 Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 609, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 954, in create_dashboard sdk_dashboard = self._ws.lakeview.create( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/dashboards.py", line 714, in create res = self._api.do('POST', '/api/2.0/lakeview/dashboards', body=body, headers=headers) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 153, in do response = retryable(self._perform)(method, File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 264, in _perform raise self._make_nicer_error(response=response, **payload) from None databricks.sdk.errors.platform.InternalError: A database error occurred during import-dashboard-new The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 59, in wrapper raise TimeoutError(f'Timed out after {timeout}') from last_err TimeoutError: Timed out after 0:04:00 05:24 ERROR [databricks.labs.blueprint.parallel] More than half 'installing dashboards' tasks failed: 0% results available (0/6). Took 0:04:14.955019 05:24 ERROR [databricks.labs.blueprint.parallel] installing components task failed: Detected 4 failures: TimeoutError: Timed out after 0:04:00 Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 516, in _create_database_and_dashboards Threads.strict("installing dashboards", list(self._get_create_dashboard_tasks())) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 63, in strict raise ManyError(errs) databricks.labs.blueprint.parallel.ManyError: Detected 4 failures: TimeoutError: Timed out after 0:04:00 05:24 ERROR [databricks.labs.blueprint.parallel] More than half 'installing components' tasks failed: 0% results available (0/2). Took 0:05:19.413985 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-y0y6-ra78a502eb@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-y0y6-ra78a502eb@example.com')], entitlements=[], external_id=None, groups=[], id='4312102820753291', name=Name(family_name=None, given_name='sdk-y0y6-ra78a502eb@example.com'), roles=[], schemas=[, ], user_name='sdk-y0y6-ra78a502eb@example.com') 05:06 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx-xB2y-ra78a502eb: https://DATABRICKS_HOST#setting/accounts/groups/139302309161969 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx-xB2y-ra78a502eb', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='139302309161969', members=[ComplexValue(display='sdk-y0y6-ra78a502eb@example.com', primary=None, ref='Users/4312102820753291', type=None, value='4312102820753291')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 05:06 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx-xB2y-ra78a502eb: https://accounts.CLOUD_ENVdatabricks.net/users/groups/684960753717171/members 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx-xB2y-ra78a502eb', entitlements=[], external_id=None, groups=[], id='684960753717171', members=[ComplexValue(display='sdk-y0y6-ra78a502eb@example.com', primary=None, ref='Users/4312102820753291', type=None, value='4312102820753291')], meta=None, roles=[], schemas=[]) 05:06 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/00159B289D705F60 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='00159B289D705F60') 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 00159B289D705F60 [group_name admins CAN_USE] -> [group_name ucx-xB2y-ra78a502eb CAN_USE] 05:06 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sxkmq: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sxkmq 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sxkmq', metastore_id=None, name='ucx_sxkmq', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 05:06 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.aIcw/config.yml) doesn't exist. 05:06 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:06 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:06 INFO [databricks.labs.ucx.install] Fetching installations... 05:06 INFO [databricks.labs.ucx.installer.policy] Setting up an external metastore 05:06 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:06 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:19 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:19 INFO [databricks.labs.ucx.install] Installing UCX v0.31.1+920240801051935 05:19 INFO [databricks.labs.ucx.install] Creating ucx schemas... 05:19 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 05:19 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 05:19 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 05:19 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 05:19 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 05:19 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 05:19 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 05:19 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 05:19 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 05:19 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 05:19 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 05:19 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 05:19 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 05:20 INFO [databricks.labs.ucx.install] Creating dashboards... 05:20 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 05:20 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 05:20 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 05:20 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 05:20 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:20 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:20 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:20 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:20 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:20 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:20 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:20 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:20 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:20 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:20 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:21 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 05:21 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 05:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:23 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:23 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:23 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:23 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:23 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 05:23 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:23 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:23 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:23 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:23 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:23 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:23 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:23 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:23 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:23 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:23 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:23 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 05:23 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:23 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:23 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:23 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:23 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:24 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:24 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:24 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:24 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:24 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:24 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:24 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 05:24 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:24 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:24 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:24 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:24 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:24 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:24 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:24 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 05:24 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:24 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:24 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:24 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:24 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:24 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:24 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:24 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.aIcw/dashboards') task failed: Timed out after 0:04:00 Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 609, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 954, in create_dashboard sdk_dashboard = self._ws.lakeview.create( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/dashboards.py", line 714, in create res = self._api.do('POST', '/api/2.0/lakeview/dashboards', body=body, headers=headers) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 153, in do response = retryable(self._perform)(method, File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 264, in _perform raise self._make_nicer_error(response=response, **payload) from None databricks.sdk.errors.platform.InternalError: A database error occurred during import-dashboard-new The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 59, in wrapper raise TimeoutError(f'Timed out after {timeout}') from last_err TimeoutError: Timed out after 0:04:00 05:24 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.aIcw/dashboards') task failed: Timed out after 0:04:00 Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 609, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 954, in create_dashboard sdk_dashboard = self._ws.lakeview.create( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/dashboards.py", line 714, in create res = self._api.do('POST', '/api/2.0/lakeview/dashboards', body=body, headers=headers) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 153, in do response = retryable(self._perform)(method, File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 264, in _perform raise self._make_nicer_error(response=response, **payload) from None databricks.sdk.errors.platform.InternalError: A database error occurred during import-dashboard-new The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 59, in wrapper raise TimeoutError(f'Timed out after {timeout}') from last_err TimeoutError: Timed out after 0:04:00 05:24 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.aIcw/dashboards') task failed: Timed out after 0:04:00 Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 609, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 954, in create_dashboard sdk_dashboard = self._ws.lakeview.create( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/dashboards.py", line 714, in create res = self._api.do('POST', '/api/2.0/lakeview/dashboards', body=body, headers=headers) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 153, in do response = retryable(self._perform)(method, File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 264, in _perform raise self._make_nicer_error(response=response, **payload) from None databricks.sdk.errors.platform.InternalError: A database error occurred during import-dashboard-new The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 59, in wrapper raise TimeoutError(f'Timed out after {timeout}') from last_err TimeoutError: Timed out after 0:04:00 05:24 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.aIcw/dashboards') task failed: Timed out after 0:04:00 Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 609, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 954, in create_dashboard sdk_dashboard = self._ws.lakeview.create( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/dashboards.py", line 714, in create res = self._api.do('POST', '/api/2.0/lakeview/dashboards', body=body, headers=headers) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 153, in do response = retryable(self._perform)(method, File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 264, in _perform raise self._make_nicer_error(response=response, **payload) from None databricks.sdk.errors.platform.InternalError: A database error occurred during import-dashboard-new The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 59, in wrapper raise TimeoutError(f'Timed out after {timeout}') from last_err TimeoutError: Timed out after 0:04:00 05:24 ERROR [databricks.labs.blueprint.parallel] More than half 'installing dashboards' tasks failed: 0% results available (0/6). Took 0:04:14.955019 05:24 ERROR [databricks.labs.blueprint.parallel] installing components task failed: Detected 4 failures: TimeoutError: Timed out after 0:04:00 Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 516, in _create_database_and_dashboards Threads.strict("installing dashboards", list(self._get_create_dashboard_tasks())) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 63, in strict raise ManyError(errs) databricks.labs.blueprint.parallel.ManyError: Detected 4 failures: TimeoutError: Timed out after 0:04:00 05:24 ERROR [databricks.labs.blueprint.parallel] More than half 'installing components' tasks failed: 0% results available (0/2). Took 0:05:19.413985 05:24 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster_policy permissions fixtures 05:24 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster_policy permissions fixture: 00159B289D705F60 [group_name admins CAN_USE] -> [group_name ucx-xB2y-ra78a502eb CAN_USE] 05:24 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster policy fixtures 05:24 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster policy fixture: CreatePolicyResponse(policy_id='00159B289D705F60') 05:24 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while cluster policy CreatePolicyResponse(policy_id='00159B289D705F60') teardown: Can't find a cluster policy with id: 00159B289D705F60. 05:24 INFO [databricks.labs.ucx.install] Deleting UCX v0.31.1+920240801051935 from https://DATABRICKS_HOST 05:24 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_sxkmq 05:24 INFO [databricks.labs.ucx.install] Deleting jobs 05:24 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=300344389517263. 05:24 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=1000566014575262. 05:24 INFO [databricks.labs.ucx.install] Deleting scan-tables-in-mounts-experimental job_id=934040487445088. 05:24 INFO [databricks.labs.ucx.install] Deleting failing job_id=1061048217327088. 05:24 INFO [databricks.labs.ucx.install] Deleting migrate-external-tables-ctas job_id=175033840370979. 05:24 INFO [databricks.labs.ucx.install] Deleting assessment job_id=915058225477115. 05:25 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=348569967376648. 05:25 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=493612145499802. 05:25 INFO [databricks.labs.ucx.install] Deleting migrate-data-reconciliation job_id=145490560026749. 05:25 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=519420116340646. 05:25 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=1119501272309483. 05:25 INFO [databricks.labs.ucx.install] Deleting migrate-external-hiveserde-tables-in-place-experimental job_id=1067684370523153. 05:25 INFO [databricks.labs.ucx.install] Deleting experimental-workflow-linter job_id=1112392634005097. 05:25 INFO [databricks.labs.ucx.install] Deleting cluster policy 05:25 INFO [databricks.labs.ucx.install] Deleting secret scope 05:25 INFO [databricks.labs.ucx.install] UnInstalling UCX complete 05:25 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace user fixtures 05:25 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='sdk-y0y6-ra78a502eb@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-y0y6-ra78a502eb@example.com')], entitlements=[], external_id=None, groups=[], id='4312102820753291', name=Name(family_name=None, given_name='sdk-y0y6-ra78a502eb@example.com'), roles=[], schemas=[, ], user_name='sdk-y0y6-ra78a502eb@example.com') 05:25 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 account group fixtures 05:25 DEBUG [databricks.labs.ucx.mixins.fixtures] removing account group fixture: Group(display_name='ucx-xB2y-ra78a502eb', entitlements=[], external_id=None, groups=[], id='684960753717171', members=[ComplexValue(display='sdk-y0y6-ra78a502eb@example.com', primary=None, ref='Users/4312102820753291', type=None, value='4312102820753291')], meta=None, roles=[], schemas=[]) 05:25 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace group fixtures 05:25 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace group fixture: Group(display_name='ucx-xB2y-ra78a502eb', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='139302309161969', members=[ComplexValue(display='sdk-y0y6-ra78a502eb@example.com', primary=None, ref='Users/4312102820753291', type=None, value='4312102820753291')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 05:25 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 05:25 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 05:25 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 schema fixtures 05:25 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sxkmq', metastore_id=None, name='ucx_sxkmq', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw4] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```

_{Running from nightly #144}

❌ test_running_real_assessment_job_ext_hms: TimeoutError: timed out after 0:20:00: (36m39.734s)

``` TimeoutError: timed out after 0:20:00: [gw5] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-cv6z-ra78a5034f@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-cv6z-ra78a5034f@example.com')], entitlements=[], external_id=None, groups=[], id='6750984022363964', name=Name(family_name=None, given_name='sdk-cv6z-ra78a5034f@example.com'), roles=[], schemas=[, ], user_name='sdk-cv6z-ra78a5034f@example.com') 05:06 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx-xQUw-ra78a5034f: https://DATABRICKS_HOST#setting/accounts/groups/389576239226211 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx-xQUw-ra78a5034f', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='389576239226211', members=[ComplexValue(display='sdk-cv6z-ra78a5034f@example.com', primary=None, ref='Users/6750984022363964', type=None, value='6750984022363964')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 05:06 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx-xQUw-ra78a5034f: https://accounts.CLOUD_ENVdatabricks.net/users/groups/458486370066695/members 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx-xQUw-ra78a5034f', entitlements=[], external_id=None, groups=[], id='458486370066695', members=[ComplexValue(display='sdk-cv6z-ra78a5034f@example.com', primary=None, ref='Users/6750984022363964', type=None, value='6750984022363964')], meta=None, roles=[], schemas=[]) 05:06 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/000FC88695A46A2A 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='000FC88695A46A2A') 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 000FC88695A46A2A [group_name admins CAN_USE] -> [group_name ucx-xQUw-ra78a5034f CAN_USE] 05:06 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_saqsl: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_saqsl 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_saqsl', metastore_id=None, name='ucx_saqsl', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 05:06 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.zcBN/config.yml) doesn't exist. 05:06 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:06 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:06 INFO [databricks.labs.ucx.install] Fetching installations... 05:06 INFO [databricks.labs.ucx.installer.policy] Setting up an external metastore 05:06 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:06 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:13 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:13 INFO [databricks.labs.ucx.install] Installing UCX v0.31.1+920240802051312 05:13 INFO [databricks.labs.ucx.install] Creating ucx schemas... 05:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 05:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 05:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 05:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 05:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 05:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 05:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 05:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 05:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 05:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 05:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 05:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 05:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 05:22 INFO [databricks.labs.ucx.install] Creating dashboards... 05:22 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 05:22 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 05:22 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 05:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 05:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.zcBN/README for the next steps. 05:22 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/276619073087730 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-cv6z-ra78a5034f@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-cv6z-ra78a5034f@example.com')], entitlements=[], external_id=None, groups=[], id='6750984022363964', name=Name(family_name=None, given_name='sdk-cv6z-ra78a5034f@example.com'), roles=[], schemas=[, ], user_name='sdk-cv6z-ra78a5034f@example.com') 05:06 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx-xQUw-ra78a5034f: https://DATABRICKS_HOST#setting/accounts/groups/389576239226211 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx-xQUw-ra78a5034f', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='389576239226211', members=[ComplexValue(display='sdk-cv6z-ra78a5034f@example.com', primary=None, ref='Users/6750984022363964', type=None, value='6750984022363964')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 05:06 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx-xQUw-ra78a5034f: https://accounts.CLOUD_ENVdatabricks.net/users/groups/458486370066695/members 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx-xQUw-ra78a5034f', entitlements=[], external_id=None, groups=[], id='458486370066695', members=[ComplexValue(display='sdk-cv6z-ra78a5034f@example.com', primary=None, ref='Users/6750984022363964', type=None, value='6750984022363964')], meta=None, roles=[], schemas=[]) 05:06 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/000FC88695A46A2A 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='000FC88695A46A2A') 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 000FC88695A46A2A [group_name admins CAN_USE] -> [group_name ucx-xQUw-ra78a5034f CAN_USE] 05:06 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_saqsl: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_saqsl 05:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_saqsl', metastore_id=None, name='ucx_saqsl', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 05:06 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.zcBN/config.yml) doesn't exist. 05:06 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:06 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:06 INFO [databricks.labs.ucx.install] Fetching installations... 05:06 INFO [databricks.labs.ucx.installer.policy] Setting up an external metastore 05:06 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:06 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:13 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:13 INFO [databricks.labs.ucx.install] Installing UCX v0.31.1+920240802051312 05:13 INFO [databricks.labs.ucx.install] Creating ucx schemas... 05:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 05:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 05:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 05:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 05:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 05:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 05:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 05:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 05:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 05:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 05:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 05:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 05:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 05:22 INFO [databricks.labs.ucx.install] Creating dashboards... 05:22 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 05:22 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 05:22 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 05:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 05:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:22 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.zcBN/README for the next steps. 05:22 DEBUG [databricks.labs.ucx.installer.workflows] starting assessment job: https://DATABRICKS_HOST#job/276619073087730 05:42 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster_policy permissions fixtures 05:42 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster_policy permissions fixture: 000FC88695A46A2A [group_name admins CAN_USE] -> [group_name ucx-xQUw-ra78a5034f CAN_USE] 05:42 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster policy fixtures 05:42 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster policy fixture: CreatePolicyResponse(policy_id='000FC88695A46A2A') 05:42 INFO [databricks.labs.ucx.install] Deleting UCX v0.31.1+920240802051312 from https://DATABRICKS_HOST 05:42 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_saqsl 05:43 INFO [databricks.labs.ucx.install] Deleting jobs 05:43 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=794384547727548. 05:43 INFO [databricks.labs.ucx.install] Deleting migrate-data-reconciliation job_id=357990250774862. 05:43 INFO [databricks.labs.ucx.install] Deleting assessment job_id=276619073087730. 05:43 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=1114209015790201. 05:43 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=617709307332458. 05:43 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=662645039052283. 05:43 INFO [databricks.labs.ucx.install] Deleting scan-tables-in-mounts-experimental job_id=814504579556627. 05:43 INFO [databricks.labs.ucx.install] Deleting experimental-workflow-linter job_id=715972777889755. 05:43 INFO [databricks.labs.ucx.install] Deleting migrate-external-tables-ctas job_id=255288062707618. 05:43 INFO [databricks.labs.ucx.install] Deleting failing job_id=150524763465860. 05:43 INFO [databricks.labs.ucx.install] Deleting migrate-external-hiveserde-tables-in-place-experimental job_id=432444587352573. 05:43 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=899253145799320. 05:43 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=412245867520129. 05:43 INFO [databricks.labs.ucx.install] Deleting cluster policy 05:43 INFO [databricks.labs.ucx.install] Deleting secret scope 05:43 INFO [databricks.labs.ucx.install] UnInstalling UCX complete 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace user fixtures 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='sdk-cv6z-ra78a5034f@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-cv6z-ra78a5034f@example.com')], entitlements=[], external_id=None, groups=[], id='6750984022363964', name=Name(family_name=None, given_name='sdk-cv6z-ra78a5034f@example.com'), roles=[], schemas=[, ], user_name='sdk-cv6z-ra78a5034f@example.com') 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 account group fixtures 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] removing account group fixture: Group(display_name='ucx-xQUw-ra78a5034f', entitlements=[], external_id=None, groups=[], id='458486370066695', members=[ComplexValue(display='sdk-cv6z-ra78a5034f@example.com', primary=None, ref='Users/6750984022363964', type=None, value='6750984022363964')], meta=None, roles=[], schemas=[]) 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace group fixtures 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace group fixture: Group(display_name='ucx-xQUw-ra78a5034f', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='389576239226211', members=[ComplexValue(display='sdk-cv6z-ra78a5034f@example.com', primary=None, ref='Users/6750984022363964', type=None, value='6750984022363964')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 schema fixtures 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_saqsl', metastore_id=None, name='ucx_saqsl', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw5] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```

_{Running from nightly #145}

databrickslabs / ucx

Test failure: `test_running_real_assessment_job_ext_hms` #2198