Test failure: `test_running_real_validate_groups_permissions_job`

[github-actions[bot]]

❌ test_running_real_validate_groups_permissions_job: TimeoutError: Timed out after 0:05:00 (8m0.699s)

``` TimeoutError: Timed out after 0:05:00 [gw5] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-qoze-ra78a4e793@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-qoze-ra78a4e793@example.com')], entitlements=[], external_id=None, groups=[], id='6851471377726871', name=Name(family_name=None, given_name='sdk-qoze-ra78a4e793@example.com'), roles=[], schemas=[, ], user_name='sdk-qoze-ra78a4e793@example.com') 05:43 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx-x2Nz-ra78a4e793: https://DATABRICKS_HOST#setting/accounts/groups/426646167961004 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx-x2Nz-ra78a4e793', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='426646167961004', members=[ComplexValue(display='sdk-qoze-ra78a4e793@example.com', primary=None, ref='Users/6851471377726871', type=None, value='6851471377726871')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 05:43 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx-x2Nz-ra78a4e793: https://accounts.CLOUD_ENVdatabricks.net/users/groups/792635406151723/members 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx-x2Nz-ra78a4e793', entitlements=[], external_id=None, groups=[], id='792635406151723', members=[ComplexValue(display='sdk-qoze-ra78a4e793@example.com', primary=None, ref='Users/6851471377726871', type=None, value='6851471377726871')], meta=None, roles=[], schemas=[]) 05:43 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s2d9r: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s2d9r 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s2d9r', metastore_id=None, name='ucx_s2d9r', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 05:43 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_s2d9r.ucx_t9y5e: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s2d9r/ucx_t9y5e 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_s2d9r.ucx_t9y5e', metastore_id=None, name='ucx_t9y5e', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024073107'}, row_filter=None, schema_name='ucx_s2d9r', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_s2d9r/ucx_t9y5e', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 05:43 INFO [databricks.labs.ucx.mixins.fixtures] Query Created ucx_query_QqvQa: https://DATABRICKS_HOST/sql/editor/a85dc4e9-a939-4d03-9ab2-d7364134451c 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] added query fixture: Query(can_edit=None, created_at='2024-07-31T05:43:36Z', data_source_id=None, description='TEST QUERY FOR UCX', id='a85dc4e9-a939-4d03-9ab2-d7364134451c', is_archived=False, is_draft=False, is_favorite=False, is_safe=True, last_modified_by=User(email='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', id=481119220561874, name='labs-account-admin-identity'), last_modified_by_id=None, latest_query_data_id=None, name='ucx_query_QqvQa', options=QueryOptions(catalog=None, moved_to_trash_at=None, parameters=[], schema=None), parent='folders/4279257340449065', permission_tier=None, query='SELECT * FROM ucx_s2d9r.ucx_t9y5e', query_hash=None, run_as_role=, tags=['original_query_tag'], updated_at='2024-07-31T05:43:37Z', user=User(email='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', id=481119220561874, name='labs-account-admin-identity'), user_id=481119220561874, visualizations=[Visualization(created_at='2024-07-31T05:43:36Z', description='', id='0650e00f-b1fb-41b7-b108-fa6b78aa522c', name='Results', options={'version': 2}, query=None, type='TABLE', updated_at='2024-07-31T05:43:36Z')]) 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] added query permissions fixture: a85dc4e9-a939-4d03-9ab2-d7364134451c [user_name 0a330eb5-dd51-4d97-b6e4-c474356b1d5d CAN_MANAGE, group_name admins CAN_MANAGE] -> [group_name ucx-x2Nz-ra78a4e793 CAN_EDIT] 05:43 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/00003EF5C8937E9D 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='00003EF5C8937E9D') 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 00003EF5C8937E9D [group_name admins CAN_USE] -> [group_name ucx-x2Nz-ra78a4e793 CAN_USE] 05:43 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_stl1u: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_stl1u 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_stl1u', metastore_id=None, name='ucx_stl1u', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 05:43 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_stl1u.ucx_tf2ts: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_stl1u/ucx_tf2ts 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_stl1u.ucx_tf2ts', metastore_id=None, name='ucx_tf2ts', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024073107'}, row_filter=None, schema_name='ucx_stl1u', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_stl1u/ucx_tf2ts', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] added secret scope fixture: sdk-S5Ei-ra78a4e793 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] added secret scope acl fixture: ('sdk-S5Ei-ra78a4e793', 'ucx-x2Nz-ra78a4e793') 05:43 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sxhv8: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sxhv8 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sxhv8', metastore_id=None, name='ucx_sxhv8', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 05:43 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.pYjM/config.yml) doesn't exist. 05:43 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:43 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:43 INFO [databricks.labs.ucx.install] Fetching installations... 05:43 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:43 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:43 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:43 INFO [databricks.labs.ucx.install] Installing UCX v0.31.1+None20240731054350 05:43 INFO [databricks.labs.ucx.install] Creating ucx schemas... 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 05:44 INFO [databricks.labs.ucx.install] Creating dashboards... 05:44 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 05:44 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 05:44 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 05:44 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:44 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:44 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:44 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:44 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:44 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:44 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:44 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:44 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:44 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:44 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.pYjM/README for the next steps. 05:44 DEBUG [databricks.labs.ucx.workspace_access.manager] Crawling permissions 05:44 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sxhv8.grants] fetching grants inventory 05:44 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sxhv8.grants] crawling new batch for grants 05:44 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sxhv8.tables] fetching tables inventory 05:44 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sxhv8.tables] crawling new batch for tables 05:44 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_stl1u] listing tables and views 05:44 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_stl1u.ucx_tf2ts] fetching table metadata 05:44 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sxhv8.tables] found 1 new records for tables 05:44 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sxhv8.udfs] fetching udfs inventory 05:44 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sxhv8.udfs] crawling new batch for udfs 05:44 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_stl1u] listing udfs 05:44 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sxhv8.udfs] found 0 new records for udfs 05:44 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sxhv8.grants] found 3 new records for grants 05:44 INFO [databricks.labs.ucx.workspace_access.manager] Starting to crawl permissions. Total tasks: 5 05:44 INFO [databricks.labs.ucx.workspace_access.manager] Total crawled permissions: 5 05:44 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sxhv8.permissions] found 5 new records for permissions 05:44 INFO [databricks.labs.ucx.workspace_access.manager] Successfully saved the items to inventory table 05:44 INFO [databricks.labs.ucx.workspace_access.manager] Saved 5 to hive_metastore.ucx_sxhv8.permissions 05:44 DEBUG [databricks.labs.ucx.installer.workflows] starting validate-groups-permissions job: https://DATABRICKS_HOST#job/576001911317514 [gw5] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-qoze-ra78a4e793@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-qoze-ra78a4e793@example.com')], entitlements=[], external_id=None, groups=[], id='6851471377726871', name=Name(family_name=None, given_name='sdk-qoze-ra78a4e793@example.com'), roles=[], schemas=[, ], user_name='sdk-qoze-ra78a4e793@example.com') 05:43 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx-x2Nz-ra78a4e793: https://DATABRICKS_HOST#setting/accounts/groups/426646167961004 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx-x2Nz-ra78a4e793', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='426646167961004', members=[ComplexValue(display='sdk-qoze-ra78a4e793@example.com', primary=None, ref='Users/6851471377726871', type=None, value='6851471377726871')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 05:43 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx-x2Nz-ra78a4e793: https://accounts.CLOUD_ENVdatabricks.net/users/groups/792635406151723/members 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx-x2Nz-ra78a4e793', entitlements=[], external_id=None, groups=[], id='792635406151723', members=[ComplexValue(display='sdk-qoze-ra78a4e793@example.com', primary=None, ref='Users/6851471377726871', type=None, value='6851471377726871')], meta=None, roles=[], schemas=[]) 05:43 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s2d9r: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s2d9r 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s2d9r', metastore_id=None, name='ucx_s2d9r', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 05:43 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_s2d9r.ucx_t9y5e: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s2d9r/ucx_t9y5e 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_s2d9r.ucx_t9y5e', metastore_id=None, name='ucx_t9y5e', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024073107'}, row_filter=None, schema_name='ucx_s2d9r', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_s2d9r/ucx_t9y5e', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 05:43 INFO [databricks.labs.ucx.mixins.fixtures] Query Created ucx_query_QqvQa: https://DATABRICKS_HOST/sql/editor/a85dc4e9-a939-4d03-9ab2-d7364134451c 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] added query fixture: Query(can_edit=None, created_at='2024-07-31T05:43:36Z', data_source_id=None, description='TEST QUERY FOR UCX', id='a85dc4e9-a939-4d03-9ab2-d7364134451c', is_archived=False, is_draft=False, is_favorite=False, is_safe=True, last_modified_by=User(email='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', id=481119220561874, name='labs-account-admin-identity'), last_modified_by_id=None, latest_query_data_id=None, name='ucx_query_QqvQa', options=QueryOptions(catalog=None, moved_to_trash_at=None, parameters=[], schema=None), parent='folders/4279257340449065', permission_tier=None, query='SELECT * FROM ucx_s2d9r.ucx_t9y5e', query_hash=None, run_as_role=, tags=['original_query_tag'], updated_at='2024-07-31T05:43:37Z', user=User(email='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', id=481119220561874, name='labs-account-admin-identity'), user_id=481119220561874, visualizations=[Visualization(created_at='2024-07-31T05:43:36Z', description='', id='0650e00f-b1fb-41b7-b108-fa6b78aa522c', name='Results', options={'version': 2}, query=None, type='TABLE', updated_at='2024-07-31T05:43:36Z')]) 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] added query permissions fixture: a85dc4e9-a939-4d03-9ab2-d7364134451c [user_name 0a330eb5-dd51-4d97-b6e4-c474356b1d5d CAN_MANAGE, group_name admins CAN_MANAGE] -> [group_name ucx-x2Nz-ra78a4e793 CAN_EDIT] 05:43 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/00003EF5C8937E9D 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='00003EF5C8937E9D') 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 00003EF5C8937E9D [group_name admins CAN_USE] -> [group_name ucx-x2Nz-ra78a4e793 CAN_USE] 05:43 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_stl1u: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_stl1u 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_stl1u', metastore_id=None, name='ucx_stl1u', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 05:43 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_stl1u.ucx_tf2ts: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_stl1u/ucx_tf2ts 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_stl1u.ucx_tf2ts', metastore_id=None, name='ucx_tf2ts', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024073107'}, row_filter=None, schema_name='ucx_stl1u', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_stl1u/ucx_tf2ts', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] added secret scope fixture: sdk-S5Ei-ra78a4e793 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] added secret scope acl fixture: ('sdk-S5Ei-ra78a4e793', 'ucx-x2Nz-ra78a4e793') 05:43 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sxhv8: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sxhv8 05:43 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sxhv8', metastore_id=None, name='ucx_sxhv8', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 05:43 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.pYjM/config.yml) doesn't exist. 05:43 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:43 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:43 INFO [databricks.labs.ucx.install] Fetching installations... 05:43 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:43 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:43 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:43 INFO [databricks.labs.ucx.install] Installing UCX v0.31.1+None20240731054350 05:43 INFO [databricks.labs.ucx.install] Creating ucx schemas... 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 05:44 INFO [databricks.labs.ucx.install] Creating dashboards... 05:44 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 05:44 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 05:44 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 05:44 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:44 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:44 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:44 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:44 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:44 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:44 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:44 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:44 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:44 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:44 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.pYjM/README for the next steps. 05:44 DEBUG [databricks.labs.ucx.workspace_access.manager] Crawling permissions 05:44 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sxhv8.grants] fetching grants inventory 05:44 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sxhv8.grants] crawling new batch for grants 05:44 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sxhv8.tables] fetching tables inventory 05:44 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sxhv8.tables] crawling new batch for tables 05:44 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_stl1u] listing tables and views 05:44 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_stl1u.ucx_tf2ts] fetching table metadata 05:44 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sxhv8.tables] found 1 new records for tables 05:44 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sxhv8.udfs] fetching udfs inventory 05:44 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sxhv8.udfs] crawling new batch for udfs 05:44 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_stl1u] listing udfs 05:44 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sxhv8.udfs] found 0 new records for udfs 05:44 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sxhv8.grants] found 3 new records for grants 05:44 INFO [databricks.labs.ucx.workspace_access.manager] Starting to crawl permissions. Total tasks: 5 05:44 INFO [databricks.labs.ucx.workspace_access.manager] Total crawled permissions: 5 05:44 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sxhv8.permissions] found 5 new records for permissions 05:44 INFO [databricks.labs.ucx.workspace_access.manager] Successfully saved the items to inventory table 05:44 INFO [databricks.labs.ucx.workspace_access.manager] Saved 5 to hive_metastore.ucx_sxhv8.permissions 05:44 DEBUG [databricks.labs.ucx.installer.workflows] starting validate-groups-permissions job: https://DATABRICKS_HOST#job/576001911317514 05:45 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 secret scope acl fixtures 05:45 DEBUG [databricks.labs.ucx.mixins.fixtures] removing secret scope acl fixture: ('sdk-S5Ei-ra78a4e793', 'ucx-x2Nz-ra78a4e793') 05:45 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 secret scope fixtures 05:45 DEBUG [databricks.labs.ucx.mixins.fixtures] removing secret scope fixture: sdk-S5Ei-ra78a4e793 05:45 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster_policy permissions fixtures 05:45 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster_policy permissions fixture: 00003EF5C8937E9D [group_name admins CAN_USE] -> [group_name ucx-x2Nz-ra78a4e793 CAN_USE] 05:45 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster policy fixtures 05:45 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster policy fixture: CreatePolicyResponse(policy_id='00003EF5C8937E9D') 05:45 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 query permissions fixtures 05:45 DEBUG [databricks.labs.ucx.mixins.fixtures] removing query permissions fixture: a85dc4e9-a939-4d03-9ab2-d7364134451c [user_name 0a330eb5-dd51-4d97-b6e4-c474356b1d5d CAN_MANAGE, group_name admins CAN_MANAGE] -> [group_name ucx-x2Nz-ra78a4e793 CAN_EDIT] 05:45 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 query fixtures 05:45 DEBUG [databricks.labs.ucx.mixins.fixtures] removing query fixture: Query(can_edit=None, created_at='2024-07-31T05:43:36Z', data_source_id=None, description='TEST QUERY FOR UCX', id='a85dc4e9-a939-4d03-9ab2-d7364134451c', is_archived=False, is_draft=False, is_favorite=False, is_safe=True, last_modified_by=User(email='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', id=481119220561874, name='labs-account-admin-identity'), last_modified_by_id=None, latest_query_data_id=None, name='ucx_query_QqvQa', options=QueryOptions(catalog=None, moved_to_trash_at=None, parameters=[], schema=None), parent='folders/4279257340449065', permission_tier=None, query='SELECT * FROM ucx_s2d9r.ucx_t9y5e', query_hash=None, run_as_role=, tags=['original_query_tag'], updated_at='2024-07-31T05:43:37Z', user=User(email='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', id=481119220561874, name='labs-account-admin-identity'), user_id=481119220561874, visualizations=[Visualization(created_at='2024-07-31T05:43:36Z', description='', id='0650e00f-b1fb-41b7-b108-fa6b78aa522c', name='Results', options={'version': 2}, query=None, type='TABLE', updated_at='2024-07-31T05:43:36Z')]) 05:45 INFO [databricks.labs.ucx.install] Deleting UCX v0.31.1+None20240731054350 from https://DATABRICKS_HOST 05:46 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_sxhv8 05:46 INFO [databricks.labs.ucx.install] Deleting jobs 05:46 INFO [databricks.labs.ucx.install] Deleting experimental-workflow-linter job_id=278710493582928. 05:46 INFO [databricks.labs.ucx.install] Deleting scan-tables-in-mounts-experimental job_id=1056472978534363. 05:46 INFO [databricks.labs.ucx.install] Deleting assessment job_id=63419420259630. 05:46 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=107966347602410. 05:46 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=431905332021313. 05:46 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=924657504055280. 05:46 INFO [databricks.labs.ucx.install] Deleting migrate-external-hiveserde-tables-in-place-experimental job_id=1061267194599505. 05:46 INFO [databricks.labs.ucx.install] Deleting failing job_id=59456538986455. 05:46 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=973312703810339. 05:46 INFO [databricks.labs.ucx.install] Deleting migrate-external-tables-ctas job_id=264707719167074. 05:46 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=56304649419481. 05:46 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=576001911317514. 05:46 INFO [databricks.labs.ucx.install] Deleting migrate-data-reconciliation job_id=633471721372722. 05:46 INFO [databricks.labs.ucx.install] Deleting cluster policy 05:46 INFO [databricks.labs.ucx.install] Deleting secret scope 05:46 INFO [databricks.labs.ucx.install] UnInstalling UCX complete 05:46 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace user fixtures 05:46 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='sdk-qoze-ra78a4e793@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-qoze-ra78a4e793@example.com')], entitlements=[], external_id=None, groups=[], id='6851471377726871', name=Name(family_name=None, given_name='sdk-qoze-ra78a4e793@example.com'), roles=[], schemas=[, ], user_name='sdk-qoze-ra78a4e793@example.com') 05:46 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 account group fixtures 05:46 DEBUG [databricks.labs.ucx.mixins.fixtures] removing account group fixture: Group(display_name='ucx-x2Nz-ra78a4e793', entitlements=[], external_id=None, groups=[], id='792635406151723', members=[ComplexValue(display='sdk-qoze-ra78a4e793@example.com', primary=None, ref='Users/6851471377726871', type=None, value='6851471377726871')], meta=None, roles=[], schemas=[]) 05:51 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace group fixtures 05:51 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace group fixture: Group(display_name='ucx-x2Nz-ra78a4e793', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='426646167961004', members=[ComplexValue(display='sdk-qoze-ra78a4e793@example.com', primary=None, ref='Users/6851471377726871', type=None, value='6851471377726871')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 05:51 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 05:51 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 table fixtures 05:51 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_s2d9r.ucx_t9y5e', metastore_id=None, name='ucx_t9y5e', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024073107'}, row_filter=None, schema_name='ucx_s2d9r', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_s2d9r/ucx_t9y5e', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 05:51 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_stl1u.ucx_tf2ts', metastore_id=None, name='ucx_tf2ts', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024073107'}, row_filter=None, schema_name='ucx_stl1u', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_stl1u/ucx_tf2ts', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 05:51 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 schema fixtures 05:51 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s2d9r', metastore_id=None, name='ucx_s2d9r', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 05:51 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_stl1u', metastore_id=None, name='ucx_stl1u', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 05:51 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sxhv8', metastore_id=None, name='ucx_sxhv8', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) ```

_{Running from nightly #143}

[github-actions[bot]]

❌ test_running_real_validate_groups_permissions_job: TimeoutError: Timed out after 0:05:00 (8m19.346s)

``` TimeoutError: Timed out after 0:05:00 [gw0] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 07:56 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-vf1e-ra78a4e795@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-vf1e-ra78a4e795@example.com')], entitlements=[], external_id=None, groups=[], id='2701972383186196', name=Name(family_name=None, given_name='sdk-vf1e-ra78a4e795@example.com'), roles=[], schemas=[, ], user_name='sdk-vf1e-ra78a4e795@example.com') 07:56 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx-gd10-ra78a4e795: https://DATABRICKS_HOST#setting/accounts/groups/1108514349747343 07:56 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx-gd10-ra78a4e795', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='1108514349747343', members=[ComplexValue(display='sdk-vf1e-ra78a4e795@example.com', primary=None, ref='Users/2701972383186196', type=None, value='2701972383186196')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 07:56 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx-gd10-ra78a4e795: https://accounts.CLOUD_ENVdatabricks.net/users/groups/689303973207261/members 07:56 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx-gd10-ra78a4e795', entitlements=[], external_id=None, groups=[], id='689303973207261', members=[ComplexValue(display='sdk-vf1e-ra78a4e795@example.com', primary=None, ref='Users/2701972383186196', type=None, value='2701972383186196')], meta=None, roles=[], schemas=[]) 07:56 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sg9yd: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sg9yd 07:56 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sg9yd', metastore_id=None, name='ucx_sg9yd', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:56 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_sg9yd.ucx_twtco: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sg9yd/ucx_twtco 07:56 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sg9yd.ucx_twtco', metastore_id=None, name='ucx_twtco', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024073109'}, row_filter=None, schema_name='ucx_sg9yd', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_sg9yd/ucx_twtco', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:56 INFO [databricks.labs.ucx.mixins.fixtures] Query Created ucx_query_QXHgT: https://DATABRICKS_HOST/sql/editor/1dc3ee97-65e9-4121-9f46-061648a99e03 07:56 DEBUG [databricks.labs.ucx.mixins.fixtures] added query fixture: Query(can_edit=None, created_at='2024-07-31T07:56:57Z', data_source_id=None, description='TEST QUERY FOR UCX', id='1dc3ee97-65e9-4121-9f46-061648a99e03', is_archived=False, is_draft=False, is_favorite=False, is_safe=True, last_modified_by=User(email='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', id=481119220561874, name='labs-account-admin-identity'), last_modified_by_id=None, latest_query_data_id=None, name='ucx_query_QXHgT', options=QueryOptions(catalog=None, moved_to_trash_at=None, parameters=[], schema=None), parent='folders/4279257340449065', permission_tier=None, query='SELECT * FROM ucx_sg9yd.ucx_twtco', query_hash=None, run_as_role=, tags=['original_query_tag'], updated_at='2024-07-31T07:56:58Z', user=User(email='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', id=481119220561874, name='labs-account-admin-identity'), user_id=481119220561874, visualizations=[Visualization(created_at='2024-07-31T07:56:57Z', description='', id='3dee3412-bb7a-49e5-bd26-fc36256d5736', name='Results', options={'version': 2}, query=None, type='TABLE', updated_at='2024-07-31T07:56:57Z')]) 07:56 DEBUG [databricks.labs.ucx.mixins.fixtures] added query permissions fixture: 1dc3ee97-65e9-4121-9f46-061648a99e03 [user_name 0a330eb5-dd51-4d97-b6e4-c474356b1d5d CAN_MANAGE, group_name admins CAN_MANAGE] -> [group_name ucx-gd10-ra78a4e795 CAN_EDIT] 07:56 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/001FCD92B891D149 07:56 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='001FCD92B891D149') 07:56 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 001FCD92B891D149 [group_name admins CAN_USE] -> [group_name ucx-gd10-ra78a4e795 CAN_USE] 07:57 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s1zpq: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s1zpq 07:57 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s1zpq', metastore_id=None, name='ucx_s1zpq', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:57 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_s1zpq.ucx_tenzb: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s1zpq/ucx_tenzb 07:57 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_s1zpq.ucx_tenzb', metastore_id=None, name='ucx_tenzb', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024073109'}, row_filter=None, schema_name='ucx_s1zpq', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_s1zpq/ucx_tenzb', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:57 DEBUG [databricks.labs.ucx.mixins.fixtures] added secret scope fixture: sdk-Z30X-ra78a4e795 07:57 DEBUG [databricks.labs.ucx.mixins.fixtures] added secret scope acl fixture: ('sdk-Z30X-ra78a4e795', 'ucx-gd10-ra78a4e795') 07:57 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_scphz: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_scphz 07:57 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_scphz', metastore_id=None, name='ucx_scphz', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:57 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.2y2L/config.yml) doesn't exist. 07:57 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 07:57 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 07:57 INFO [databricks.labs.ucx.install] Fetching installations... 07:57 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 07:57 DEBUG [tests.integration.conftest] Waiting for clusters to start... 07:57 DEBUG [tests.integration.conftest] Waiting for clusters to start... 07:57 INFO [databricks.labs.ucx.install] Installing UCX v0.31.1+None20240731075709 07:57 INFO [databricks.labs.ucx.install] Creating ucx schemas... 07:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 07:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 07:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 07:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 07:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 07:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 07:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 07:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 07:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 07:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 07:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 07:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 07:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 07:57 INFO [databricks.labs.ucx.install] Creating dashboards... 07:57 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 07:57 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 07:57 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 07:57 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 07:57 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 07:57 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 07:57 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 07:57 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 07:57 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 07:57 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 07:57 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 07:57 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 07:57 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 07:57 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 07:57 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 07:57 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 07:57 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 07:57 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.2y2L/README for the next steps. 07:57 DEBUG [databricks.labs.ucx.workspace_access.manager] Crawling permissions 07:57 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_scphz.grants] fetching grants inventory 07:57 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_scphz.grants] crawling new batch for grants 07:57 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_scphz.tables] fetching tables inventory 07:57 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_scphz.tables] crawling new batch for tables 07:57 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s1zpq] listing tables and views 07:57 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s1zpq.ucx_tenzb] fetching table metadata 07:57 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_scphz.tables] found 1 new records for tables 07:58 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_scphz.udfs] fetching udfs inventory 07:58 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_scphz.udfs] crawling new batch for udfs 07:58 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_s1zpq] listing udfs 07:58 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_scphz.udfs] found 0 new records for udfs 07:58 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_scphz.grants] found 9 new records for grants 07:58 INFO [databricks.labs.ucx.workspace_access.manager] Starting to crawl permissions. Total tasks: 5 07:58 INFO [databricks.labs.ucx.workspace_access.manager] Total crawled permissions: 5 07:58 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_scphz.permissions] found 5 new records for permissions 07:58 INFO [databricks.labs.ucx.workspace_access.manager] Successfully saved the items to inventory table 07:58 INFO [databricks.labs.ucx.workspace_access.manager] Saved 5 to hive_metastore.ucx_scphz.permissions 07:58 DEBUG [databricks.labs.ucx.installer.workflows] starting validate-groups-permissions job: https://DATABRICKS_HOST#job/79387633529622 [gw0] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 07:56 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-vf1e-ra78a4e795@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-vf1e-ra78a4e795@example.com')], entitlements=[], external_id=None, groups=[], id='2701972383186196', name=Name(family_name=None, given_name='sdk-vf1e-ra78a4e795@example.com'), roles=[], schemas=[, ], user_name='sdk-vf1e-ra78a4e795@example.com') 07:56 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx-gd10-ra78a4e795: https://DATABRICKS_HOST#setting/accounts/groups/1108514349747343 07:56 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx-gd10-ra78a4e795', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='1108514349747343', members=[ComplexValue(display='sdk-vf1e-ra78a4e795@example.com', primary=None, ref='Users/2701972383186196', type=None, value='2701972383186196')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 07:56 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx-gd10-ra78a4e795: https://accounts.CLOUD_ENVdatabricks.net/users/groups/689303973207261/members 07:56 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx-gd10-ra78a4e795', entitlements=[], external_id=None, groups=[], id='689303973207261', members=[ComplexValue(display='sdk-vf1e-ra78a4e795@example.com', primary=None, ref='Users/2701972383186196', type=None, value='2701972383186196')], meta=None, roles=[], schemas=[]) 07:56 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sg9yd: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sg9yd 07:56 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sg9yd', metastore_id=None, name='ucx_sg9yd', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:56 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_sg9yd.ucx_twtco: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sg9yd/ucx_twtco 07:56 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sg9yd.ucx_twtco', metastore_id=None, name='ucx_twtco', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024073109'}, row_filter=None, schema_name='ucx_sg9yd', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_sg9yd/ucx_twtco', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:56 INFO [databricks.labs.ucx.mixins.fixtures] Query Created ucx_query_QXHgT: https://DATABRICKS_HOST/sql/editor/1dc3ee97-65e9-4121-9f46-061648a99e03 07:56 DEBUG [databricks.labs.ucx.mixins.fixtures] added query fixture: Query(can_edit=None, created_at='2024-07-31T07:56:57Z', data_source_id=None, description='TEST QUERY FOR UCX', id='1dc3ee97-65e9-4121-9f46-061648a99e03', is_archived=False, is_draft=False, is_favorite=False, is_safe=True, last_modified_by=User(email='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', id=481119220561874, name='labs-account-admin-identity'), last_modified_by_id=None, latest_query_data_id=None, name='ucx_query_QXHgT', options=QueryOptions(catalog=None, moved_to_trash_at=None, parameters=[], schema=None), parent='folders/4279257340449065', permission_tier=None, query='SELECT * FROM ucx_sg9yd.ucx_twtco', query_hash=None, run_as_role=, tags=['original_query_tag'], updated_at='2024-07-31T07:56:58Z', user=User(email='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', id=481119220561874, name='labs-account-admin-identity'), user_id=481119220561874, visualizations=[Visualization(created_at='2024-07-31T07:56:57Z', description='', id='3dee3412-bb7a-49e5-bd26-fc36256d5736', name='Results', options={'version': 2}, query=None, type='TABLE', updated_at='2024-07-31T07:56:57Z')]) 07:56 DEBUG [databricks.labs.ucx.mixins.fixtures] added query permissions fixture: 1dc3ee97-65e9-4121-9f46-061648a99e03 [user_name 0a330eb5-dd51-4d97-b6e4-c474356b1d5d CAN_MANAGE, group_name admins CAN_MANAGE] -> [group_name ucx-gd10-ra78a4e795 CAN_EDIT] 07:56 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/001FCD92B891D149 07:56 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='001FCD92B891D149') 07:56 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 001FCD92B891D149 [group_name admins CAN_USE] -> [group_name ucx-gd10-ra78a4e795 CAN_USE] 07:57 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s1zpq: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s1zpq 07:57 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s1zpq', metastore_id=None, name='ucx_s1zpq', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:57 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_s1zpq.ucx_tenzb: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s1zpq/ucx_tenzb 07:57 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_s1zpq.ucx_tenzb', metastore_id=None, name='ucx_tenzb', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024073109'}, row_filter=None, schema_name='ucx_s1zpq', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_s1zpq/ucx_tenzb', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:57 DEBUG [databricks.labs.ucx.mixins.fixtures] added secret scope fixture: sdk-Z30X-ra78a4e795 07:57 DEBUG [databricks.labs.ucx.mixins.fixtures] added secret scope acl fixture: ('sdk-Z30X-ra78a4e795', 'ucx-gd10-ra78a4e795') 07:57 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_scphz: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_scphz 07:57 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_scphz', metastore_id=None, name='ucx_scphz', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:57 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.2y2L/config.yml) doesn't exist. 07:57 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 07:57 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 07:57 INFO [databricks.labs.ucx.install] Fetching installations... 07:57 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 07:57 DEBUG [tests.integration.conftest] Waiting for clusters to start... 07:57 DEBUG [tests.integration.conftest] Waiting for clusters to start... 07:57 INFO [databricks.labs.ucx.install] Installing UCX v0.31.1+None20240731075709 07:57 INFO [databricks.labs.ucx.install] Creating ucx schemas... 07:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 07:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 07:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 07:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 07:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 07:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 07:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 07:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 07:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 07:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 07:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 07:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 07:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 07:57 INFO [databricks.labs.ucx.install] Creating dashboards... 07:57 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 07:57 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 07:57 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 07:57 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 07:57 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 07:57 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 07:57 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 07:57 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 07:57 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 07:57 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 07:57 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 07:57 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 07:57 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 07:57 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 07:57 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 07:57 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 07:57 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 07:57 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.2y2L/README for the next steps. 07:57 DEBUG [databricks.labs.ucx.workspace_access.manager] Crawling permissions 07:57 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_scphz.grants] fetching grants inventory 07:57 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_scphz.grants] crawling new batch for grants 07:57 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_scphz.tables] fetching tables inventory 07:57 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_scphz.tables] crawling new batch for tables 07:57 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s1zpq] listing tables and views 07:57 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s1zpq.ucx_tenzb] fetching table metadata 07:57 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_scphz.tables] found 1 new records for tables 07:58 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_scphz.udfs] fetching udfs inventory 07:58 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_scphz.udfs] crawling new batch for udfs 07:58 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_s1zpq] listing udfs 07:58 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_scphz.udfs] found 0 new records for udfs 07:58 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_scphz.grants] found 9 new records for grants 07:58 INFO [databricks.labs.ucx.workspace_access.manager] Starting to crawl permissions. Total tasks: 5 07:58 INFO [databricks.labs.ucx.workspace_access.manager] Total crawled permissions: 5 07:58 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_scphz.permissions] found 5 new records for permissions 07:58 INFO [databricks.labs.ucx.workspace_access.manager] Successfully saved the items to inventory table 07:58 INFO [databricks.labs.ucx.workspace_access.manager] Saved 5 to hive_metastore.ucx_scphz.permissions 07:58 DEBUG [databricks.labs.ucx.installer.workflows] starting validate-groups-permissions job: https://DATABRICKS_HOST#job/79387633529622 07:59 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 secret scope acl fixtures 07:59 DEBUG [databricks.labs.ucx.mixins.fixtures] removing secret scope acl fixture: ('sdk-Z30X-ra78a4e795', 'ucx-gd10-ra78a4e795') 07:59 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 secret scope fixtures 07:59 DEBUG [databricks.labs.ucx.mixins.fixtures] removing secret scope fixture: sdk-Z30X-ra78a4e795 07:59 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster_policy permissions fixtures 07:59 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster_policy permissions fixture: 001FCD92B891D149 [group_name admins CAN_USE] -> [group_name ucx-gd10-ra78a4e795 CAN_USE] 07:59 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster policy fixtures 07:59 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster policy fixture: CreatePolicyResponse(policy_id='001FCD92B891D149') 07:59 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 query permissions fixtures 07:59 DEBUG [databricks.labs.ucx.mixins.fixtures] removing query permissions fixture: 1dc3ee97-65e9-4121-9f46-061648a99e03 [user_name 0a330eb5-dd51-4d97-b6e4-c474356b1d5d CAN_MANAGE, group_name admins CAN_MANAGE] -> [group_name ucx-gd10-ra78a4e795 CAN_EDIT] 07:59 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 query fixtures 07:59 DEBUG [databricks.labs.ucx.mixins.fixtures] removing query fixture: Query(can_edit=None, created_at='2024-07-31T07:56:57Z', data_source_id=None, description='TEST QUERY FOR UCX', id='1dc3ee97-65e9-4121-9f46-061648a99e03', is_archived=False, is_draft=False, is_favorite=False, is_safe=True, last_modified_by=User(email='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', id=481119220561874, name='labs-account-admin-identity'), last_modified_by_id=None, latest_query_data_id=None, name='ucx_query_QXHgT', options=QueryOptions(catalog=None, moved_to_trash_at=None, parameters=[], schema=None), parent='folders/4279257340449065', permission_tier=None, query='SELECT * FROM ucx_sg9yd.ucx_twtco', query_hash=None, run_as_role=, tags=['original_query_tag'], updated_at='2024-07-31T07:56:58Z', user=User(email='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', id=481119220561874, name='labs-account-admin-identity'), user_id=481119220561874, visualizations=[Visualization(created_at='2024-07-31T07:56:57Z', description='', id='3dee3412-bb7a-49e5-bd26-fc36256d5736', name='Results', options={'version': 2}, query=None, type='TABLE', updated_at='2024-07-31T07:56:57Z')]) 07:59 INFO [databricks.labs.ucx.install] Deleting UCX v0.31.1+None20240731075709 from https://DATABRICKS_HOST 07:59 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_scphz 07:59 INFO [databricks.labs.ucx.install] Deleting jobs 07:59 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=931441671130495. 07:59 INFO [databricks.labs.ucx.install] Deleting migrate-external-hiveserde-tables-in-place-experimental job_id=7478295260846. 07:59 INFO [databricks.labs.ucx.install] Deleting scan-tables-in-mounts-experimental job_id=706934981234683. 07:59 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=523375895582578. 07:59 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=707761312524940. 07:59 INFO [databricks.labs.ucx.install] Deleting failing job_id=838710499558224. 07:59 INFO [databricks.labs.ucx.install] Deleting assessment job_id=789481505238693. 07:59 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=79387633529622. 07:59 INFO [databricks.labs.ucx.install] Deleting migrate-external-tables-ctas job_id=1015877594912647. 07:59 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=578250360164864. 07:59 INFO [databricks.labs.ucx.install] Deleting migrate-data-reconciliation job_id=1063818395966906. 07:59 INFO [databricks.labs.ucx.install] Deleting experimental-workflow-linter job_id=397114970314234. 07:59 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=399441877088509. 07:59 INFO [databricks.labs.ucx.install] Deleting cluster policy 07:59 INFO [databricks.labs.ucx.install] Deleting secret scope 07:59 INFO [databricks.labs.ucx.install] UnInstalling UCX complete 07:59 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace user fixtures 07:59 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='sdk-vf1e-ra78a4e795@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-vf1e-ra78a4e795@example.com')], entitlements=[], external_id=None, groups=[], id='2701972383186196', name=Name(family_name=None, given_name='sdk-vf1e-ra78a4e795@example.com'), roles=[], schemas=[, ], user_name='sdk-vf1e-ra78a4e795@example.com') 07:59 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 account group fixtures 07:59 DEBUG [databricks.labs.ucx.mixins.fixtures] removing account group fixture: Group(display_name='ucx-gd10-ra78a4e795', entitlements=[], external_id=None, groups=[], id='689303973207261', members=[ComplexValue(display='sdk-vf1e-ra78a4e795@example.com', primary=None, ref='Users/2701972383186196', type=None, value='2701972383186196')], meta=None, roles=[], schemas=[]) 08:05 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace group fixtures 08:05 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace group fixture: Group(display_name='ucx-gd10-ra78a4e795', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='1108514349747343', members=[ComplexValue(display='sdk-vf1e-ra78a4e795@example.com', primary=None, ref='Users/2701972383186196', type=None, value='2701972383186196')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 08:05 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 08:05 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 table fixtures 08:05 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sg9yd.ucx_twtco', metastore_id=None, name='ucx_twtco', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024073109'}, row_filter=None, schema_name='ucx_sg9yd', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_sg9yd/ucx_twtco', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 08:05 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_s1zpq.ucx_tenzb', metastore_id=None, name='ucx_tenzb', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024073109'}, row_filter=None, schema_name='ucx_s1zpq', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_s1zpq/ucx_tenzb', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 08:05 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 schema fixtures 08:05 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sg9yd', metastore_id=None, name='ucx_sg9yd', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 08:05 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s1zpq', metastore_id=None, name='ucx_s1zpq', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 08:05 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_scphz', metastore_id=None, name='ucx_scphz', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) ```

_{Running from nightly #143}