Update `assessment` workflow documentation to cover the `crawl_udfs` task.

❌ 39/41 passed, 1 flaky, 2 failed, 2 skipped, 1h51m35s total

❌ test_running_real_remove_backup_groups_job: TimeoutError: Timed out after 0:03:00 (12m19.783s)

``` TimeoutError: Timed out after 0:03:00 [gw4] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 13:37 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-hsks-ra78a530a7@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-hsks-ra78a530a7@example.com')], entitlements=[], external_id=None, groups=[], id='4546320172229843', name=Name(family_name=None, given_name='sdk-hsks-ra78a530a7@example.com'), roles=[], schemas=[, ], user_name='sdk-hsks-ra78a530a7@example.com') 13:37 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx-oKxr-ra78a530a7: https://DATABRICKS_HOST#setting/accounts/groups/169865458132965 13:37 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx-oKxr-ra78a530a7', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='169865458132965', members=[ComplexValue(display='sdk-hsks-ra78a530a7@example.com', primary=None, ref='Users/4546320172229843', type=None, value='4546320172229843')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 13:37 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx-oKxr-ra78a530a7: https://accounts.CLOUD_ENVdatabricks.net/users/groups/146950221997294/members 13:37 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx-oKxr-ra78a530a7', entitlements=[], external_id=None, groups=[], id='146950221997294', members=[ComplexValue(display='sdk-hsks-ra78a530a7@example.com', primary=None, ref='Users/4546320172229843', type=None, value='4546320172229843')], meta=None, roles=[], schemas=[]) 13:37 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sfyne: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sfyne 13:37 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sfyne', metastore_id=None, name='ucx_sfyne', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 13:37 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.SlYu/config.yml) doesn't exist. 13:37 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 13:37 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 13:37 INFO [databricks.labs.ucx.install] Fetching installations... 13:37 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 13:37 DEBUG [tests.integration.conftest] Waiting for clusters to start... 13:37 DEBUG [tests.integration.conftest] Waiting for clusters to start... 13:37 INFO [databricks.labs.ucx.install] Installing UCX v0.36.1+2020240918133728 13:37 INFO [databricks.labs.ucx.install] Creating ucx schemas... 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 13:37 INFO [databricks.labs.ucx.install] Creating dashboards... 13:37 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 13:37 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 13:37 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 13:37 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 13:37 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 13:37 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 13:37 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 13:37 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 13:37 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 13:37 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 13:37 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 13:37 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 13:37 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 13:37 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 13:37 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 13:37 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.SlYu/README for the next steps. 13:37 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sfyne.groups] fetching groups inventory 13:37 WARNING [databricks.labs.ucx.workspace_access.groups] Group ucx-oKxr-ra78a530a7 defined in configuration does not exist on the groups table. Consider checking if the group exist in the workspace or re-running the assessment. 13:37 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sfyne.groups] crawling new set of snapshot data for groups 13:37 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ... 13:37 INFO [databricks.labs.ucx.workspace_access.groups] Found 14 WorkspaceGroup 13:37 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId... 13:37 INFO [databricks.labs.ucx.workspace_access.groups] Found 83 account groups 13:37 INFO [databricks.labs.ucx.workspace_access.groups] Group listing provided, a subset of all groups will be migrated 13:37 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sfyne.groups] found 1 new records for groups 13:37 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta ... 13:37 INFO [databricks.labs.ucx.workspace_access.groups] Found 59 Group 13:37 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ... 13:37 INFO [databricks.labs.ucx.workspace_access.groups] Found 14 WorkspaceGroup 13:37 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sfyne.groups] fetching groups inventory 13:37 INFO [databricks.labs.ucx.workspace_access.groups] Starting to rename 1 groups for migration... 13:37 DEBUG [databricks.labs.ucx.workspace_access.groups] Renaming group: ucx-oKxr-ra78a530a7 (id=169865458132965) -> rename-SlYu-ucx-oKxr-ra78a530a7 13:38 DEBUG [databricks.labs.ucx.workspace_access.groups] Group still has old name; still waiting for rename to take effect: ucx-oKxr-ra78a530a7 (id=169865458132965) -> rename-SlYu-ucx-oKxr-ra78a530a7 13:38 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename has possibly taken effect: ucx-oKxr-ra78a530a7 (id=169865458132965) -> rename-SlYu-ucx-oKxr-ra78a530a7 13:38 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename has possibly taken effect: ucx-oKxr-ra78a530a7 (id=169865458132965) -> rename-SlYu-ucx-oKxr-ra78a530a7 13:38 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename is assumed complete: ucx-oKxr-ra78a530a7 (id=169865458132965) -> rename-SlYu-ucx-oKxr-ra78a530a7 13:38 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ... 13:38 INFO [databricks.labs.ucx.workspace_access.groups] Found 73 WorkspaceGroup 13:38 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration reflects renamed group: 169865458132965 (renamed to rename-SlYu-ucx-oKxr-ra78a530a7) 13:38 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ... 13:38 INFO [databricks.labs.ucx.workspace_access.groups] Found 73 WorkspaceGroup 13:38 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration reflects renamed group: 169865458132965 (renamed to rename-SlYu-ucx-oKxr-ra78a530a7) 13:38 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration showed all 1 renamed groups; assuming complete. 13:38 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId... 13:38 INFO [databricks.labs.ucx.workspace_access.groups] Found 83 account groups 13:38 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta ... 13:38 INFO [databricks.labs.ucx.workspace_access.groups] Found 59 Group 13:38 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ... 13:38 INFO [databricks.labs.ucx.workspace_access.groups] Found 14 WorkspaceGroup 13:38 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sfyne.groups] fetching groups inventory 13:38 INFO [databricks.labs.ucx.workspace_access.groups] Starting to reflect 1 account groups into workspace for migration... 13:38 DEBUG [databricks.labs.ucx.installer.workflows] starting remove-workspace-local-backup-groups job: https://DATABRICKS_HOST#job/832982766678330 13:38 INFO [databricks.labs.ucx.installer.workflows] Started remove-workspace-local-backup-groups job: https://DATABRICKS_HOST#job/832982766678330/runs/931587442157173 13:38 DEBUG [databricks.labs.ucx.installer.workflows] Waiting for completion of remove-workspace-local-backup-groups job: https://DATABRICKS_HOST#job/832982766678330/runs/931587442157173 13:46 INFO [databricks.labs.ucx.installer.workflows] Completed remove-workspace-local-backup-groups job run 931587442157173 with state: RunResultState.SUCCESS_WITH_FAILURES (The job run succeeded with 1 failed task) 13:46 INFO [databricks.labs.ucx.installer.workflows] Completed remove-workspace-local-backup-groups job run 931587442157173 duration: 0:08:10.155000 (2024-09-18 13:38:07.601000+00:00 thru 2024-09-18 13:46:17.756000+00:00) 13:37 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-hsks-ra78a530a7@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-hsks-ra78a530a7@example.com')], entitlements=[], external_id=None, groups=[], id='4546320172229843', name=Name(family_name=None, given_name='sdk-hsks-ra78a530a7@example.com'), roles=[], schemas=[, ], user_name='sdk-hsks-ra78a530a7@example.com') 13:37 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx-oKxr-ra78a530a7: https://DATABRICKS_HOST#setting/accounts/groups/169865458132965 13:37 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx-oKxr-ra78a530a7', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='169865458132965', members=[ComplexValue(display='sdk-hsks-ra78a530a7@example.com', primary=None, ref='Users/4546320172229843', type=None, value='4546320172229843')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 13:37 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx-oKxr-ra78a530a7: https://accounts.CLOUD_ENVdatabricks.net/users/groups/146950221997294/members 13:37 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx-oKxr-ra78a530a7', entitlements=[], external_id=None, groups=[], id='146950221997294', members=[ComplexValue(display='sdk-hsks-ra78a530a7@example.com', primary=None, ref='Users/4546320172229843', type=None, value='4546320172229843')], meta=None, roles=[], schemas=[]) 13:37 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sfyne: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sfyne 13:37 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sfyne', metastore_id=None, name='ucx_sfyne', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 13:37 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.SlYu/config.yml) doesn't exist. 13:37 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 13:37 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 13:37 INFO [databricks.labs.ucx.install] Fetching installations... 13:37 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 13:37 DEBUG [tests.integration.conftest] Waiting for clusters to start... 13:37 DEBUG [tests.integration.conftest] Waiting for clusters to start... 13:37 INFO [databricks.labs.ucx.install] Installing UCX v0.36.1+2020240918133728 13:37 INFO [databricks.labs.ucx.install] Creating ucx schemas... 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 13:37 INFO [databricks.labs.ucx.install] Creating dashboards... 13:37 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 13:37 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 13:37 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 13:37 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 13:37 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 13:37 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 13:37 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 13:37 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 13:37 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 13:37 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 13:37 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 13:37 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 13:37 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 13:37 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 13:37 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 13:37 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.SlYu/README for the next steps. 13:37 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sfyne.groups] fetching groups inventory 13:37 WARNING [databricks.labs.ucx.workspace_access.groups] Group ucx-oKxr-ra78a530a7 defined in configuration does not exist on the groups table. Consider checking if the group exist in the workspace or re-running the assessment. 13:37 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sfyne.groups] crawling new set of snapshot data for groups 13:37 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ... 13:37 INFO [databricks.labs.ucx.workspace_access.groups] Found 14 WorkspaceGroup 13:37 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId... 13:37 INFO [databricks.labs.ucx.workspace_access.groups] Found 83 account groups 13:37 INFO [databricks.labs.ucx.workspace_access.groups] Group listing provided, a subset of all groups will be migrated 13:37 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sfyne.groups] found 1 new records for groups 13:37 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta ... 13:37 INFO [databricks.labs.ucx.workspace_access.groups] Found 59 Group 13:37 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ... 13:37 INFO [databricks.labs.ucx.workspace_access.groups] Found 14 WorkspaceGroup 13:37 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sfyne.groups] fetching groups inventory 13:37 INFO [databricks.labs.ucx.workspace_access.groups] Starting to rename 1 groups for migration... 13:37 DEBUG [databricks.labs.ucx.workspace_access.groups] Renaming group: ucx-oKxr-ra78a530a7 (id=169865458132965) -> rename-SlYu-ucx-oKxr-ra78a530a7 13:38 DEBUG [databricks.labs.ucx.workspace_access.groups] Group still has old name; still waiting for rename to take effect: ucx-oKxr-ra78a530a7 (id=169865458132965) -> rename-SlYu-ucx-oKxr-ra78a530a7 13:38 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename has possibly taken effect: ucx-oKxr-ra78a530a7 (id=169865458132965) -> rename-SlYu-ucx-oKxr-ra78a530a7 13:38 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename has possibly taken effect: ucx-oKxr-ra78a530a7 (id=169865458132965) -> rename-SlYu-ucx-oKxr-ra78a530a7 13:38 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename is assumed complete: ucx-oKxr-ra78a530a7 (id=169865458132965) -> rename-SlYu-ucx-oKxr-ra78a530a7 13:38 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ... 13:38 INFO [databricks.labs.ucx.workspace_access.groups] Found 73 WorkspaceGroup 13:38 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration reflects renamed group: 169865458132965 (renamed to rename-SlYu-ucx-oKxr-ra78a530a7) 13:38 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ... 13:38 INFO [databricks.labs.ucx.workspace_access.groups] Found 73 WorkspaceGroup 13:38 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration reflects renamed group: 169865458132965 (renamed to rename-SlYu-ucx-oKxr-ra78a530a7) 13:38 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration showed all 1 renamed groups; assuming complete. 13:38 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId... 13:38 INFO [databricks.labs.ucx.workspace_access.groups] Found 83 account groups 13:38 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta ... 13:38 INFO [databricks.labs.ucx.workspace_access.groups] Found 59 Group 13:38 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ... 13:38 INFO [databricks.labs.ucx.workspace_access.groups] Found 14 WorkspaceGroup 13:38 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sfyne.groups] fetching groups inventory 13:38 INFO [databricks.labs.ucx.workspace_access.groups] Starting to reflect 1 account groups into workspace for migration... 13:38 DEBUG [databricks.labs.ucx.installer.workflows] starting remove-workspace-local-backup-groups job: https://DATABRICKS_HOST#job/832982766678330 13:38 INFO [databricks.labs.ucx.installer.workflows] Started remove-workspace-local-backup-groups job: https://DATABRICKS_HOST#job/832982766678330/runs/931587442157173 13:38 DEBUG [databricks.labs.ucx.installer.workflows] Waiting for completion of remove-workspace-local-backup-groups job: https://DATABRICKS_HOST#job/832982766678330/runs/931587442157173 13:46 INFO [databricks.labs.ucx.installer.workflows] Completed remove-workspace-local-backup-groups job run 931587442157173 with state: RunResultState.SUCCESS_WITH_FAILURES (The job run succeeded with 1 failed task) 13:46 INFO [databricks.labs.ucx.installer.workflows] Completed remove-workspace-local-backup-groups job run 931587442157173 duration: 0:08:10.155000 (2024-09-18 13:38:07.601000+00:00 thru 2024-09-18 13:46:17.756000+00:00) 13:49 INFO [databricks.labs.ucx.install] Deleting UCX v0.36.1+2020240918133728 from https://DATABRICKS_HOST 13:49 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_sfyne 13:49 INFO [databricks.labs.ucx.install] Deleting jobs 13:49 INFO [databricks.labs.ucx.install] Deleting migrate-external-tables-ctas job_id=927677669240435. 13:49 INFO [databricks.labs.ucx.install] Deleting scan-tables-in-mounts-experimental job_id=1033102944758488. 13:49 INFO [databricks.labs.ucx.install] Deleting assessment job_id=231940751135126. 13:49 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=622543668909798. 13:49 INFO [databricks.labs.ucx.install] Deleting failing job_id=1091310888945442. 13:49 INFO [databricks.labs.ucx.install] Deleting migrate-data-reconciliation job_id=347963003521892. 13:49 INFO [databricks.labs.ucx.install] Deleting migrate-external-hiveserde-tables-in-place-experimental job_id=905547358063183. 13:49 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=832982766678330. 13:49 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=41639725715616. 13:49 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=909171621186913. 13:49 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=526889231845308. 13:49 INFO [databricks.labs.ucx.install] Deleting experimental-workflow-linter job_id=286911074519667. 13:49 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=653185878997275. 13:49 INFO [databricks.labs.ucx.install] Deleting cluster policy 13:49 INFO [databricks.labs.ucx.install] Deleting secret scope 13:49 INFO [databricks.labs.ucx.install] UnInstalling UCX complete 13:49 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace user fixtures 13:49 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='sdk-hsks-ra78a530a7@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-hsks-ra78a530a7@example.com')], entitlements=[], external_id=None, groups=[], id='4546320172229843', name=Name(family_name=None, given_name='sdk-hsks-ra78a530a7@example.com'), roles=[], schemas=[, ], user_name='sdk-hsks-ra78a530a7@example.com') 13:49 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 account group fixtures 13:49 DEBUG [databricks.labs.ucx.mixins.fixtures] removing account group fixture: Group(display_name='ucx-oKxr-ra78a530a7', entitlements=[], external_id=None, groups=[], id='146950221997294', members=[ComplexValue(display='sdk-hsks-ra78a530a7@example.com', primary=None, ref='Users/4546320172229843', type=None, value='4546320172229843')], meta=None, roles=[], schemas=[]) 13:49 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace group fixtures 13:49 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace group fixture: Group(display_name='ucx-oKxr-ra78a530a7', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='169865458132965', members=[ComplexValue(display='sdk-hsks-ra78a530a7@example.com', primary=None, ref='Users/4546320172229843', type=None, value='4546320172229843')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 13:49 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 13:49 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 13:49 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 schema fixtures 13:49 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sfyne', metastore_id=None, name='ucx_sfyne', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw4] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```

❌ test_running_real_assessment_job_ext_hms: TimeoutError: timed out after 0:20:00: current status: CommandStatus.RUNNING (32m52.687s)

``` TimeoutError: timed out after 0:20:00: current status: CommandStatus.RUNNING databricks.sdk.errors.platform.InternalError: UnexpectedHttpException: Got invalid response: 404 /ERR_NGROK_3200 [gw6] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 13:37 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-zgf8-ra78a530a7@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-zgf8-ra78a530a7@example.com')], entitlements=[], external_id=None, groups=[], id='3052776869284346', name=Name(family_name=None, given_name='sdk-zgf8-ra78a530a7@example.com'), roles=[], schemas=[, ], user_name='sdk-zgf8-ra78a530a7@example.com') 13:37 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx-t0FH-ra78a530a7: https://DATABRICKS_HOST#setting/accounts/groups/970993613309924 13:37 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx-t0FH-ra78a530a7', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='970993613309924', members=[ComplexValue(display='sdk-zgf8-ra78a530a7@example.com', primary=None, ref='Users/3052776869284346', type=None, value='3052776869284346')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 13:37 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx-t0FH-ra78a530a7: https://accounts.CLOUD_ENVdatabricks.net/users/groups/388325374949604/members 13:37 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx-t0FH-ra78a530a7', entitlements=[], external_id=None, groups=[], id='388325374949604', members=[ComplexValue(display='sdk-zgf8-ra78a530a7@example.com', primary=None, ref='Users/3052776869284346', type=None, value='3052776869284346')], meta=None, roles=[], schemas=[]) 13:37 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/0012127EE03CB1FE 13:37 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='0012127EE03CB1FE') 13:37 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 0012127EE03CB1FE [group_name admins CAN_USE] -> [group_name ucx-t0FH-ra78a530a7 CAN_USE] 13:37 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s2mpx: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s2mpx 13:37 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s2mpx', metastore_id=None, name='ucx_s2mpx', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 13:37 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.IUBW/config.yml) doesn't exist. 13:37 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 13:37 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 13:37 INFO [databricks.labs.ucx.install] Fetching installations... 13:37 INFO [databricks.labs.ucx.installer.policy] Setting up an external metastore 13:37 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 13:37 DEBUG [tests.integration.conftest] Waiting for clusters to start... 13:37 DEBUG [tests.integration.conftest] Waiting for clusters to start... 13:37 INFO [databricks.labs.ucx.install] Installing UCX v0.36.1+2020240918133716 13:37 INFO [databricks.labs.ucx.install] Creating ucx schemas... 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 13:57 ERROR [databricks.labs.blueprint.parallel] installing components task failed: timed out after 0:20:00: current status: CommandStatus.RUNNING Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 516, in _create_database_and_dashboards self._create_database() # Need the database before creating the dashboards File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 544, in _create_database raise err File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 523, in _create_database deploy_schema(self._sql_backend, self._config.inventory_database) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 98, in deploy_schema deployer.deploy_schema() File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/deployment.py", line 18, in deploy_schema self._sql_backend.execute(f"CREATE SCHEMA IF NOT EXISTS hive_metastore.{self._inventory_schema}") File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 221, in execute self._sql.run(sql) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/commands.py", line 113, in run ).result() File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/_internal.py", line 67, in result return self._waiter(callback=callback, timeout=timeout, **kwargs) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/compute.py", line 7849, in wait_command_status_command_execution_finished_or_error raise TimeoutError(f'timed out after {timeout}: {status_message}') TimeoutError: timed out after 0:20:00: current status: CommandStatus.RUNNING 13:57 ERROR [databricks.labs.blueprint.parallel] More than half 'installing components' tasks failed: 0% results available (0/2). Took 0:20:17.256472 13:37 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-zgf8-ra78a530a7@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-zgf8-ra78a530a7@example.com')], entitlements=[], external_id=None, groups=[], id='3052776869284346', name=Name(family_name=None, given_name='sdk-zgf8-ra78a530a7@example.com'), roles=[], schemas=[, ], user_name='sdk-zgf8-ra78a530a7@example.com') 13:37 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx-t0FH-ra78a530a7: https://DATABRICKS_HOST#setting/accounts/groups/970993613309924 13:37 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx-t0FH-ra78a530a7', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='970993613309924', members=[ComplexValue(display='sdk-zgf8-ra78a530a7@example.com', primary=None, ref='Users/3052776869284346', type=None, value='3052776869284346')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 13:37 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx-t0FH-ra78a530a7: https://accounts.CLOUD_ENVdatabricks.net/users/groups/388325374949604/members 13:37 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx-t0FH-ra78a530a7', entitlements=[], external_id=None, groups=[], id='388325374949604', members=[ComplexValue(display='sdk-zgf8-ra78a530a7@example.com', primary=None, ref='Users/3052776869284346', type=None, value='3052776869284346')], meta=None, roles=[], schemas=[]) 13:37 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/0012127EE03CB1FE 13:37 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='0012127EE03CB1FE') 13:37 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 0012127EE03CB1FE [group_name admins CAN_USE] -> [group_name ucx-t0FH-ra78a530a7 CAN_USE] 13:37 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s2mpx: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s2mpx 13:37 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s2mpx', metastore_id=None, name='ucx_s2mpx', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 13:37 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.IUBW/config.yml) doesn't exist. 13:37 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 13:37 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 13:37 INFO [databricks.labs.ucx.install] Fetching installations... 13:37 INFO [databricks.labs.ucx.installer.policy] Setting up an external metastore 13:37 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 13:37 DEBUG [tests.integration.conftest] Waiting for clusters to start... 13:37 DEBUG [tests.integration.conftest] Waiting for clusters to start... 13:37 INFO [databricks.labs.ucx.install] Installing UCX v0.36.1+2020240918133716 13:37 INFO [databricks.labs.ucx.install] Creating ucx schemas... 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 13:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 13:57 ERROR [databricks.labs.blueprint.parallel] installing components task failed: timed out after 0:20:00: current status: CommandStatus.RUNNING Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 516, in _create_database_and_dashboards self._create_database() # Need the database before creating the dashboards File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 544, in _create_database raise err File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 523, in _create_database deploy_schema(self._sql_backend, self._config.inventory_database) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 98, in deploy_schema deployer.deploy_schema() File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/deployment.py", line 18, in deploy_schema self._sql_backend.execute(f"CREATE SCHEMA IF NOT EXISTS hive_metastore.{self._inventory_schema}") File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/backends.py", line 221, in execute self._sql.run(sql) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/commands.py", line 113, in run ).result() File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/_internal.py", line 67, in result return self._waiter(callback=callback, timeout=timeout, **kwargs) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/compute.py", line 7849, in wait_command_status_command_execution_finished_or_error raise TimeoutError(f'timed out after {timeout}: {status_message}') TimeoutError: timed out after 0:20:00: current status: CommandStatus.RUNNING 13:57 ERROR [databricks.labs.blueprint.parallel] More than half 'installing components' tasks failed: 0% results available (0/2). Took 0:20:17.256472 13:57 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster_policy permissions fixtures 13:57 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster_policy permissions fixture: 0012127EE03CB1FE [group_name admins CAN_USE] -> [group_name ucx-t0FH-ra78a530a7 CAN_USE] 13:57 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster policy fixtures 13:57 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster policy fixture: CreatePolicyResponse(policy_id='0012127EE03CB1FE') 13:57 INFO [databricks.labs.ucx.install] Deleting UCX v0.36.1+2020240918133716 from https://DATABRICKS_HOST 13:57 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_s2mpx 14:09 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace user fixtures 14:09 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='sdk-zgf8-ra78a530a7@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-zgf8-ra78a530a7@example.com')], entitlements=[], external_id=None, groups=[], id='3052776869284346', name=Name(family_name=None, given_name='sdk-zgf8-ra78a530a7@example.com'), roles=[], schemas=[, ], user_name='sdk-zgf8-ra78a530a7@example.com') 14:09 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 account group fixtures 14:09 DEBUG [databricks.labs.ucx.mixins.fixtures] removing account group fixture: Group(display_name='ucx-t0FH-ra78a530a7', entitlements=[], external_id=None, groups=[], id='388325374949604', members=[ComplexValue(display='sdk-zgf8-ra78a530a7@example.com', primary=None, ref='Users/3052776869284346', type=None, value='3052776869284346')], meta=None, roles=[], schemas=[]) 14:09 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace group fixtures 14:09 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace group fixture: Group(display_name='ucx-t0FH-ra78a530a7', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='970993613309924', members=[ComplexValue(display='sdk-zgf8-ra78a530a7@example.com', primary=None, ref='Users/3052776869284346', type=None, value='3052776869284346')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 14:09 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 14:09 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 14:09 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 schema fixtures 14:09 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s2mpx', metastore_id=None, name='ucx_s2mpx', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) ```

Flaky tests:

🤪 test_repair_run_workflow_job (9m7.24s)

_{Running from acceptance #5922}

databrickslabs / ucx

Update `assessment` workflow documentation to cover the `crawl_udfs` task. #2665

Changes

Linked issues

Functionality