Test failure: `test_running_real_remove_backup_groups_job`

[github-actions[bot]]

❌ test_running_real_remove_backup_groups_job: TimeoutError: Timed out after 0:05:00 (6m58.085s)

``` TimeoutError: Timed out after 0:05:00 [gw7] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python 05:42 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.ckwL/config.yml) doesn't exist. 05:42 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:42 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:42 INFO [databricks.labs.ucx.install] Fetching installations... 05:43 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:43 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:43 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:43 INFO [databricks.labs.ucx.install] Installing UCX v0.48.1+420241104054302 05:43 INFO [databricks.labs.ucx.install] Creating ucx schemas... 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 05:43 INFO [databricks.labs.ucx.install] Creating dashboards... 05:43 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 05:43 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 05:43 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 05:43 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress... 05:43 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:43 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:43 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:43 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:43 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 05:43 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:43 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main... 05:43 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:43 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:43 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:43 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:43 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:43 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:43 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:43 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.ckwL/README for the next steps. 05:43 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sgwkh.groups] fetching groups inventory 05:43 WARNING [databricks.labs.ucx.workspace_access.groups] Group ucx-DqQo-ra78a57947 defined in configuration does not exist on the groups table. Consider checking if the group exist in the workspace or re-running the assessment. 05:43 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sgwkh.groups] crawling new set of snapshot data for groups 05:43 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ... 05:43 INFO [databricks.labs.ucx.workspace_access.groups] Found 2 WorkspaceGroup 05:43 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId... 05:43 INFO [databricks.labs.ucx.workspace_access.groups] Found 70 account groups 05:43 INFO [databricks.labs.ucx.workspace_access.groups] Group listing provided, a subset of all groups will be migrated 05:43 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sgwkh.groups] found 1 new records for groups 05:43 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta ... 05:43 INFO [databricks.labs.ucx.workspace_access.groups] Found 57 Group 05:43 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ... 05:43 INFO [databricks.labs.ucx.workspace_access.groups] Found 2 WorkspaceGroup 05:43 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sgwkh.groups] fetching groups inventory 05:43 INFO [databricks.labs.ucx.workspace_access.groups] Starting to rename 1 groups for migration... 05:43 DEBUG [databricks.labs.ucx.workspace_access.groups] Renaming group: ucx-DqQo-ra78a57947 (id=748863602065961) -> rename-ckwL-ucx-DqQo-ra78a57947 05:43 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename has possibly taken effect: ucx-DqQo-ra78a57947 (id=748863602065961) -> rename-ckwL-ucx-DqQo-ra78a57947 05:43 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename has possibly taken effect: ucx-DqQo-ra78a57947 (id=748863602065961) -> rename-ckwL-ucx-DqQo-ra78a57947 05:43 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename is assumed complete: ucx-DqQo-ra78a57947 (id=748863602065961) -> rename-ckwL-ucx-DqQo-ra78a57947 05:43 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ... 05:43 INFO [databricks.labs.ucx.workspace_access.groups] Found 59 WorkspaceGroup 05:43 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration reflects renamed group: 748863602065961 (renamed to rename-ckwL-ucx-DqQo-ra78a57947) 05:43 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ... 05:43 INFO [databricks.labs.ucx.workspace_access.groups] Found 59 WorkspaceGroup 05:43 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration reflects renamed group: 748863602065961 (renamed to rename-ckwL-ucx-DqQo-ra78a57947) 05:43 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration showed all 1 renamed groups; assuming complete. 05:43 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId... 05:43 INFO [databricks.labs.ucx.workspace_access.groups] Found 70 account groups 05:43 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta ... 05:43 INFO [databricks.labs.ucx.workspace_access.groups] Found 57 Group 05:43 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ... 05:43 INFO [databricks.labs.ucx.workspace_access.groups] Found 2 WorkspaceGroup 05:43 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sgwkh.groups] fetching groups inventory 05:43 INFO [databricks.labs.ucx.workspace_access.groups] Starting to reflect 1 account groups into workspace for migration... 05:43 ERROR [databricks.labs.ucx.workspace_access.groups] Skipping ucx-DqQo-ra78a57947: group already exists in workspace 05:43 DEBUG [databricks.labs.ucx.installer.workflows] starting remove-workspace-local-backup-groups job: https://DATABRICKS_HOST#job/161237363180921 05:43 INFO [databricks.labs.ucx.installer.workflows] Started remove-workspace-local-backup-groups job: https://DATABRICKS_HOST#job/161237363180921/runs/200472481485304 05:43 DEBUG [databricks.labs.ucx.installer.workflows] Waiting for completion of remove-workspace-local-backup-groups job: https://DATABRICKS_HOST#job/161237363180921/runs/200472481485304 05:44 INFO [databricks.labs.ucx.installer.workflows] Completed remove-workspace-local-backup-groups job run 200472481485304 with state: RunResultState.SUCCESS 05:44 INFO [databricks.labs.ucx.installer.workflows] Completed remove-workspace-local-backup-groups job run 200472481485304 duration: 0:00:54.861000 (2024-11-04 05:43:26.075000+00:00 thru 2024-11-04 05:44:20.936000+00:00) 05:44 DEBUG [databricks.labs.ucx.installer.workflows] Validating remove-workspace-local-backup-groups workflow: https://DATABRICKS_HOST#job/161237363180921 05:42 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.ckwL/config.yml) doesn't exist. 05:42 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:42 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:42 INFO [databricks.labs.ucx.install] Fetching installations... 05:43 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:43 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:43 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:43 INFO [databricks.labs.ucx.install] Installing UCX v0.48.1+420241104054302 05:43 INFO [databricks.labs.ucx.install] Creating ucx schemas... 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 05:43 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 05:43 INFO [databricks.labs.ucx.install] Creating dashboards... 05:43 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 05:43 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 05:43 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 05:43 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress... 05:43 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:43 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:43 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:43 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:43 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 05:43 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:43 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main... 05:43 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:43 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:43 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:43 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:43 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:43 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:43 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:43 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.ckwL/README for the next steps. 05:43 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sgwkh.groups] fetching groups inventory 05:43 WARNING [databricks.labs.ucx.workspace_access.groups] Group ucx-DqQo-ra78a57947 defined in configuration does not exist on the groups table. Consider checking if the group exist in the workspace or re-running the assessment. 05:43 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sgwkh.groups] crawling new set of snapshot data for groups 05:43 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ... 05:43 INFO [databricks.labs.ucx.workspace_access.groups] Found 2 WorkspaceGroup 05:43 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId... 05:43 INFO [databricks.labs.ucx.workspace_access.groups] Found 70 account groups 05:43 INFO [databricks.labs.ucx.workspace_access.groups] Group listing provided, a subset of all groups will be migrated 05:43 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sgwkh.groups] found 1 new records for groups 05:43 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta ... 05:43 INFO [databricks.labs.ucx.workspace_access.groups] Found 57 Group 05:43 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ... 05:43 INFO [databricks.labs.ucx.workspace_access.groups] Found 2 WorkspaceGroup 05:43 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sgwkh.groups] fetching groups inventory 05:43 INFO [databricks.labs.ucx.workspace_access.groups] Starting to rename 1 groups for migration... 05:43 DEBUG [databricks.labs.ucx.workspace_access.groups] Renaming group: ucx-DqQo-ra78a57947 (id=748863602065961) -> rename-ckwL-ucx-DqQo-ra78a57947 05:43 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename has possibly taken effect: ucx-DqQo-ra78a57947 (id=748863602065961) -> rename-ckwL-ucx-DqQo-ra78a57947 05:43 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename has possibly taken effect: ucx-DqQo-ra78a57947 (id=748863602065961) -> rename-ckwL-ucx-DqQo-ra78a57947 05:43 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename is assumed complete: ucx-DqQo-ra78a57947 (id=748863602065961) -> rename-ckwL-ucx-DqQo-ra78a57947 05:43 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ... 05:43 INFO [databricks.labs.ucx.workspace_access.groups] Found 59 WorkspaceGroup 05:43 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration reflects renamed group: 748863602065961 (renamed to rename-ckwL-ucx-DqQo-ra78a57947) 05:43 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ... 05:43 INFO [databricks.labs.ucx.workspace_access.groups] Found 59 WorkspaceGroup 05:43 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration reflects renamed group: 748863602065961 (renamed to rename-ckwL-ucx-DqQo-ra78a57947) 05:43 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration showed all 1 renamed groups; assuming complete. 05:43 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId... 05:43 INFO [databricks.labs.ucx.workspace_access.groups] Found 70 account groups 05:43 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta ... 05:43 INFO [databricks.labs.ucx.workspace_access.groups] Found 57 Group 05:43 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ... 05:43 INFO [databricks.labs.ucx.workspace_access.groups] Found 2 WorkspaceGroup 05:43 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sgwkh.groups] fetching groups inventory 05:43 INFO [databricks.labs.ucx.workspace_access.groups] Starting to reflect 1 account groups into workspace for migration... 05:43 ERROR [databricks.labs.ucx.workspace_access.groups] Skipping ucx-DqQo-ra78a57947: group already exists in workspace 05:43 DEBUG [databricks.labs.ucx.installer.workflows] starting remove-workspace-local-backup-groups job: https://DATABRICKS_HOST#job/161237363180921 05:43 INFO [databricks.labs.ucx.installer.workflows] Started remove-workspace-local-backup-groups job: https://DATABRICKS_HOST#job/161237363180921/runs/200472481485304 05:43 DEBUG [databricks.labs.ucx.installer.workflows] Waiting for completion of remove-workspace-local-backup-groups job: https://DATABRICKS_HOST#job/161237363180921/runs/200472481485304 05:44 INFO [databricks.labs.ucx.installer.workflows] Completed remove-workspace-local-backup-groups job run 200472481485304 with state: RunResultState.SUCCESS 05:44 INFO [databricks.labs.ucx.installer.workflows] Completed remove-workspace-local-backup-groups job run 200472481485304 duration: 0:00:54.861000 (2024-11-04 05:43:26.075000+00:00 thru 2024-11-04 05:44:20.936000+00:00) 05:44 DEBUG [databricks.labs.ucx.installer.workflows] Validating remove-workspace-local-backup-groups workflow: https://DATABRICKS_HOST#job/161237363180921 05:49 INFO [databricks.labs.ucx.install] Deleting UCX v0.48.1+420241104054302 from https://DATABRICKS_HOST 05:49 INFO [databricks.labs.ucx.install] Deleting inventory database dummy_sgwkh 05:49 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=173814981235146, as it is no longer needed 05:49 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=161237363180921, as it is no longer needed 05:49 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=847236409381343, as it is no longer needed 05:49 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1072383126996521, as it is no longer needed 05:49 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=943153682297607, as it is no longer needed 05:49 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=961637706804386, as it is no longer needed 05:49 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=219566744412718, as it is no longer needed 05:49 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1039847198016085, as it is no longer needed 05:49 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=576798742873666, as it is no longer needed 05:49 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=752662833170630, as it is no longer needed 05:49 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=580275168913689, as it is no longer needed 05:49 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=713254282939475, as it is no longer needed 05:49 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1044052756129261, as it is no longer needed 05:49 INFO [databricks.labs.ucx.install] Deleting cluster policy 05:49 INFO [databricks.labs.ucx.install] Deleting secret scope 05:49 INFO [databricks.labs.ucx.install] UnInstalling UCX complete [gw7] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python ```

_{Running from nightly #250}

[github-actions[bot]]

❌ test_running_real_remove_backup_groups_job: TimeoutError: Timed out after 0:05:00 (7m41.143s)

``` TimeoutError: Timed out after 0:05:00 [gw5] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python 05:35 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.PXGi/config.yml) doesn't exist. 05:35 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:35 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:35 INFO [databricks.labs.ucx.install] Fetching installations... 05:36 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:36 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:36 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:36 INFO [databricks.labs.ucx.install] Installing UCX v0.48.1+1320241107053607 05:36 INFO [databricks.labs.ucx.install] Creating ucx schemas... 05:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental 05:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 05:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 05:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 05:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 05:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 05:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 05:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 05:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 05:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 05:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 05:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 05:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 05:36 INFO [databricks.labs.ucx.install] Creating dashboards... 05:36 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 05:36 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 05:36 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 05:36 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress... 05:36 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:36 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:36 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:36 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:36 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 05:36 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:36 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main... 05:36 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:36 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:36 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:36 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:36 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:36 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:36 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:36 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.PXGi/README for the next steps. 05:36 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s08wl.groups] fetching groups inventory 05:36 WARNING [databricks.labs.ucx.workspace_access.groups] Group ucx-YAPQ-ra78a57a73 defined in configuration does not exist on the groups table. Consider checking if the group exist in the workspace or re-running the assessment. 05:36 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s08wl.groups] crawling new set of snapshot data for groups 05:36 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ... 05:36 INFO [databricks.labs.ucx.workspace_access.groups] Found 5 WorkspaceGroup 05:36 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId... 05:36 INFO [databricks.labs.ucx.workspace_access.groups] Found 71 account groups 05:36 INFO [databricks.labs.ucx.workspace_access.groups] Group listing provided, a subset of all groups will be migrated 05:36 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s08wl.groups] found 1 new records for groups 05:36 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta ... 05:36 INFO [databricks.labs.ucx.workspace_access.groups] Found 58 Group 05:36 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ... 05:36 INFO [databricks.labs.ucx.workspace_access.groups] Found 5 WorkspaceGroup 05:36 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s08wl.groups] fetching groups inventory 05:36 INFO [databricks.labs.ucx.workspace_access.groups] Starting to rename 1 groups for migration... 05:36 DEBUG [databricks.labs.ucx.workspace_access.groups] Renaming group: ucx-YAPQ-ra78a57a73 (id=254220250978790) -> rename-PXGi-ucx-YAPQ-ra78a57a73 05:36 DEBUG [databricks.labs.ucx.workspace_access.groups] Group still has old name; still waiting for rename to take effect: ucx-YAPQ-ra78a57a73 (id=254220250978790) -> rename-PXGi-ucx-YAPQ-ra78a57a73 05:36 DEBUG [databricks.labs.ucx.workspace_access.groups] Group still has old name; still waiting for rename to take effect: ucx-YAPQ-ra78a57a73 (id=254220250978790) -> rename-PXGi-ucx-YAPQ-ra78a57a73 05:36 DEBUG [databricks.labs.ucx.workspace_access.groups] Group still has old name; still waiting for rename to take effect: ucx-YAPQ-ra78a57a73 (id=254220250978790) -> rename-PXGi-ucx-YAPQ-ra78a57a73 05:36 DEBUG [databricks.labs.ucx.workspace_access.groups] Group still has old name; still waiting for rename to take effect: ucx-YAPQ-ra78a57a73 (id=254220250978790) -> rename-PXGi-ucx-YAPQ-ra78a57a73 05:36 DEBUG [databricks.labs.ucx.workspace_access.groups] Group still has old name; still waiting for rename to take effect: ucx-YAPQ-ra78a57a73 (id=254220250978790) -> rename-PXGi-ucx-YAPQ-ra78a57a73 05:36 DEBUG [databricks.labs.ucx.workspace_access.groups] Group still has old name; still waiting for rename to take effect: ucx-YAPQ-ra78a57a73 (id=254220250978790) -> rename-PXGi-ucx-YAPQ-ra78a57a73 05:36 DEBUG [databricks.labs.ucx.workspace_access.groups] Group still has old name; still waiting for rename to take effect: ucx-YAPQ-ra78a57a73 (id=254220250978790) -> rename-PXGi-ucx-YAPQ-ra78a57a73 05:37 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename has possibly taken effect: ucx-YAPQ-ra78a57a73 (id=254220250978790) -> rename-PXGi-ucx-YAPQ-ra78a57a73 05:37 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename has possibly taken effect: ucx-YAPQ-ra78a57a73 (id=254220250978790) -> rename-PXGi-ucx-YAPQ-ra78a57a73 05:37 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename is assumed complete: ucx-YAPQ-ra78a57a73 (id=254220250978790) -> rename-PXGi-ucx-YAPQ-ra78a57a73 05:37 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ... 05:37 INFO [databricks.labs.ucx.workspace_access.groups] Found 63 WorkspaceGroup 05:37 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration reflects renamed group: 254220250978790 (renamed to rename-PXGi-ucx-YAPQ-ra78a57a73) 05:37 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ... 05:37 INFO [databricks.labs.ucx.workspace_access.groups] Found 63 WorkspaceGroup 05:37 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration reflects renamed group: 254220250978790 (renamed to rename-PXGi-ucx-YAPQ-ra78a57a73) 05:37 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration showed all 1 renamed groups; assuming complete. 05:37 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId... 05:37 INFO [databricks.labs.ucx.workspace_access.groups] Found 71 account groups 05:37 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta ... 05:37 INFO [databricks.labs.ucx.workspace_access.groups] Found 58 Group 05:37 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ... 05:37 INFO [databricks.labs.ucx.workspace_access.groups] Found 5 WorkspaceGroup 05:37 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s08wl.groups] fetching groups inventory 05:37 INFO [databricks.labs.ucx.workspace_access.groups] Starting to reflect 1 account groups into workspace for migration... 05:37 ERROR [databricks.labs.ucx.workspace_access.groups] Skipping ucx-YAPQ-ra78a57a73: group already exists in workspace 05:37 DEBUG [databricks.labs.ucx.installer.workflows] starting remove-workspace-local-backup-groups job: https://DATABRICKS_HOST#job/79343116660040 05:37 INFO [databricks.labs.ucx.installer.workflows] Started remove-workspace-local-backup-groups job: https://DATABRICKS_HOST#job/79343116660040/runs/33554402865138 05:37 DEBUG [databricks.labs.ucx.installer.workflows] Waiting for completion of remove-workspace-local-backup-groups job: https://DATABRICKS_HOST#job/79343116660040/runs/33554402865138 05:38 INFO [databricks.labs.ucx.installer.workflows] Completed remove-workspace-local-backup-groups job run 33554402865138 with state: RunResultState.SUCCESS 05:38 INFO [databricks.labs.ucx.installer.workflows] Completed remove-workspace-local-backup-groups job run 33554402865138 duration: 0:00:59.955000 (2024-11-07 05:37:06.600000+00:00 thru 2024-11-07 05:38:06.555000+00:00) 05:38 DEBUG [databricks.labs.ucx.installer.workflows] Validating remove-workspace-local-backup-groups workflow: https://DATABRICKS_HOST#job/79343116660040 05:35 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.PXGi/config.yml) doesn't exist. 05:35 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:35 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:35 INFO [databricks.labs.ucx.install] Fetching installations... 05:36 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:36 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:36 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:36 INFO [databricks.labs.ucx.install] Installing UCX v0.48.1+1320241107053607 05:36 INFO [databricks.labs.ucx.install] Creating ucx schemas... 05:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental 05:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 05:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 05:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 05:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 05:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 05:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 05:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 05:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 05:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 05:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 05:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 05:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 05:36 INFO [databricks.labs.ucx.install] Creating dashboards... 05:36 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 05:36 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 05:36 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 05:36 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress... 05:36 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:36 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:36 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:36 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:36 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 05:36 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:36 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main... 05:36 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:36 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:36 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:36 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:36 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:36 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:36 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:36 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.PXGi/README for the next steps. 05:36 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s08wl.groups] fetching groups inventory 05:36 WARNING [databricks.labs.ucx.workspace_access.groups] Group ucx-YAPQ-ra78a57a73 defined in configuration does not exist on the groups table. Consider checking if the group exist in the workspace or re-running the assessment. 05:36 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s08wl.groups] crawling new set of snapshot data for groups 05:36 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ... 05:36 INFO [databricks.labs.ucx.workspace_access.groups] Found 5 WorkspaceGroup 05:36 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId... 05:36 INFO [databricks.labs.ucx.workspace_access.groups] Found 71 account groups 05:36 INFO [databricks.labs.ucx.workspace_access.groups] Group listing provided, a subset of all groups will be migrated 05:36 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s08wl.groups] found 1 new records for groups 05:36 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta ... 05:36 INFO [databricks.labs.ucx.workspace_access.groups] Found 58 Group 05:36 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ... 05:36 INFO [databricks.labs.ucx.workspace_access.groups] Found 5 WorkspaceGroup 05:36 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s08wl.groups] fetching groups inventory 05:36 INFO [databricks.labs.ucx.workspace_access.groups] Starting to rename 1 groups for migration... 05:36 DEBUG [databricks.labs.ucx.workspace_access.groups] Renaming group: ucx-YAPQ-ra78a57a73 (id=254220250978790) -> rename-PXGi-ucx-YAPQ-ra78a57a73 05:36 DEBUG [databricks.labs.ucx.workspace_access.groups] Group still has old name; still waiting for rename to take effect: ucx-YAPQ-ra78a57a73 (id=254220250978790) -> rename-PXGi-ucx-YAPQ-ra78a57a73 05:36 DEBUG [databricks.labs.ucx.workspace_access.groups] Group still has old name; still waiting for rename to take effect: ucx-YAPQ-ra78a57a73 (id=254220250978790) -> rename-PXGi-ucx-YAPQ-ra78a57a73 05:36 DEBUG [databricks.labs.ucx.workspace_access.groups] Group still has old name; still waiting for rename to take effect: ucx-YAPQ-ra78a57a73 (id=254220250978790) -> rename-PXGi-ucx-YAPQ-ra78a57a73 05:36 DEBUG [databricks.labs.ucx.workspace_access.groups] Group still has old name; still waiting for rename to take effect: ucx-YAPQ-ra78a57a73 (id=254220250978790) -> rename-PXGi-ucx-YAPQ-ra78a57a73 05:36 DEBUG [databricks.labs.ucx.workspace_access.groups] Group still has old name; still waiting for rename to take effect: ucx-YAPQ-ra78a57a73 (id=254220250978790) -> rename-PXGi-ucx-YAPQ-ra78a57a73 05:36 DEBUG [databricks.labs.ucx.workspace_access.groups] Group still has old name; still waiting for rename to take effect: ucx-YAPQ-ra78a57a73 (id=254220250978790) -> rename-PXGi-ucx-YAPQ-ra78a57a73 05:36 DEBUG [databricks.labs.ucx.workspace_access.groups] Group still has old name; still waiting for rename to take effect: ucx-YAPQ-ra78a57a73 (id=254220250978790) -> rename-PXGi-ucx-YAPQ-ra78a57a73 05:37 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename has possibly taken effect: ucx-YAPQ-ra78a57a73 (id=254220250978790) -> rename-PXGi-ucx-YAPQ-ra78a57a73 05:37 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename has possibly taken effect: ucx-YAPQ-ra78a57a73 (id=254220250978790) -> rename-PXGi-ucx-YAPQ-ra78a57a73 05:37 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename is assumed complete: ucx-YAPQ-ra78a57a73 (id=254220250978790) -> rename-PXGi-ucx-YAPQ-ra78a57a73 05:37 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ... 05:37 INFO [databricks.labs.ucx.workspace_access.groups] Found 63 WorkspaceGroup 05:37 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration reflects renamed group: 254220250978790 (renamed to rename-PXGi-ucx-YAPQ-ra78a57a73) 05:37 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ... 05:37 INFO [databricks.labs.ucx.workspace_access.groups] Found 63 WorkspaceGroup 05:37 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration reflects renamed group: 254220250978790 (renamed to rename-PXGi-ucx-YAPQ-ra78a57a73) 05:37 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration showed all 1 renamed groups; assuming complete. 05:37 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId... 05:37 INFO [databricks.labs.ucx.workspace_access.groups] Found 71 account groups 05:37 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta ... 05:37 INFO [databricks.labs.ucx.workspace_access.groups] Found 58 Group 05:37 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ... 05:37 INFO [databricks.labs.ucx.workspace_access.groups] Found 5 WorkspaceGroup 05:37 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_s08wl.groups] fetching groups inventory 05:37 INFO [databricks.labs.ucx.workspace_access.groups] Starting to reflect 1 account groups into workspace for migration... 05:37 ERROR [databricks.labs.ucx.workspace_access.groups] Skipping ucx-YAPQ-ra78a57a73: group already exists in workspace 05:37 DEBUG [databricks.labs.ucx.installer.workflows] starting remove-workspace-local-backup-groups job: https://DATABRICKS_HOST#job/79343116660040 05:37 INFO [databricks.labs.ucx.installer.workflows] Started remove-workspace-local-backup-groups job: https://DATABRICKS_HOST#job/79343116660040/runs/33554402865138 05:37 DEBUG [databricks.labs.ucx.installer.workflows] Waiting for completion of remove-workspace-local-backup-groups job: https://DATABRICKS_HOST#job/79343116660040/runs/33554402865138 05:38 INFO [databricks.labs.ucx.installer.workflows] Completed remove-workspace-local-backup-groups job run 33554402865138 with state: RunResultState.SUCCESS 05:38 INFO [databricks.labs.ucx.installer.workflows] Completed remove-workspace-local-backup-groups job run 33554402865138 duration: 0:00:59.955000 (2024-11-07 05:37:06.600000+00:00 thru 2024-11-07 05:38:06.555000+00:00) 05:38 DEBUG [databricks.labs.ucx.installer.workflows] Validating remove-workspace-local-backup-groups workflow: https://DATABRICKS_HOST#job/79343116660040 05:43 INFO [databricks.labs.ucx.install] Deleting UCX v0.48.1+1320241107053607 from https://DATABRICKS_HOST 05:43 INFO [databricks.labs.ucx.install] Deleting inventory database dummy_s08wl 05:43 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=883004135486379, as it is no longer needed 05:43 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=409043526553491, as it is no longer needed 05:43 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=79343116660040, as it is no longer needed 05:43 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=567724917449771, as it is no longer needed 05:43 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=972356788004854, as it is no longer needed 05:43 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1035634235661663, as it is no longer needed 05:43 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=827503119667618, as it is no longer needed 05:43 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=362697427001936, as it is no longer needed 05:43 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=789533415751934, as it is no longer needed 05:43 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=447320374306214, as it is no longer needed 05:43 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1079883612713701, as it is no longer needed 05:43 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=860257161397723, as it is no longer needed 05:43 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=239029601269509, as it is no longer needed 05:43 INFO [databricks.labs.ucx.install] Deleting cluster policy 05:43 INFO [databricks.labs.ucx.install] Deleting secret scope 05:43 INFO [databricks.labs.ucx.install] UnInstalling UCX complete [gw5] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python ```

_{Running from nightly #259}

[github-actions[bot]]

❌ test_running_real_remove_backup_groups_job: databricks.labs.blueprint.parallel.ManyError: Detected 7 failures: TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' (41.167s)

``` databricks.labs.blueprint.parallel.ManyError: Detected 7 failures: TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' [gw1] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python 15:59 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Rlo7/config.yml) doesn't exist. 15:59 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 15:59 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 15:59 INFO [databricks.labs.ucx.install] Fetching installations... 15:59 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 15:59 DEBUG [tests.integration.conftest] Waiting for clusters to start... 15:59 DEBUG [tests.integration.conftest] Waiting for clusters to start... 15:59 INFO [databricks.labs.ucx.install] Installing UCX v0.49.1+1420241114155918 15:59 INFO [databricks.labs.ucx.install] Creating ucx schemas... 15:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 15:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy 15:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 15:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 15:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 15:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 15:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 15:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 15:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 15:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental 15:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 15:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 15:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 15:59 INFO [databricks.labs.ucx.install] Creating dashboards... 15:59 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 15:59 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 15:59 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 15:59 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress... 15:59 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 15:59 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 15:59 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 15:59 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 15:59 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 15:59 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 15:59 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main... 15:59 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 15:59 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Rlo7/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 15:59 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 15:59 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Rlo7/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 15:59 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 15:59 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Rlo7/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 15:59 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 15:59 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Rlo7/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 15:59 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 15:59 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Rlo7/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 15:59 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 15:59 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Rlo7/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 15:59 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 15:59 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Rlo7/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 15:59 CRITICAL [databricks.labs.blueprint.parallel] All 'installing dashboards' tasks failed!!! 15:59 ERROR [databricks.labs.blueprint.parallel] installing components task failed: Detected 7 failures: TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 540, in _create_database_and_dashboards Threads.strict("installing dashboards", list(self._get_create_dashboard_tasks())) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 63, in strict raise ManyError(errs) databricks.labs.blueprint.parallel.ManyError: Detected 7 failures: TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 15:59 ERROR [databricks.labs.blueprint.parallel] More than half 'installing components' tasks failed: 0% results available (0/2). Took 0:00:15.081722 15:59 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Rlo7/config.yml) doesn't exist. 15:59 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 15:59 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 15:59 INFO [databricks.labs.ucx.install] Fetching installations... 15:59 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 15:59 DEBUG [tests.integration.conftest] Waiting for clusters to start... 15:59 DEBUG [tests.integration.conftest] Waiting for clusters to start... 15:59 INFO [databricks.labs.ucx.install] Installing UCX v0.49.1+1420241114155918 15:59 INFO [databricks.labs.ucx.install] Creating ucx schemas... 15:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 15:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy 15:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 15:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 15:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 15:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 15:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 15:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 15:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 15:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental 15:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 15:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 15:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 15:59 INFO [databricks.labs.ucx.install] Creating dashboards... 15:59 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 15:59 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 15:59 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 15:59 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress... 15:59 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 15:59 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 15:59 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 15:59 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 15:59 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 15:59 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 15:59 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main... 15:59 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 15:59 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Rlo7/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 15:59 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 15:59 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Rlo7/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 15:59 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 15:59 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Rlo7/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 15:59 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 15:59 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Rlo7/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 15:59 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 15:59 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Rlo7/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 15:59 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 15:59 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Rlo7/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 15:59 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 15:59 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Rlo7/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 15:59 CRITICAL [databricks.labs.blueprint.parallel] All 'installing dashboards' tasks failed!!! 15:59 ERROR [databricks.labs.blueprint.parallel] installing components task failed: Detected 7 failures: TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 540, in _create_database_and_dashboards Threads.strict("installing dashboards", list(self._get_create_dashboard_tasks())) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 63, in strict raise ManyError(errs) databricks.labs.blueprint.parallel.ManyError: Detected 7 failures: TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 15:59 ERROR [databricks.labs.blueprint.parallel] More than half 'installing components' tasks failed: 0% results available (0/2). Took 0:00:15.081722 15:59 INFO [databricks.labs.ucx.install] Deleting UCX v0.49.1+1420241114155918 from https://DATABRICKS_HOST 15:59 INFO [databricks.labs.ucx.install] Deleting inventory database dummy_sbucf 15:59 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=492897505775012, as it is no longer needed 15:59 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=611897439936964, as it is no longer needed 15:59 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=518886894294428, as it is no longer needed 15:59 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=474996478456723, as it is no longer needed 15:59 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=109500981359356, as it is no longer needed 15:59 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=322913729814610, as it is no longer needed 15:59 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=258497775465289, as it is no longer needed 15:59 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1089727387015209, as it is no longer needed 15:59 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=235425541676456, as it is no longer needed 15:59 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=471437367987254, as it is no longer needed 15:59 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=183291796915760, as it is no longer needed 15:59 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=13207276899490, as it is no longer needed 15:59 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=725822635208625, as it is no longer needed 15:59 INFO [databricks.labs.ucx.install] Deleting cluster policy 15:59 INFO [databricks.labs.ucx.install] Deleting secret scope 15:59 INFO [databricks.labs.ucx.install] UnInstalling UCX complete [gw1] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python ```

_{Running from nightly #268}

[github-actions[bot]]

❌ test_running_real_remove_backup_groups_job: databricks.labs.blueprint.parallel.ManyError: Detected 7 failures: TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' (41.884s)

``` databricks.labs.blueprint.parallel.ManyError: Detected 7 failures: TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' [gw7] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python 05:15 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.X6Fj/config.yml) doesn't exist. 05:15 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:15 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:15 INFO [databricks.labs.ucx.install] Fetching installations... 05:15 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:15 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:15 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:15 INFO [databricks.labs.ucx.install] Installing UCX v0.49.1+1420241115051503 05:15 INFO [databricks.labs.ucx.install] Creating ucx schemas... 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy 05:15 INFO [databricks.labs.ucx.install] Creating dashboards... 05:15 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 05:15 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 05:15 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 05:15 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress... 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main... 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.X6Fj/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.X6Fj/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.X6Fj/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.X6Fj/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.X6Fj/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.X6Fj/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.X6Fj/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:15 CRITICAL [databricks.labs.blueprint.parallel] All 'installing dashboards' tasks failed!!! 05:15 ERROR [databricks.labs.blueprint.parallel] installing components task failed: Detected 7 failures: TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 540, in _create_database_and_dashboards Threads.strict("installing dashboards", list(self._get_create_dashboard_tasks())) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 63, in strict raise ManyError(errs) databricks.labs.blueprint.parallel.ManyError: Detected 7 failures: TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:15 ERROR [databricks.labs.blueprint.parallel] More than half 'installing components' tasks failed: 0% results available (0/2). Took 0:00:19.141438 05:15 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.X6Fj/config.yml) doesn't exist. 05:15 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:15 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:15 INFO [databricks.labs.ucx.install] Fetching installations... 05:15 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:15 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:15 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:15 INFO [databricks.labs.ucx.install] Installing UCX v0.49.1+1420241115051503 05:15 INFO [databricks.labs.ucx.install] Creating ucx schemas... 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental 05:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy 05:15 INFO [databricks.labs.ucx.install] Creating dashboards... 05:15 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 05:15 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 05:15 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 05:15 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress... 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main... 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.X6Fj/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.X6Fj/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.X6Fj/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.X6Fj/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.X6Fj/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.X6Fj/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.X6Fj/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:15 CRITICAL [databricks.labs.blueprint.parallel] All 'installing dashboards' tasks failed!!! 05:15 ERROR [databricks.labs.blueprint.parallel] installing components task failed: Detected 7 failures: TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 540, in _create_database_and_dashboards Threads.strict("installing dashboards", list(self._get_create_dashboard_tasks())) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 63, in strict raise ManyError(errs) databricks.labs.blueprint.parallel.ManyError: Detected 7 failures: TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:15 ERROR [databricks.labs.blueprint.parallel] More than half 'installing components' tasks failed: 0% results available (0/2). Took 0:00:19.141438 05:15 INFO [databricks.labs.ucx.install] Deleting UCX v0.49.1+1420241115051503 from https://DATABRICKS_HOST 05:15 INFO [databricks.labs.ucx.install] Deleting inventory database dummy_sqqda 05:15 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=15501213826301, as it is no longer needed 05:15 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=182814177904300, as it is no longer needed 05:15 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1065831302019684, as it is no longer needed 05:15 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=620622021419499, as it is no longer needed 05:15 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=13675777828466, as it is no longer needed 05:15 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=729872774920071, as it is no longer needed 05:15 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=799837478389685, as it is no longer needed 05:15 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=681761473358194, as it is no longer needed 05:15 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=866502786018889, as it is no longer needed 05:15 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=456648734012186, as it is no longer needed 05:15 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=374258073195711, as it is no longer needed 05:15 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1095004891376461, as it is no longer needed 05:15 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=606161891963749, as it is no longer needed 05:15 INFO [databricks.labs.ucx.install] Deleting cluster policy 05:15 INFO [databricks.labs.ucx.install] Deleting secret scope 05:15 INFO [databricks.labs.ucx.install] UnInstalling UCX complete [gw7] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python ```

_{Running from nightly #269}

[github-actions[bot]]

❌ test_running_real_remove_backup_groups_job: databricks.labs.blueprint.parallel.ManyError: Detected 7 failures: TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' (34.834s)

``` databricks.labs.blueprint.parallel.ManyError: Detected 7 failures: TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' [gw1] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python 05:17 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.LFRT/config.yml) doesn't exist. 05:17 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:17 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:17 INFO [databricks.labs.ucx.install] Fetching installations... 05:17 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:17 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:17 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:17 INFO [databricks.labs.ucx.install] Installing UCX v0.49.1+1420241116051754 05:17 INFO [databricks.labs.ucx.install] Creating ucx schemas... 05:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 05:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 05:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 05:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 05:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 05:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 05:18 INFO [databricks.labs.ucx.install] Creating dashboards... 05:18 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 05:18 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 05:18 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 05:18 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress... 05:18 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:18 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:18 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:18 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:18 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 05:18 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:18 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main... 05:18 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:18 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:18 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.LFRT/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.LFRT/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:18 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.LFRT/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:18 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.LFRT/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:18 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.LFRT/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:18 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.LFRT/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:18 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.LFRT/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 CRITICAL [databricks.labs.blueprint.parallel] All 'installing dashboards' tasks failed!!! 05:18 ERROR [databricks.labs.blueprint.parallel] installing components task failed: Detected 7 failures: TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 540, in _create_database_and_dashboards Threads.strict("installing dashboards", list(self._get_create_dashboard_tasks())) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 63, in strict raise ManyError(errs) databricks.labs.blueprint.parallel.ManyError: Detected 7 failures: TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 ERROR [databricks.labs.blueprint.parallel] More than half 'installing components' tasks failed: 0% results available (0/2). Took 0:00:12.740660 05:17 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.LFRT/config.yml) doesn't exist. 05:17 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:17 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:17 INFO [databricks.labs.ucx.install] Fetching installations... 05:17 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:17 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:17 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:17 INFO [databricks.labs.ucx.install] Installing UCX v0.49.1+1420241116051754 05:17 INFO [databricks.labs.ucx.install] Creating ucx schemas... 05:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 05:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 05:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 05:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 05:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 05:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 05:18 INFO [databricks.labs.ucx.install] Creating dashboards... 05:18 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 05:18 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 05:18 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 05:18 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress... 05:18 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:18 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:18 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:18 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:18 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 05:18 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:18 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main... 05:18 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:18 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:18 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.LFRT/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.LFRT/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:18 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.LFRT/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:18 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.LFRT/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:18 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.LFRT/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:18 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.LFRT/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:18 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.LFRT/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 CRITICAL [databricks.labs.blueprint.parallel] All 'installing dashboards' tasks failed!!! 05:18 ERROR [databricks.labs.blueprint.parallel] installing components task failed: Detected 7 failures: TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 540, in _create_database_and_dashboards Threads.strict("installing dashboards", list(self._get_create_dashboard_tasks())) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 63, in strict raise ManyError(errs) databricks.labs.blueprint.parallel.ManyError: Detected 7 failures: TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 ERROR [databricks.labs.blueprint.parallel] More than half 'installing components' tasks failed: 0% results available (0/2). Took 0:00:12.740660 05:18 INFO [databricks.labs.ucx.install] Deleting UCX v0.49.1+1420241116051754 from https://DATABRICKS_HOST 05:18 INFO [databricks.labs.ucx.install] Deleting inventory database dummy_sl8po 05:18 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=240364470924876, as it is no longer needed 05:18 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=505564948692409, as it is no longer needed 05:18 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=761036480298242, as it is no longer needed 05:18 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=349248869356556, as it is no longer needed 05:18 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=640929129603969, as it is no longer needed 05:18 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=501093703365146, as it is no longer needed 05:18 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=596308568347968, as it is no longer needed 05:18 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=760235381428779, as it is no longer needed 05:18 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=874381832161993, as it is no longer needed 05:18 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=770953735067042, as it is no longer needed 05:18 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=517073157726129, as it is no longer needed 05:18 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=46360269427533, as it is no longer needed 05:18 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=917895808223790, as it is no longer needed 05:18 INFO [databricks.labs.ucx.install] Deleting cluster policy 05:18 INFO [databricks.labs.ucx.install] Deleting secret scope 05:18 INFO [databricks.labs.ucx.install] UnInstalling UCX complete [gw1] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python ```

_{Running from nightly #270}

[github-actions[bot]]

❌ test_running_real_remove_backup_groups_job: databricks.labs.blueprint.parallel.ManyError: Detected 7 failures: TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' (34.651s)

``` databricks.labs.blueprint.parallel.ManyError: Detected 7 failures: TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' [gw2] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python 05:18 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.IRML/config.yml) doesn't exist. 05:18 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:18 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:18 INFO [databricks.labs.ucx.install] Fetching installations... 05:18 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:18 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:18 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:18 INFO [databricks.labs.ucx.install] Installing UCX v0.49.1+1420241117051806 05:18 INFO [databricks.labs.ucx.install] Creating ucx schemas... 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 05:18 INFO [databricks.labs.ucx.install] Creating dashboards... 05:18 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 05:18 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 05:18 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 05:18 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress... 05:18 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:18 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:18 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:18 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:18 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 05:18 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:18 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main... 05:18 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:18 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.IRML/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:18 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.IRML/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:18 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.IRML/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:18 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.IRML/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:18 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.IRML/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:18 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.IRML/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:18 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.IRML/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 CRITICAL [databricks.labs.blueprint.parallel] All 'installing dashboards' tasks failed!!! 05:18 ERROR [databricks.labs.blueprint.parallel] installing components task failed: Detected 7 failures: TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 540, in _create_database_and_dashboards Threads.strict("installing dashboards", list(self._get_create_dashboard_tasks())) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 63, in strict raise ManyError(errs) databricks.labs.blueprint.parallel.ManyError: Detected 7 failures: TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 ERROR [databricks.labs.blueprint.parallel] More than half 'installing components' tasks failed: 0% results available (0/2). Took 0:00:13.109691 05:18 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.IRML/config.yml) doesn't exist. 05:18 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:18 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:18 INFO [databricks.labs.ucx.install] Fetching installations... 05:18 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:18 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:18 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:18 INFO [databricks.labs.ucx.install] Installing UCX v0.49.1+1420241117051806 05:18 INFO [databricks.labs.ucx.install] Creating ucx schemas... 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 05:18 INFO [databricks.labs.ucx.install] Creating dashboards... 05:18 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 05:18 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 05:18 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 05:18 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress... 05:18 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:18 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:18 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:18 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:18 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 05:18 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:18 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main... 05:18 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:18 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.IRML/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:18 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.IRML/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:18 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.IRML/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:18 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.IRML/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:18 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.IRML/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:18 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.IRML/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:18 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.IRML/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 CRITICAL [databricks.labs.blueprint.parallel] All 'installing dashboards' tasks failed!!! 05:18 ERROR [databricks.labs.blueprint.parallel] installing components task failed: Detected 7 failures: TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 540, in _create_database_and_dashboards Threads.strict("installing dashboards", list(self._get_create_dashboard_tasks())) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 63, in strict raise ManyError(errs) databricks.labs.blueprint.parallel.ManyError: Detected 7 failures: TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 ERROR [databricks.labs.blueprint.parallel] More than half 'installing components' tasks failed: 0% results available (0/2). Took 0:00:13.109691 05:18 INFO [databricks.labs.ucx.install] Deleting UCX v0.49.1+1420241117051806 from https://DATABRICKS_HOST 05:18 INFO [databricks.labs.ucx.install] Deleting inventory database dummy_sds2p 05:18 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=518634395280521, as it is no longer needed 05:18 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=527768603997227, as it is no longer needed 05:18 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=696828557574937, as it is no longer needed 05:18 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=930904738299965, as it is no longer needed 05:18 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=693458339794123, as it is no longer needed 05:18 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=977409267332224, as it is no longer needed 05:18 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=777698847918690, as it is no longer needed 05:18 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=253061789892790, as it is no longer needed 05:18 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=375527237828294, as it is no longer needed 05:18 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=899352818397930, as it is no longer needed 05:18 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=291792616326909, as it is no longer needed 05:18 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=135831783391052, as it is no longer needed 05:18 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1100541173353498, as it is no longer needed 05:18 INFO [databricks.labs.ucx.install] Deleting cluster policy 05:18 INFO [databricks.labs.ucx.install] Deleting secret scope 05:18 INFO [databricks.labs.ucx.install] UnInstalling UCX complete [gw2] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python ```

_{Running from nightly #271}

[github-actions[bot]]

❌ test_running_real_remove_backup_groups_job: databricks.labs.blueprint.parallel.ManyError: Detected 7 failures: TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' (32.211s)

``` databricks.labs.blueprint.parallel.ManyError: Detected 7 failures: TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' [gw2] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python 05:18 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.zc9a/config.yml) doesn't exist. 05:18 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:18 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:18 INFO [databricks.labs.ucx.install] Fetching installations... 05:18 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:18 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:18 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:18 INFO [databricks.labs.ucx.install] Installing UCX v0.49.1+1420241118051822 05:18 INFO [databricks.labs.ucx.install] Creating ucx schemas... 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 05:18 INFO [databricks.labs.ucx.install] Creating dashboards... 05:18 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 05:18 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 05:18 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 05:18 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress... 05:18 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:18 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:18 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:18 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:18 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 05:18 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:18 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main... 05:18 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:18 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:18 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.zc9a/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.zc9a/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:18 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.zc9a/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:18 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.zc9a/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:18 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.zc9a/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:18 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.zc9a/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:18 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.zc9a/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 CRITICAL [databricks.labs.blueprint.parallel] All 'installing dashboards' tasks failed!!! 05:18 ERROR [databricks.labs.blueprint.parallel] installing components task failed: Detected 7 failures: TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 540, in _create_database_and_dashboards Threads.strict("installing dashboards", list(self._get_create_dashboard_tasks())) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 63, in strict raise ManyError(errs) databricks.labs.blueprint.parallel.ManyError: Detected 7 failures: TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 ERROR [databricks.labs.blueprint.parallel] More than half 'installing components' tasks failed: 0% results available (0/2). Took 0:00:11.859644 05:18 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.zc9a/config.yml) doesn't exist. 05:18 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:18 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:18 INFO [databricks.labs.ucx.install] Fetching installations... 05:18 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:18 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:18 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:18 INFO [databricks.labs.ucx.install] Installing UCX v0.49.1+1420241118051822 05:18 INFO [databricks.labs.ucx.install] Creating ucx schemas... 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 05:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 05:18 INFO [databricks.labs.ucx.install] Creating dashboards... 05:18 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 05:18 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 05:18 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 05:18 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress... 05:18 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:18 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:18 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:18 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:18 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 05:18 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:18 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main... 05:18 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:18 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:18 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.zc9a/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.zc9a/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:18 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.zc9a/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:18 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.zc9a/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:18 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.zc9a/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:18 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.zc9a/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:18 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.zc9a/dashboards') task failed: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1136, in create_dashboard sdk_dashboard = self._ws.lakeview.create( TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 CRITICAL [databricks.labs.blueprint.parallel] All 'installing dashboards' tasks failed!!! 05:18 ERROR [databricks.labs.blueprint.parallel] installing components task failed: Detected 7 failures: TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 540, in _create_database_and_dashboards Threads.strict("installing dashboards", list(self._get_create_dashboard_tasks())) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 63, in strict raise ManyError(errs) databricks.labs.blueprint.parallel.ManyError: Detected 7 failures: TypeError: LakeviewAPI.create() got an unexpected keyword argument 'parent_path' 05:18 ERROR [databricks.labs.blueprint.parallel] More than half 'installing components' tasks failed: 0% results available (0/2). Took 0:00:11.859644 05:18 INFO [databricks.labs.ucx.install] Deleting UCX v0.49.1+1420241118051822 from https://DATABRICKS_HOST 05:18 INFO [databricks.labs.ucx.install] Deleting inventory database dummy_sccgi 05:18 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=500324871889411, as it is no longer needed 05:18 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=679661116629970, as it is no longer needed 05:18 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1056699345760534, as it is no longer needed 05:18 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=471101759665534, as it is no longer needed 05:18 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=722141358788938, as it is no longer needed 05:18 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=13260959709836, as it is no longer needed 05:18 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=742046732933843, as it is no longer needed 05:18 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=130197698229811, as it is no longer needed 05:18 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=776561774719430, as it is no longer needed 05:18 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=392993499167032, as it is no longer needed 05:18 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=634785166449406, as it is no longer needed 05:18 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=647989875515885, as it is no longer needed 05:18 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1075249840431313, as it is no longer needed 05:18 INFO [databricks.labs.ucx.install] Deleting cluster policy 05:18 INFO [databricks.labs.ucx.install] Deleting secret scope 05:18 INFO [databricks.labs.ucx.install] UnInstalling UCX complete [gw2] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python ```

_{Running from nightly #272}

[github-actions[bot]]

❌ test_running_real_remove_backup_groups_job: databricks.labs.blueprint.parallel.ManyError: Detected 7 failures: AttributeError: 'dict' object has no attribute 'as_dict' (35.259s)

``` databricks.labs.blueprint.parallel.ManyError: Detected 7 failures: AttributeError: 'dict' object has no attribute 'as_dict' [gw6] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python 09:58 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.N86u/config.yml) doesn't exist. 09:58 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 09:58 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 09:58 INFO [databricks.labs.ucx.install] Fetching installations... 09:58 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 09:58 DEBUG [tests.integration.conftest] Waiting for clusters to start... 09:58 DEBUG [tests.integration.conftest] Waiting for clusters to start... 09:58 INFO [databricks.labs.ucx.install] Installing UCX v0.50.1+320241119095819 09:58 INFO [databricks.labs.ucx.install] Creating ucx schemas... 09:58 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 09:58 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 09:58 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 09:58 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 09:58 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental 09:58 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 09:58 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 09:58 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy 09:58 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 09:58 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 09:58 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 09:58 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 09:58 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 09:58 INFO [databricks.labs.ucx.install] Creating dashboards... 09:58 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 09:58 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 09:58 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 09:58 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress... 09:58 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 09:58 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 09:58 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 09:58 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 09:58 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 09:58 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 09:58 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main... 09:58 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 09:58 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.N86u/dashboards') task failed: 'dict' object has no attribute 'as_dict' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1138, in create_dashboard sdk_dashboard = self._ws.lakeview.create(dashboard=dashboard_to_create.as_dict()) # type: ignore File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/dashboards.py", line 1147, in create body = dashboard.as_dict() AttributeError: 'dict' object has no attribute 'as_dict' 09:58 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 09:58 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.N86u/dashboards') task failed: 'dict' object has no attribute 'as_dict' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1138, in create_dashboard sdk_dashboard = self._ws.lakeview.create(dashboard=dashboard_to_create.as_dict()) # type: ignore File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/dashboards.py", line 1147, in create body = dashboard.as_dict() AttributeError: 'dict' object has no attribute 'as_dict' 09:58 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 09:58 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.N86u/dashboards') task failed: 'dict' object has no attribute 'as_dict' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1138, in create_dashboard sdk_dashboard = self._ws.lakeview.create(dashboard=dashboard_to_create.as_dict()) # type: ignore File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/dashboards.py", line 1147, in create body = dashboard.as_dict() AttributeError: 'dict' object has no attribute 'as_dict' 09:58 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 09:58 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.N86u/dashboards') task failed: 'dict' object has no attribute 'as_dict' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1138, in create_dashboard sdk_dashboard = self._ws.lakeview.create(dashboard=dashboard_to_create.as_dict()) # type: ignore File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/dashboards.py", line 1147, in create body = dashboard.as_dict() AttributeError: 'dict' object has no attribute 'as_dict' 09:58 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 09:58 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.N86u/dashboards') task failed: 'dict' object has no attribute 'as_dict' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1138, in create_dashboard sdk_dashboard = self._ws.lakeview.create(dashboard=dashboard_to_create.as_dict()) # type: ignore File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/dashboards.py", line 1147, in create body = dashboard.as_dict() AttributeError: 'dict' object has no attribute 'as_dict' 09:58 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 09:58 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.N86u/dashboards') task failed: 'dict' object has no attribute 'as_dict' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1138, in create_dashboard sdk_dashboard = self._ws.lakeview.create(dashboard=dashboard_to_create.as_dict()) # type: ignore File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/dashboards.py", line 1147, in create body = dashboard.as_dict() AttributeError: 'dict' object has no attribute 'as_dict' 09:58 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 09:58 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.N86u/dashboards') task failed: 'dict' object has no attribute 'as_dict' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1138, in create_dashboard sdk_dashboard = self._ws.lakeview.create(dashboard=dashboard_to_create.as_dict()) # type: ignore File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/dashboards.py", line 1147, in create body = dashboard.as_dict() AttributeError: 'dict' object has no attribute 'as_dict' 09:58 CRITICAL [databricks.labs.blueprint.parallel] All 'installing dashboards' tasks failed!!! 09:58 ERROR [databricks.labs.blueprint.parallel] installing components task failed: Detected 7 failures: AttributeError: 'dict' object has no attribute 'as_dict' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 540, in _create_database_and_dashboards Threads.strict("installing dashboards", list(self._get_create_dashboard_tasks())) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 63, in strict raise ManyError(errs) databricks.labs.blueprint.parallel.ManyError: Detected 7 failures: AttributeError: 'dict' object has no attribute 'as_dict' 09:58 ERROR [databricks.labs.blueprint.parallel] More than half 'installing components' tasks failed: 0% results available (0/2). Took 0:00:13.091664 09:58 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.N86u/config.yml) doesn't exist. 09:58 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 09:58 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 09:58 INFO [databricks.labs.ucx.install] Fetching installations... 09:58 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 09:58 DEBUG [tests.integration.conftest] Waiting for clusters to start... 09:58 DEBUG [tests.integration.conftest] Waiting for clusters to start... 09:58 INFO [databricks.labs.ucx.install] Installing UCX v0.50.1+320241119095819 09:58 INFO [databricks.labs.ucx.install] Creating ucx schemas... 09:58 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 09:58 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 09:58 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 09:58 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 09:58 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental 09:58 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 09:58 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 09:58 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy 09:58 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 09:58 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 09:58 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 09:58 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 09:58 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 09:58 INFO [databricks.labs.ucx.install] Creating dashboards... 09:58 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 09:58 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 09:58 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 09:58 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress... 09:58 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 09:58 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 09:58 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 09:58 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 09:58 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 09:58 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 09:58 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main... 09:58 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 09:58 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.N86u/dashboards') task failed: 'dict' object has no attribute 'as_dict' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1138, in create_dashboard sdk_dashboard = self._ws.lakeview.create(dashboard=dashboard_to_create.as_dict()) # type: ignore File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/dashboards.py", line 1147, in create body = dashboard.as_dict() AttributeError: 'dict' object has no attribute 'as_dict' 09:58 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 09:58 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.N86u/dashboards') task failed: 'dict' object has no attribute 'as_dict' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1138, in create_dashboard sdk_dashboard = self._ws.lakeview.create(dashboard=dashboard_to_create.as_dict()) # type: ignore File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/dashboards.py", line 1147, in create body = dashboard.as_dict() AttributeError: 'dict' object has no attribute 'as_dict' 09:58 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 09:58 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.N86u/dashboards') task failed: 'dict' object has no attribute 'as_dict' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1138, in create_dashboard sdk_dashboard = self._ws.lakeview.create(dashboard=dashboard_to_create.as_dict()) # type: ignore File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/dashboards.py", line 1147, in create body = dashboard.as_dict() AttributeError: 'dict' object has no attribute 'as_dict' 09:58 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 09:58 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.N86u/dashboards') task failed: 'dict' object has no attribute 'as_dict' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1138, in create_dashboard sdk_dashboard = self._ws.lakeview.create(dashboard=dashboard_to_create.as_dict()) # type: ignore File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/dashboards.py", line 1147, in create body = dashboard.as_dict() AttributeError: 'dict' object has no attribute 'as_dict' 09:58 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 09:58 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.N86u/dashboards') task failed: 'dict' object has no attribute 'as_dict' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1138, in create_dashboard sdk_dashboard = self._ws.lakeview.create(dashboard=dashboard_to_create.as_dict()) # type: ignore File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/dashboards.py", line 1147, in create body = dashboard.as_dict() AttributeError: 'dict' object has no attribute 'as_dict' 09:58 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 09:58 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.N86u/dashboards') task failed: 'dict' object has no attribute 'as_dict' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1138, in create_dashboard sdk_dashboard = self._ws.lakeview.create(dashboard=dashboard_to_create.as_dict()) # type: ignore File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/dashboards.py", line 1147, in create body = dashboard.as_dict() AttributeError: 'dict' object has no attribute 'as_dict' 09:58 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 09:58 ERROR [databricks.labs.blueprint.parallel] installing dashboards(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.N86u/dashboards') task failed: 'dict' object has no attribute 'as_dict' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 653, in _create_dashboard dashboard = Dashboards(self._ws).create_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 1138, in create_dashboard sdk_dashboard = self._ws.lakeview.create(dashboard=dashboard_to_create.as_dict()) # type: ignore File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/dashboards.py", line 1147, in create body = dashboard.as_dict() AttributeError: 'dict' object has no attribute 'as_dict' 09:58 CRITICAL [databricks.labs.blueprint.parallel] All 'installing dashboards' tasks failed!!! 09:58 ERROR [databricks.labs.blueprint.parallel] installing components task failed: Detected 7 failures: AttributeError: 'dict' object has no attribute 'as_dict' Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 540, in _create_database_and_dashboards Threads.strict("installing dashboards", list(self._get_create_dashboard_tasks())) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 63, in strict raise ManyError(errs) databricks.labs.blueprint.parallel.ManyError: Detected 7 failures: AttributeError: 'dict' object has no attribute 'as_dict' 09:58 ERROR [databricks.labs.blueprint.parallel] More than half 'installing components' tasks failed: 0% results available (0/2). Took 0:00:13.091664 09:58 INFO [databricks.labs.ucx.install] Deleting UCX v0.50.1+320241119095819 from https://DATABRICKS_HOST 09:58 INFO [databricks.labs.ucx.install] Deleting inventory database dummy_sb9q7 09:58 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=628710459720234, as it is no longer needed 09:58 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=290143463847497, as it is no longer needed 09:58 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=437874383688276, as it is no longer needed 09:58 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=743215368304435, as it is no longer needed 09:58 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=674853581299374, as it is no longer needed 09:58 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=576520431313525, as it is no longer needed 09:58 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=740357866282338, as it is no longer needed 09:58 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=974936318333395, as it is no longer needed 09:58 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=131376775119891, as it is no longer needed 09:58 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=617906706213221, as it is no longer needed 09:58 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=619421035993630, as it is no longer needed 09:58 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=128942641103976, as it is no longer needed 09:58 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=548318045619651, as it is no longer needed 09:58 INFO [databricks.labs.ucx.install] Deleting cluster policy 09:58 INFO [databricks.labs.ucx.install] Deleting secret scope 09:58 INFO [databricks.labs.ucx.install] UnInstalling UCX complete [gw6] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python ```

_{Running from nightly #276}

[github-actions[bot]]

❌ test_running_real_remove_backup_groups_job: AssertionError: assert False (11m22.729s)

``` AssertionError: assert False + where False = validate_step('remove-workspace-local-backup-groups') + where validate_step = .validate_step + where = .deployed_workflows [gw1] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python 09:22 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.hADg/config.yml) doesn't exist. 09:22 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 09:22 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 09:22 INFO [databricks.labs.ucx.install] Fetching installations... 09:22 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 09:22 DEBUG [tests.integration.conftest] Waiting for clusters to start... 09:22 DEBUG [tests.integration.conftest] Waiting for clusters to start... 09:22 INFO [databricks.labs.ucx.install] Installing UCX v0.50.1+520241120092230 09:22 INFO [databricks.labs.ucx.install] Creating ucx schemas... 09:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 09:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 09:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 09:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 09:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 09:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 09:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 09:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 09:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental 09:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 09:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 09:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy 09:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 09:22 INFO [databricks.labs.ucx.install] Creating dashboards... 09:22 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 09:22 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 09:22 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 09:22 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress... 09:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 09:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 09:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 09:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 09:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 09:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 09:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main... 09:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 09:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 09:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 09:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 09:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 09:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 09:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 09:22 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.hADg/README for the next steps. 09:22 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sze2x.groups] fetching groups inventory 09:22 WARNING [databricks.labs.ucx.workspace_access.groups] Group ucx-d62E-ra78a57f8b defined in configuration does not exist on the groups table. Consider checking if the group exist in the workspace or re-running the assessment. 09:22 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sze2x.groups] crawling new set of snapshot data for groups 09:22 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ... 09:22 INFO [databricks.labs.ucx.workspace_access.groups] Found 4 WorkspaceGroup 09:22 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId... 09:22 INFO [databricks.labs.ucx.workspace_access.groups] Found 83 account groups 09:22 INFO [databricks.labs.ucx.workspace_access.groups] Group listing provided, a subset of all groups will be migrated 09:22 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sze2x.groups] found 1 new records for groups 09:22 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta ... 09:22 INFO [databricks.labs.ucx.workspace_access.groups] Found 59 Group 09:22 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ... 09:22 INFO [databricks.labs.ucx.workspace_access.groups] Found 4 WorkspaceGroup 09:22 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sze2x.groups] fetching groups inventory 09:22 INFO [databricks.labs.ucx.workspace_access.groups] Starting to rename 1 groups for migration... 09:22 DEBUG [databricks.labs.ucx.workspace_access.groups] Renaming group: ucx-d62E-ra78a57f8b (id=1053058473826439) -> rename-hADg-ucx-d62E-ra78a57f8b 09:22 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename has possibly taken effect: ucx-d62E-ra78a57f8b (id=1053058473826439) -> rename-hADg-ucx-d62E-ra78a57f8b 09:22 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename has possibly taken effect: ucx-d62E-ra78a57f8b (id=1053058473826439) -> rename-hADg-ucx-d62E-ra78a57f8b 09:22 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename is assumed complete: ucx-d62E-ra78a57f8b (id=1053058473826439) -> rename-hADg-ucx-d62E-ra78a57f8b 09:22 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ... 09:22 INFO [databricks.labs.ucx.workspace_access.groups] Found 63 WorkspaceGroup 09:22 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration reflects renamed group: 1053058473826439 (renamed to rename-hADg-ucx-d62E-ra78a57f8b) 09:22 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ... 09:22 INFO [databricks.labs.ucx.workspace_access.groups] Found 63 WorkspaceGroup 09:22 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration reflects renamed group: 1053058473826439 (renamed to rename-hADg-ucx-d62E-ra78a57f8b) 09:22 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration showed all 1 renamed groups; assuming complete. 09:22 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId... 09:22 INFO [databricks.labs.ucx.workspace_access.groups] Found 83 account groups 09:22 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta ... 09:22 INFO [databricks.labs.ucx.workspace_access.groups] Found 59 Group 09:22 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ... 09:22 INFO [databricks.labs.ucx.workspace_access.groups] Found 4 WorkspaceGroup 09:22 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sze2x.groups] fetching groups inventory 09:22 INFO [databricks.labs.ucx.workspace_access.groups] Starting to reflect 1 account groups into workspace for migration... 09:22 DEBUG [databricks.labs.ucx.installer.workflows] starting remove-workspace-local-backup-groups job: https://DATABRICKS_HOST#job/1102066224363033 09:22 INFO [databricks.labs.ucx.installer.workflows] Started remove-workspace-local-backup-groups job: https://DATABRICKS_HOST#job/1102066224363033/runs/981435701836829 09:22 DEBUG [databricks.labs.ucx.installer.workflows] Waiting for completion of remove-workspace-local-backup-groups job: https://DATABRICKS_HOST#job/1102066224363033/runs/981435701836829 09:33 INFO [databricks.labs.ucx.installer.workflows] Completed remove-workspace-local-backup-groups job run 981435701836829 with state: RunResultState.SUCCESS_WITH_FAILURES (The job run succeeded with 1 failed task) 09:33 INFO [databricks.labs.ucx.installer.workflows] Completed remove-workspace-local-backup-groups job run 981435701836829 duration: 0:10:13.103000 (2024-11-20 09:22:52.207000+00:00 thru 2024-11-20 09:33:05.310000+00:00) 09:33 DEBUG [databricks.labs.ucx.installer.workflows] Validating remove-workspace-local-backup-groups workflow: https://DATABRICKS_HOST#job/1102066224363033 09:22 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.hADg/config.yml) doesn't exist. 09:22 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 09:22 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 09:22 INFO [databricks.labs.ucx.install] Fetching installations... 09:22 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 09:22 DEBUG [tests.integration.conftest] Waiting for clusters to start... 09:22 DEBUG [tests.integration.conftest] Waiting for clusters to start... 09:22 INFO [databricks.labs.ucx.install] Installing UCX v0.50.1+520241120092230 09:22 INFO [databricks.labs.ucx.install] Creating ucx schemas... 09:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 09:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 09:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 09:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 09:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 09:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 09:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 09:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 09:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migration-progress-experimental 09:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 09:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 09:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-legacy 09:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 09:22 INFO [databricks.labs.ucx.install] Creating dashboards... 09:22 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 09:22 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 09:22 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 09:22 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress... 09:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 09:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 09:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 09:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 09:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/groups... 09:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 09:22 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/progress/main... 09:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 09:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 09:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 09:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 09:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 09:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 09:22 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 09:22 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.hADg/README for the next steps. 09:22 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sze2x.groups] fetching groups inventory 09:22 WARNING [databricks.labs.ucx.workspace_access.groups] Group ucx-d62E-ra78a57f8b defined in configuration does not exist on the groups table. Consider checking if the group exist in the workspace or re-running the assessment. 09:22 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sze2x.groups] crawling new set of snapshot data for groups 09:22 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ... 09:22 INFO [databricks.labs.ucx.workspace_access.groups] Found 4 WorkspaceGroup 09:22 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId... 09:22 INFO [databricks.labs.ucx.workspace_access.groups] Found 83 account groups 09:22 INFO [databricks.labs.ucx.workspace_access.groups] Group listing provided, a subset of all groups will be migrated 09:22 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sze2x.groups] found 1 new records for groups 09:22 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta ... 09:22 INFO [databricks.labs.ucx.workspace_access.groups] Found 59 Group 09:22 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ... 09:22 INFO [databricks.labs.ucx.workspace_access.groups] Found 4 WorkspaceGroup 09:22 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sze2x.groups] fetching groups inventory 09:22 INFO [databricks.labs.ucx.workspace_access.groups] Starting to rename 1 groups for migration... 09:22 DEBUG [databricks.labs.ucx.workspace_access.groups] Renaming group: ucx-d62E-ra78a57f8b (id=1053058473826439) -> rename-hADg-ucx-d62E-ra78a57f8b 09:22 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename has possibly taken effect: ucx-d62E-ra78a57f8b (id=1053058473826439) -> rename-hADg-ucx-d62E-ra78a57f8b 09:22 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename has possibly taken effect: ucx-d62E-ra78a57f8b (id=1053058473826439) -> rename-hADg-ucx-d62E-ra78a57f8b 09:22 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename is assumed complete: ucx-d62E-ra78a57f8b (id=1053058473826439) -> rename-hADg-ucx-d62E-ra78a57f8b 09:22 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ... 09:22 INFO [databricks.labs.ucx.workspace_access.groups] Found 63 WorkspaceGroup 09:22 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration reflects renamed group: 1053058473826439 (renamed to rename-hADg-ucx-d62E-ra78a57f8b) 09:22 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ... 09:22 INFO [databricks.labs.ucx.workspace_access.groups] Found 63 WorkspaceGroup 09:22 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration reflects renamed group: 1053058473826439 (renamed to rename-hADg-ucx-d62E-ra78a57f8b) 09:22 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration showed all 1 renamed groups; assuming complete. 09:22 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId... 09:22 INFO [databricks.labs.ucx.workspace_access.groups] Found 83 account groups 09:22 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta ... 09:22 INFO [databricks.labs.ucx.workspace_access.groups] Found 59 Group 09:22 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ... 09:22 INFO [databricks.labs.ucx.workspace_access.groups] Found 4 WorkspaceGroup 09:22 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sze2x.groups] fetching groups inventory 09:22 INFO [databricks.labs.ucx.workspace_access.groups] Starting to reflect 1 account groups into workspace for migration... 09:22 DEBUG [databricks.labs.ucx.installer.workflows] starting remove-workspace-local-backup-groups job: https://DATABRICKS_HOST#job/1102066224363033 09:22 INFO [databricks.labs.ucx.installer.workflows] Started remove-workspace-local-backup-groups job: https://DATABRICKS_HOST#job/1102066224363033/runs/981435701836829 09:22 DEBUG [databricks.labs.ucx.installer.workflows] Waiting for completion of remove-workspace-local-backup-groups job: https://DATABRICKS_HOST#job/1102066224363033/runs/981435701836829 09:33 INFO [databricks.labs.ucx.installer.workflows] Completed remove-workspace-local-backup-groups job run 981435701836829 with state: RunResultState.SUCCESS_WITH_FAILURES (The job run succeeded with 1 failed task) 09:33 INFO [databricks.labs.ucx.installer.workflows] Completed remove-workspace-local-backup-groups job run 981435701836829 duration: 0:10:13.103000 (2024-11-20 09:22:52.207000+00:00 thru 2024-11-20 09:33:05.310000+00:00) 09:33 DEBUG [databricks.labs.ucx.installer.workflows] Validating remove-workspace-local-backup-groups workflow: https://DATABRICKS_HOST#job/1102066224363033 09:33 INFO [databricks.labs.ucx.install] Deleting UCX v0.50.1+520241120092230 from https://DATABRICKS_HOST 09:33 INFO [databricks.labs.ucx.install] Deleting inventory database dummy_sze2x 09:33 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=488706596010428, as it is no longer needed 09:33 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=56833409397747, as it is no longer needed 09:33 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=890332885395119, as it is no longer needed 09:33 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=157862534688694, as it is no longer needed 09:33 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=955019584550055, as it is no longer needed 09:33 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=410929684008214, as it is no longer needed 09:33 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=1102066224363033, as it is no longer needed 09:33 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=610052303245756, as it is no longer needed 09:33 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=100558249345191, as it is no longer needed 09:33 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=603791342643439, as it is no longer needed 09:33 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=822842611340247, as it is no longer needed 09:33 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=38041653818747, as it is no longer needed 09:33 INFO [databricks.labs.ucx.installer.workflows] Removing job_id=998133916565394, as it is no longer needed 09:33 INFO [databricks.labs.ucx.install] Deleting cluster policy 09:33 INFO [databricks.labs.ucx.install] Deleting secret scope 09:33 INFO [databricks.labs.ucx.install] UnInstalling UCX complete [gw1] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python ```

_{Running from nightly #279}