Test failure: `test_experimental_permissions_migration_for_group_with_same_name`

❌ test_experimental_permissions_migration_for_group_with_same_name: databricks.sdk.errors.platform.ResourceDoesNotExist: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Hyyg/logs/migrate-groups-experimental) doesn't exist. (4m1.811s)

``` databricks.sdk.errors.platform.ResourceDoesNotExist: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Hyyg/logs/migrate-groups-experimental) doesn't exist. [gw4] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 07:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-l5m6@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-l5m6@example.com')], entitlements=[], external_id=None, groups=[], id='5051864991231431', name=Name(family_name=None, given_name='sdk-l5m6@example.com'), roles=[], schemas=[, ], user_name='sdk-l5m6@example.com') 07:05 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx_Gqmno: https://DATABRICKS_HOST#setting/accounts/groups/750707278489144 07:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx_Gqmno', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='750707278489144', members=[ComplexValue(display='sdk-l5m6@example.com', primary=None, ref='Users/5051864991231431', type=None, value='5051864991231431')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 07:05 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx_Gqmno: https://accounts.CLOUD_ENVdatabricks.net/users/groups/373109360711338/members 07:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx_Gqmno', entitlements=[], external_id=None, groups=[], id='373109360711338', members=[ComplexValue(display='sdk-l5m6@example.com', primary=None, ref='Users/5051864991231431', type=None, value='5051864991231431')], meta=None, roles=[], schemas=[]) 07:05 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/000EFA2F5B17344C 07:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='000EFA2F5B17344C') 07:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 000EFA2F5B17344C [group_name admins CAN_USE] -> [group_name ucx_Gqmno CAN_USE] 07:05 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s3xmv: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s3xmv 07:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s3xmv', metastore_id=None, name='ucx_s3xmv', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:05 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_s3xmv.ucx_tyhqb: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s3xmv/ucx_tyhqb 07:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_s3xmv.ucx_tyhqb', metastore_id=None, name='ucx_tyhqb', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024060408'}, row_filter=None, schema_name='ucx_s3xmv', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_s3xmv/ucx_tyhqb', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:05 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sdibj: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sdibj 07:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sdibj', metastore_id=None, name='ucx_sdibj', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:05 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Hyyg/config.yml) doesn't exist. 07:05 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 07:05 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 07:05 INFO [databricks.labs.ucx.install] Fetching installations... 07:06 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 07:06 DEBUG [tests.integration.conftest] Waiting for clusters to start... 07:06 DEBUG [tests.integration.conftest] Waiting for clusters to start... 07:06 INFO [databricks.labs.ucx.install] Installing UCX v0.24.1+3020240604070629 07:06 INFO [databricks.labs.ucx.install] Creating ucx schemas... 07:06 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 07:06 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 07:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 07:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 07:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 07:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 07:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 07:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 07:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 07:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 07:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 07:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 07:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 07:07 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Hyyg/README for the next steps. 07:07 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-groups-experimental job: https://DATABRICKS_HOST#job/655188324283152 07:09 INFO [databricks.labs.ucx.installer.workflows] ---------- REMOTE LOGS -------------- 07:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-l5m6@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-l5m6@example.com')], entitlements=[], external_id=None, groups=[], id='5051864991231431', name=Name(family_name=None, given_name='sdk-l5m6@example.com'), roles=[], schemas=[, ], user_name='sdk-l5m6@example.com') 07:05 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx_Gqmno: https://DATABRICKS_HOST#setting/accounts/groups/750707278489144 07:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx_Gqmno', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='750707278489144', members=[ComplexValue(display='sdk-l5m6@example.com', primary=None, ref='Users/5051864991231431', type=None, value='5051864991231431')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 07:05 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx_Gqmno: https://accounts.CLOUD_ENVdatabricks.net/users/groups/373109360711338/members 07:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx_Gqmno', entitlements=[], external_id=None, groups=[], id='373109360711338', members=[ComplexValue(display='sdk-l5m6@example.com', primary=None, ref='Users/5051864991231431', type=None, value='5051864991231431')], meta=None, roles=[], schemas=[]) 07:05 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/000EFA2F5B17344C 07:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='000EFA2F5B17344C') 07:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 000EFA2F5B17344C [group_name admins CAN_USE] -> [group_name ucx_Gqmno CAN_USE] 07:05 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s3xmv: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s3xmv 07:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s3xmv', metastore_id=None, name='ucx_s3xmv', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:05 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_s3xmv.ucx_tyhqb: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s3xmv/ucx_tyhqb 07:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_s3xmv.ucx_tyhqb', metastore_id=None, name='ucx_tyhqb', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024060408'}, row_filter=None, schema_name='ucx_s3xmv', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_s3xmv/ucx_tyhqb', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:05 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sdibj: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sdibj 07:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sdibj', metastore_id=None, name='ucx_sdibj', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:05 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Hyyg/config.yml) doesn't exist. 07:05 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 07:05 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 07:05 INFO [databricks.labs.ucx.install] Fetching installations... 07:06 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 07:06 DEBUG [tests.integration.conftest] Waiting for clusters to start... 07:06 DEBUG [tests.integration.conftest] Waiting for clusters to start... 07:06 INFO [databricks.labs.ucx.install] Installing UCX v0.24.1+3020240604070629 07:06 INFO [databricks.labs.ucx.install] Creating ucx schemas... 07:06 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 07:06 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 07:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 07:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 07:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 07:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 07:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 07:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 07:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 07:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 07:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 07:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 07:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 07:07 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Hyyg/README for the next steps. 07:07 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-groups-experimental job: https://DATABRICKS_HOST#job/655188324283152 07:09 INFO [databricks.labs.ucx.installer.workflows] ---------- REMOTE LOGS -------------- 07:09 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster_policy permissions fixtures 07:09 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster_policy permissions fixture: 000EFA2F5B17344C [group_name admins CAN_USE] -> [group_name ucx_Gqmno CAN_USE] 07:09 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster policy fixtures 07:09 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster policy fixture: CreatePolicyResponse(policy_id='000EFA2F5B17344C') 07:09 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while cluster policy CreatePolicyResponse(policy_id='000EFA2F5B17344C') teardown: Can't find a cluster policy with id: 000EFA2F5B17344C. 07:09 INFO [databricks.labs.ucx.install] Deleting UCX v0.24.1+3020240604070629 from https://DATABRICKS_HOST 07:09 ERROR [databricks.labs.ucx.install] Check if /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Hyyg is present 07:09 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace user fixtures 07:09 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='sdk-l5m6@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-l5m6@example.com')], entitlements=[], external_id=None, groups=[], id='5051864991231431', name=Name(family_name=None, given_name='sdk-l5m6@example.com'), roles=[], schemas=[, ], user_name='sdk-l5m6@example.com') 07:09 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while workspace user User(active=True, display_name='sdk-l5m6@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-l5m6@example.com')], entitlements=[], external_id=None, groups=[], id='5051864991231431', name=Name(family_name=None, given_name='sdk-l5m6@example.com'), roles=[], schemas=[, ], user_name='sdk-l5m6@example.com') teardown: None User with id 5051864991231431 not found. 07:09 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 account group fixtures 07:09 DEBUG [databricks.labs.ucx.mixins.fixtures] removing account group fixture: Group(display_name='ucx_Gqmno', entitlements=[], external_id=None, groups=[], id='373109360711338', members=[ComplexValue(display='sdk-l5m6@example.com', primary=None, ref='Users/5051864991231431', type=None, value='5051864991231431')], meta=None, roles=[], schemas=[]) 07:09 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace group fixtures 07:09 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace group fixture: Group(display_name='ucx_Gqmno', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='750707278489144', members=[ComplexValue(display='sdk-l5m6@example.com', primary=None, ref='Users/5051864991231431', type=None, value='5051864991231431')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 07:09 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while workspace group Group(display_name='ucx_Gqmno', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='750707278489144', members=[ComplexValue(display='sdk-l5m6@example.com', primary=None, ref='Users/5051864991231431', type=None, value='5051864991231431')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) teardown: None Group with id 750707278489144 not found. 07:09 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 07:09 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 table fixtures 07:09 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_s3xmv.ucx_tyhqb', metastore_id=None, name='ucx_tyhqb', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024060408'}, row_filter=None, schema_name='ucx_s3xmv', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_s3xmv/ucx_tyhqb', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:09 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 schema fixtures 07:09 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s3xmv', metastore_id=None, name='ucx_s3xmv', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:09 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sdibj', metastore_id=None, name='ucx_sdibj', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw4] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```

_{Running from nightly #81}

❌ test_experimental_permissions_migration_for_group_with_same_name: databricks.sdk.errors.platform.InvalidParameterValue: Run 165700422664699 does not exist. (3m52.769s)

``` databricks.sdk.errors.platform.InvalidParameterValue: Run 165700422664699 does not exist. databricks.sdk.errors.platform.ResourceDoesNotExist: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.td7J) doesn't exist. [gw4] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 07:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-sdne@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-sdne@example.com')], entitlements=[], external_id=None, groups=[], id='7359836626340472', name=Name(family_name=None, given_name='sdk-sdne@example.com'), roles=[], schemas=[, ], user_name='sdk-sdne@example.com') 07:05 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx_GdfsN: https://DATABRICKS_HOST#setting/accounts/groups/160635970093727 07:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx_GdfsN', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='160635970093727', members=[ComplexValue(display='sdk-sdne@example.com', primary=None, ref='Users/7359836626340472', type=None, value='7359836626340472')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 07:05 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx_GdfsN: https://accounts.CLOUD_ENVdatabricks.net/users/groups/632149874157740/members 07:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx_GdfsN', entitlements=[], external_id=None, groups=[], id='632149874157740', members=[ComplexValue(display='sdk-sdne@example.com', primary=None, ref='Users/7359836626340472', type=None, value='7359836626340472')], meta=None, roles=[], schemas=[]) 07:05 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/0010707E599FB7AD 07:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='0010707E599FB7AD') 07:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 0010707E599FB7AD [group_name admins CAN_USE] -> [group_name ucx_GdfsN CAN_USE] 07:05 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sec8a: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sec8a 07:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sec8a', metastore_id=None, name='ucx_sec8a', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:05 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_sec8a.ucx_txivv: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sec8a/ucx_txivv 07:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sec8a.ucx_txivv', metastore_id=None, name='ucx_txivv', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024060508'}, row_filter=None, schema_name='ucx_sec8a', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_sec8a/ucx_txivv', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:05 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s0xtt: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s0xtt 07:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s0xtt', metastore_id=None, name='ucx_s0xtt', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:05 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.td7J/config.yml) doesn't exist. 07:05 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 07:05 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 07:05 INFO [databricks.labs.ucx.install] Fetching installations... 07:06 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 07:06 DEBUG [tests.integration.conftest] Waiting for clusters to start... 07:06 DEBUG [tests.integration.conftest] Waiting for clusters to start... 07:06 INFO [databricks.labs.ucx.install] Installing UCX v0.25.1+220240605070613 07:06 INFO [databricks.labs.ucx.install] Creating ucx schemas... 07:06 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 07:06 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 07:06 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 07:06 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 07:06 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 07:06 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 07:06 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 07:06 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 07:06 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 07:06 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 07:06 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 07:06 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 07:06 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 07:06 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.td7J/README for the next steps. 07:06 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-groups-experimental job: https://DATABRICKS_HOST#job/919733784273953 07:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-sdne@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-sdne@example.com')], entitlements=[], external_id=None, groups=[], id='7359836626340472', name=Name(family_name=None, given_name='sdk-sdne@example.com'), roles=[], schemas=[, ], user_name='sdk-sdne@example.com') 07:05 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx_GdfsN: https://DATABRICKS_HOST#setting/accounts/groups/160635970093727 07:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx_GdfsN', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='160635970093727', members=[ComplexValue(display='sdk-sdne@example.com', primary=None, ref='Users/7359836626340472', type=None, value='7359836626340472')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 07:05 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx_GdfsN: https://accounts.CLOUD_ENVdatabricks.net/users/groups/632149874157740/members 07:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx_GdfsN', entitlements=[], external_id=None, groups=[], id='632149874157740', members=[ComplexValue(display='sdk-sdne@example.com', primary=None, ref='Users/7359836626340472', type=None, value='7359836626340472')], meta=None, roles=[], schemas=[]) 07:05 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/0010707E599FB7AD 07:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='0010707E599FB7AD') 07:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 0010707E599FB7AD [group_name admins CAN_USE] -> [group_name ucx_GdfsN CAN_USE] 07:05 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sec8a: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sec8a 07:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sec8a', metastore_id=None, name='ucx_sec8a', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:05 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_sec8a.ucx_txivv: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sec8a/ucx_txivv 07:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sec8a.ucx_txivv', metastore_id=None, name='ucx_txivv', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024060508'}, row_filter=None, schema_name='ucx_sec8a', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_sec8a/ucx_txivv', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:05 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s0xtt: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s0xtt 07:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s0xtt', metastore_id=None, name='ucx_s0xtt', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:05 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.td7J/config.yml) doesn't exist. 07:05 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 07:05 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 07:05 INFO [databricks.labs.ucx.install] Fetching installations... 07:06 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 07:06 DEBUG [tests.integration.conftest] Waiting for clusters to start... 07:06 DEBUG [tests.integration.conftest] Waiting for clusters to start... 07:06 INFO [databricks.labs.ucx.install] Installing UCX v0.25.1+220240605070613 07:06 INFO [databricks.labs.ucx.install] Creating ucx schemas... 07:06 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 07:06 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 07:06 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 07:06 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 07:06 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 07:06 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 07:06 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 07:06 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 07:06 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 07:06 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 07:06 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 07:06 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 07:06 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 07:06 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.td7J/README for the next steps. 07:06 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-groups-experimental job: https://DATABRICKS_HOST#job/919733784273953 07:09 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster_policy permissions fixtures 07:09 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster_policy permissions fixture: 0010707E599FB7AD [group_name admins CAN_USE] -> [group_name ucx_GdfsN CAN_USE] 07:09 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster policy fixtures 07:09 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster policy fixture: CreatePolicyResponse(policy_id='0010707E599FB7AD') 07:09 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while cluster policy CreatePolicyResponse(policy_id='0010707E599FB7AD') teardown: Can't find a cluster policy with id: 0010707E599FB7AD. 07:09 INFO [databricks.labs.ucx.install] Deleting UCX v0.25.1+220240605070613 from https://DATABRICKS_HOST 07:09 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_s0xtt 07:09 INFO [databricks.labs.ucx.install] Deleting jobs 07:09 INFO [databricks.labs.ucx.install] Deleting experimental-workflow-linter job_id=368346798904444. 07:09 INFO [databricks.labs.ucx.install] Deleting migrate-data-reconciliation job_id=286162465441730. 07:09 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=803929647480729. 07:09 INFO [databricks.labs.ucx.install] Deleting failing job_id=168811700112422. 07:09 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=919733784273953. 07:09 INFO [databricks.labs.ucx.install] Deleting migrate-external-tables-ctas job_id=943433318917839. 07:09 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=775955217795912. 07:09 INFO [databricks.labs.ucx.install] Deleting assessment job_id=3181454331336. 07:09 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=182319435587484. 07:09 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=59189847999454. 07:09 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=30194310620028. 07:09 INFO [databricks.labs.ucx.install] Deleting migrate-external-hiveserde-tables-in-place-experimental job_id=879014925141841. 07:09 INFO [databricks.labs.ucx.install] Deleting scan-tables-in-mounts-experimental job_id=384932223384835. 07:09 INFO [databricks.labs.ucx.install] Deleting cluster policy 07:09 ERROR [databricks.labs.ucx.install] UCX Policy already deleted 07:09 INFO [databricks.labs.ucx.install] Deleting secret scope 07:09 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace user fixtures 07:09 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='sdk-sdne@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-sdne@example.com')], entitlements=[], external_id=None, groups=[], id='7359836626340472', name=Name(family_name=None, given_name='sdk-sdne@example.com'), roles=[], schemas=[, ], user_name='sdk-sdne@example.com') 07:09 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while workspace user User(active=True, display_name='sdk-sdne@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-sdne@example.com')], entitlements=[], external_id=None, groups=[], id='7359836626340472', name=Name(family_name=None, given_name='sdk-sdne@example.com'), roles=[], schemas=[, ], user_name='sdk-sdne@example.com') teardown: None User with id 7359836626340472 not found. 07:09 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 account group fixtures 07:09 DEBUG [databricks.labs.ucx.mixins.fixtures] removing account group fixture: Group(display_name='ucx_GdfsN', entitlements=[], external_id=None, groups=[], id='632149874157740', members=[ComplexValue(display='sdk-sdne@example.com', primary=None, ref='Users/7359836626340472', type=None, value='7359836626340472')], meta=None, roles=[], schemas=[]) 07:09 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace group fixtures 07:09 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace group fixture: Group(display_name='ucx_GdfsN', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='160635970093727', members=[ComplexValue(display='sdk-sdne@example.com', primary=None, ref='Users/7359836626340472', type=None, value='7359836626340472')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 07:09 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while workspace group Group(display_name='ucx_GdfsN', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='160635970093727', members=[ComplexValue(display='sdk-sdne@example.com', primary=None, ref='Users/7359836626340472', type=None, value='7359836626340472')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) teardown: None Group with id 160635970093727 not found. 07:09 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 07:09 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 table fixtures 07:09 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sec8a.ucx_txivv', metastore_id=None, name='ucx_txivv', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024060508'}, row_filter=None, schema_name='ucx_sec8a', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_sec8a/ucx_txivv', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:09 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 schema fixtures 07:09 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sec8a', metastore_id=None, name='ucx_sec8a', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:09 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s0xtt', metastore_id=None, name='ucx_s0xtt', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) ```

_{Running from nightly #82}

databrickslabs / ucx

Test failure: `test_experimental_permissions_migration_for_group_with_same_name` #1827