search

databrickslabs / ucx

Your best companion for upgrading to Unity Catalog. UCX will guide you, the Databricks customer, through the process of upgrading your account, groups, workspaces, jobs etc. to Unity Catalog.
Other
196 stars 70 forks source link

whitelist fasttext #2063

Closed ericvergnaud closed 1 week ago

ericvergnaud commented 1 week ago

Changes

whitelist fasttext

Linked issues

Progresses #1901

Functionality

None

Tests

github-actions[bot] commented 1 week ago

❌ 119/133 passed, 14 failed, 22 skipped, 6h26m12s total

❌ test_run_external_locations_using_access_connector: databricks.sdk.errors.platform.ResourceDoesNotExist: The specified pipeline 9bf17633-61ce-4ea0-b6c0-bc4bf93a3582 was not found. (1m8.257s) ``` databricks.sdk.errors.platform.ResourceDoesNotExist: The specified pipeline 9bf17633-61ce-4ea0-b6c0-bc4bf93a3582 was not found. [gw6] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 11:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/B4j3 11:08 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_spw6q: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_spw6q 11:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_spw6q', metastore_id=None, name='ucx_spw6q', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:09 WARNING [databricks.labs.ucx.CLOUD_ENV.credentials] There is an existing external location overlaps with the prefix that is mapped to the service principal and used for validating the migrated storage credential. Skip the validation 11:09 INFO [databricks.labs.ucx.CLOUD_ENV.credentials] Found 1 distinct service principals already used in UC storage credentials 11:09 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_spw6q.CLOUD_ENV_service_principals] fetching CLOUD_ENV_service_principals inventory 11:09 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_spw6q.CLOUD_ENV_service_principals] crawling new batch for CLOUD_ENV_service_principals 11:09 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:09 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:09 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:09 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:09 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:09 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:09 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:09 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:09 WARNING [databricks.labs.ucx.assessment.secrets] removed on the backend: reallyasecret123/sp_app_client_id 11:09 WARNING [databricks.labs.ucx.assessment.secrets] removed on the backend: reallyasecret123/sp_app_client_id 11:09 WARNING [databricks.labs.ucx.assessment.secrets] removed on the backend: reallyasecret123/sp_app_client_id 11:09 WARNING [databricks.labs.ucx.assessment.secrets] removed on the backend: reallyasecret123/sp_app_client_id 11:09 WARNING [databricks.labs.ucx.assessment.secrets] removed on the backend: reallyasecret123/sp_app_client_id 11:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/B4j3 11:08 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_spw6q: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_spw6q 11:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_spw6q', metastore_id=None, name='ucx_spw6q', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:09 WARNING [databricks.labs.ucx.CLOUD_ENV.credentials] There is an existing external location overlaps with the prefix that is mapped to the service principal and used for validating the migrated storage credential. Skip the validation 11:09 INFO [databricks.labs.ucx.CLOUD_ENV.credentials] Found 1 distinct service principals already used in UC storage credentials 11:09 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_spw6q.CLOUD_ENV_service_principals] fetching CLOUD_ENV_service_principals inventory 11:09 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_spw6q.CLOUD_ENV_service_principals] crawling new batch for CLOUD_ENV_service_principals 11:09 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:09 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:09 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:09 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:09 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:09 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:09 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:09 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:09 WARNING [databricks.labs.ucx.assessment.secrets] removed on the backend: reallyasecret123/sp_app_client_id 11:09 WARNING [databricks.labs.ucx.assessment.secrets] removed on the backend: reallyasecret123/sp_app_client_id 11:09 WARNING [databricks.labs.ucx.assessment.secrets] removed on the backend: reallyasecret123/sp_app_client_id 11:09 WARNING [databricks.labs.ucx.assessment.secrets] removed on the backend: reallyasecret123/sp_app_client_id 11:09 WARNING [databricks.labs.ucx.assessment.secrets] removed on the backend: reallyasecret123/sp_app_client_id 11:09 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_dbfs_data_copy fixtures 11:09 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/B4j3 11:09 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 cluster fixtures 11:09 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 schema fixtures 11:09 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_spw6q', metastore_id=None, name='ucx_spw6q', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw6] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```
❌ test_create_catalog_schema_with_principal_acl_CLOUD_ENV: AssertionError: assert PrivilegeAssignment(principal='sdk-hxy31kfe@example.com', privileges=[]) in [PrivilegeAssignment(principal='ucx_GQR8S', privileges=[]), PrivilegeAssignment(pr...>]), PrivilegeAssignment(principal='sdk-nqmy4tmo@example.com', privileges=[]), ...] (6m29.07s) ``` AssertionError: assert PrivilegeAssignment(principal='sdk-hxy31kfe@example.com', privileges=[]) in [PrivilegeAssignment(principal='ucx_GQR8S', privileges=[]), PrivilegeAssignment(pr...>]), PrivilegeAssignment(principal='sdk-nqmy4tmo@example.com', privileges=[]), ...] + where [PrivilegeAssignment(principal='ucx_GQR8S', privileges=[]), PrivilegeAssignment(pr...>]), PrivilegeAssignment(principal='sdk-nqmy4tmo@example.com', privileges=[]), ...] = PermissionsList(privilege_assignments=[PrivilegeAssignment(principal='ucx_GQR8S', privileges=[]), PrivilegeAssignment(principal='ucx_GqxcY', privileges=[])]).privilege_assignments 11:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/AbxN 11:08 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_skzbu: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_skzbu 11:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_skzbu', metastore_id=None, name='ucx_skzbu', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:08 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_skzbu.ucx_tl5d6: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_skzbu/ucx_tl5d6 11:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_skzbu.ucx_tl5d6', metastore_id=None, name='ucx_tl5d6', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070412'}, row_filter=None, schema_name='ucx_skzbu', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/AbxN', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720091301030, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cjvoi', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cjvoi', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720091301030, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 11:08 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cjvoi.ucx_skzbu: https://DATABRICKS_HOST/explore/data/ucx_cjvoi/ucx_skzbu 11:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cjvoi', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cjvoi.ucx_skzbu', metastore_id=None, name='ucx_skzbu', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw9] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 11:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/AbxN 11:08 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_skzbu: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_skzbu 11:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_skzbu', metastore_id=None, name='ucx_skzbu', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:08 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_skzbu.ucx_tl5d6: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_skzbu/ucx_tl5d6 11:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_skzbu.ucx_tl5d6', metastore_id=None, name='ucx_tl5d6', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070412'}, row_filter=None, schema_name='ucx_skzbu', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/AbxN', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720091301030, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cjvoi', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cjvoi', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720091301030, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 11:08 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cjvoi.ucx_skzbu: https://DATABRICKS_HOST/explore/data/ucx_cjvoi/ucx_skzbu 11:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cjvoi', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cjvoi.ucx_skzbu', metastore_id=None, name='ucx_skzbu', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: 11:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-jcr8zwau@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-jcr8zwau@example.com')], entitlements=[], external_id=None, groups=[], id='8348252556895208', name=Name(family_name=None, given_name='sdk-jcr8zwau@example.com'), roles=[], schemas=[, ], user_name='sdk-jcr8zwau@example.com') 11:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0704-110825-dz63dxdp [group_name admins CAN_MANAGE] -> [user_name sdk-jcr8zwau@example.com CAN_ATTACH_TO] 11:08 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_svepf: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_svepf 11:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_svepf', metastore_id=None, name='ucx_svepf', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:08 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:08 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:08 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:08 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:08 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:08 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Listing existing UC catalogs and schemas 11:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: 11:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-hxy31kfe@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-hxy31kfe@example.com')], entitlements=[], external_id=None, groups=[], id='224516851986212', name=Name(family_name=None, given_name='sdk-hxy31kfe@example.com'), roles=[], schemas=[, ], user_name='sdk-hxy31kfe@example.com') 11:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0704-110846-vq4jhou [group_name admins CAN_MANAGE] -> [user_name sdk-hxy31kfe@example.com CAN_ATTACH_TO] 11:08 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Listing existing UC catalogs and schemas 11:09 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Preparing a list of UC catalogs and schema to be created 11:09 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_svepf.tables] fetching tables inventory 11:09 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_svepf.tables] crawling new batch for tables 11:09 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_skzbu] listing tables 11:09 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_skzbu.ucx_tl5d6] fetching table metadata 11:09 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_svepf.tables] found 1 new records for tables 11:10 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cjvoi.ucx_skzbu') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cjvoi.ucx_skzbu TO `serge.smertin@databricks.com` 11:10 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cjvoi.ucx_skzbu') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cjvoi.ucx_skzbu TO `sdk-dfbfbu13@example.com` 11:11 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cjvoi.ucx_skzbu') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cjvoi.ucx_skzbu TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d` 11:11 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cjvoi.ucx_skzbu') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cjvoi.ucx_skzbu TO `sdk-jcr8zwau@example.com` 11:11 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cjvoi.ucx_skzbu') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cjvoi.ucx_skzbu TO `sdk-nqmy4tmo@example.com` 11:11 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cjvoi.ucx_skzbu') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cjvoi.ucx_skzbu TO `sdk-eusdvvmi@example.com` 11:11 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cjvoi.ucx_skzbu') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cjvoi.ucx_skzbu TO `ucx_GqxcY` 11:12 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cjvoi.ucx_skzbu') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cjvoi.ucx_skzbu TO `ucx_GQR8S` 11:12 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cjvoi') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cjvoi TO `sdk-dfbfbu13@example.com` 11:12 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cjvoi') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cjvoi TO `sdk-nqmy4tmo@example.com` 11:12 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cjvoi') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cjvoi TO `serge.smertin@databricks.com` 11:12 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cjvoi') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cjvoi TO `sdk-eusdvvmi@example.com` 11:12 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cjvoi') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cjvoi TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d` 11:13 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cjvoi') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cjvoi TO `ucx_GqxcY` 11:13 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cjvoi') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cjvoi TO `ucx_GQR8S` 11:13 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cjvoi') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cjvoi TO `sdk-jcr8zwau@example.com` 11:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/AbxN 11:08 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_skzbu: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_skzbu 11:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_skzbu', metastore_id=None, name='ucx_skzbu', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:08 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_skzbu.ucx_tl5d6: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_skzbu/ucx_tl5d6 11:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_skzbu.ucx_tl5d6', metastore_id=None, name='ucx_tl5d6', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070412'}, row_filter=None, schema_name='ucx_skzbu', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/AbxN', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720091301030, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cjvoi', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cjvoi', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720091301030, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 11:08 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cjvoi.ucx_skzbu: https://DATABRICKS_HOST/explore/data/ucx_cjvoi/ucx_skzbu 11:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cjvoi', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cjvoi.ucx_skzbu', metastore_id=None, name='ucx_skzbu', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: 11:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-jcr8zwau@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-jcr8zwau@example.com')], entitlements=[], external_id=None, groups=[], id='8348252556895208', name=Name(family_name=None, given_name='sdk-jcr8zwau@example.com'), roles=[], schemas=[, ], user_name='sdk-jcr8zwau@example.com') 11:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0704-110825-dz63dxdp [group_name admins CAN_MANAGE] -> [user_name sdk-jcr8zwau@example.com CAN_ATTACH_TO] 11:08 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_svepf: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_svepf 11:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_svepf', metastore_id=None, name='ucx_svepf', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:08 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:08 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:08 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:08 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:08 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:08 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Listing existing UC catalogs and schemas 11:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: 11:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-hxy31kfe@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-hxy31kfe@example.com')], entitlements=[], external_id=None, groups=[], id='224516851986212', name=Name(family_name=None, given_name='sdk-hxy31kfe@example.com'), roles=[], schemas=[, ], user_name='sdk-hxy31kfe@example.com') 11:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0704-110846-vq4jhou [group_name admins CAN_MANAGE] -> [user_name sdk-hxy31kfe@example.com CAN_ATTACH_TO] 11:08 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Listing existing UC catalogs and schemas 11:09 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Preparing a list of UC catalogs and schema to be created 11:09 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_svepf.tables] fetching tables inventory 11:09 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_svepf.tables] crawling new batch for tables 11:09 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_skzbu] listing tables 11:09 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_skzbu.ucx_tl5d6] fetching table metadata 11:09 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_svepf.tables] found 1 new records for tables 11:10 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cjvoi.ucx_skzbu') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cjvoi.ucx_skzbu TO `serge.smertin@databricks.com` 11:10 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cjvoi.ucx_skzbu') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cjvoi.ucx_skzbu TO `sdk-dfbfbu13@example.com` 11:11 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cjvoi.ucx_skzbu') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cjvoi.ucx_skzbu TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d` 11:11 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cjvoi.ucx_skzbu') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cjvoi.ucx_skzbu TO `sdk-jcr8zwau@example.com` 11:11 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cjvoi.ucx_skzbu') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cjvoi.ucx_skzbu TO `sdk-nqmy4tmo@example.com` 11:11 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cjvoi.ucx_skzbu') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cjvoi.ucx_skzbu TO `sdk-eusdvvmi@example.com` 11:11 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cjvoi.ucx_skzbu') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cjvoi.ucx_skzbu TO `ucx_GqxcY` 11:12 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cjvoi.ucx_skzbu') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cjvoi.ucx_skzbu TO `ucx_GQR8S` 11:12 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cjvoi') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cjvoi TO `sdk-dfbfbu13@example.com` 11:12 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cjvoi') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cjvoi TO `sdk-nqmy4tmo@example.com` 11:12 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cjvoi') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cjvoi TO `serge.smertin@databricks.com` 11:12 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cjvoi') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cjvoi TO `sdk-eusdvvmi@example.com` 11:12 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cjvoi') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cjvoi TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d` 11:13 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cjvoi') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cjvoi TO `ucx_GqxcY` 11:13 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cjvoi') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cjvoi TO `ucx_GQR8S` 11:13 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cjvoi') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cjvoi TO `sdk-jcr8zwau@example.com` 11:13 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 cluster permissions fixtures 11:13 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster permissions fixture: 0704-110825-dz63dxdp [group_name admins CAN_MANAGE] -> [user_name sdk-jcr8zwau@example.com CAN_ATTACH_TO] 11:14 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster permissions fixture: 0704-110846-vq4jhou [group_name admins CAN_MANAGE] -> [user_name sdk-hxy31kfe@example.com CAN_ATTACH_TO] 11:14 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 catalog fixtures 11:14 DEBUG [databricks.labs.ucx.mixins.fixtures] removing catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720091301030, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cjvoi', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cjvoi', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720091301030, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 11:14 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_dbfs_data_copy fixtures 11:14 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/AbxN 11:14 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 cluster fixtures 11:14 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster fixture: 11:14 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster fixture: 11:14 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures 11:14 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 11:14 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 table fixtures 11:14 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_skzbu.ucx_tl5d6', metastore_id=None, name='ucx_tl5d6', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070412'}, row_filter=None, schema_name='ucx_skzbu', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/AbxN', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:14 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 schema fixtures 11:14 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_skzbu', metastore_id=None, name='ucx_skzbu', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:14 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cjvoi', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cjvoi.ucx_skzbu', metastore_id=None, name='ucx_skzbu', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:14 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_svepf', metastore_id=None, name='ucx_svepf', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:14 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 workspace user fixtures 11:14 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='sdk-jcr8zwau@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-jcr8zwau@example.com')], entitlements=[], external_id=None, groups=[], id='8348252556895208', name=Name(family_name=None, given_name='sdk-jcr8zwau@example.com'), roles=[], schemas=[, ], user_name='sdk-jcr8zwau@example.com') 11:14 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='sdk-hxy31kfe@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-hxy31kfe@example.com')], entitlements=[], external_id=None, groups=[], id='224516851986212', name=Name(family_name=None, given_name='sdk-hxy31kfe@example.com'), roles=[], schemas=[, ], user_name='sdk-hxy31kfe@example.com') [gw9] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```
❌ test_migrate_table_in_mount: databricks.sdk.errors.platform.BadRequest: [SCHEMA_ALREADY_EXISTS] Cannot create schema `mounted_TEST_MOUNT_NAME` because it already exists. (35.617s) ``` databricks.sdk.errors.platform.BadRequest: [SCHEMA_ALREADY_EXISTS] Cannot create schema `mounted_TEST_MOUNT_NAME` because it already exists. Choose a different name, drop the existing schema, or add the IF NOT EXISTS clause to tolerate pre-existing schema. SQLSTATE: 42P06 11:31 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_ss0bp: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_ss0bp 11:31 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_ss0bp', metastore_id=None, name='ucx_ss0bp', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw0] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 11:31 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_ss0bp: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_ss0bp 11:31 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_ss0bp', metastore_id=None, name='ucx_ss0bp', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:31 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_ss0bp: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_ss0bp 11:31 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_ss0bp', metastore_id=None, name='ucx_ss0bp', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:32 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 account group fixtures 11:32 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures 11:32 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 11:32 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 11:32 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 catalog fixtures 11:32 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 schema fixtures 11:32 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_ss0bp', metastore_id=None, name='ucx_ss0bp', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw0] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```
❌ test_table_migration_job_refreshes_migration_status[hiveserde-migrate-external-tables-ctas]: TimeoutError: timed out after 0:20:00: (26m12.247s) ``` TimeoutError: timed out after 0:20:00: 11:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/bYpm 11:11 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.hiveserde_in_place_qspna: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_qspna 11:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.hiveserde_in_place_qspna', metastore_id=None, name='hiveserde_in_place_qspna', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_storage_dir fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_qspna 11:11 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_qspna.parquet_serde_qspna: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_qspna/parquet_serde_qspna 11:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_qspna.parquet_serde_qspna', metastore_id=None, name='parquet_serde_qspna', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070412'}, row_filter=None, schema_name='hiveserde_in_place_qspna', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_qspna/parquet_serde_qspna', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:11 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_qspna.orc_serde_qspna: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_qspna/orc_serde_qspna 11:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_qspna.orc_serde_qspna', metastore_id=None, name='orc_serde_qspna', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070412'}, row_filter=None, schema_name='hiveserde_in_place_qspna', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_qspna/orc_serde_qspna', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:12 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_qspna.avro_serde_qspna: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_qspna/avro_serde_qspna 11:12 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_qspna.avro_serde_qspna', metastore_id=None, name='avro_serde_qspna', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070412'}, row_filter=None, schema_name='hiveserde_in_place_qspna', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_qspna/avro_serde_qspna', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:12 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720091529707, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c2jer', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_c2jer', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720091529707, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 11:12 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_c2jer.hiveserde_in_place_qspna: https://DATABRICKS_HOST/explore/data/ucx_c2jer/hiveserde_in_place_qspna 11:12 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_c2jer', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c2jer.hiveserde_in_place_qspna', metastore_id=None, name='hiveserde_in_place_qspna', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:12 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sjcey: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sjcey 11:12 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sjcey', metastore_id=None, name='ucx_sjcey', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw3] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 11:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/bYpm 11:11 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.hiveserde_in_place_qspna: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_qspna 11:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.hiveserde_in_place_qspna', metastore_id=None, name='hiveserde_in_place_qspna', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_storage_dir fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_qspna 11:11 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_qspna.parquet_serde_qspna: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_qspna/parquet_serde_qspna 11:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_qspna.parquet_serde_qspna', metastore_id=None, name='parquet_serde_qspna', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070412'}, row_filter=None, schema_name='hiveserde_in_place_qspna', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_qspna/parquet_serde_qspna', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:11 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_qspna.orc_serde_qspna: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_qspna/orc_serde_qspna 11:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_qspna.orc_serde_qspna', metastore_id=None, name='orc_serde_qspna', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070412'}, row_filter=None, schema_name='hiveserde_in_place_qspna', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_qspna/orc_serde_qspna', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:12 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_qspna.avro_serde_qspna: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_qspna/avro_serde_qspna 11:12 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_qspna.avro_serde_qspna', metastore_id=None, name='avro_serde_qspna', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070412'}, row_filter=None, schema_name='hiveserde_in_place_qspna', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_qspna/avro_serde_qspna', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:12 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720091529707, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c2jer', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_c2jer', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720091529707, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 11:12 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_c2jer.hiveserde_in_place_qspna: https://DATABRICKS_HOST/explore/data/ucx_c2jer/hiveserde_in_place_qspna 11:12 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_c2jer', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c2jer.hiveserde_in_place_qspna', metastore_id=None, name='hiveserde_in_place_qspna', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:12 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sjcey: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sjcey 11:12 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sjcey', metastore_id=None, name='ucx_sjcey', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:14 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.lYit/config.yml) doesn't exist. 11:14 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 11:14 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 11:14 INFO [databricks.labs.ucx.install] Fetching installations... 11:14 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.lYit is corrupted. Skipping... 11:14 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 11:14 DEBUG [tests.integration.conftest] Waiting for clusters to start... 11:14 DEBUG [tests.integration.conftest] Waiting for clusters to start... 11:14 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+7820240704111431 11:14 INFO [databricks.labs.ucx.install] Creating ucx schemas... 11:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 11:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 11:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 11:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 11:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 11:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 11:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 11:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 11:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 11:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 11:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 11:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 11:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 11:16 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.lYit/README for the next steps. 11:16 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-external-tables-ctas job: https://DATABRICKS_HOST#job/377537411344946 11:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/bYpm 11:11 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.hiveserde_in_place_qspna: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_qspna 11:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.hiveserde_in_place_qspna', metastore_id=None, name='hiveserde_in_place_qspna', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_storage_dir fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_qspna 11:11 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_qspna.parquet_serde_qspna: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_qspna/parquet_serde_qspna 11:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_qspna.parquet_serde_qspna', metastore_id=None, name='parquet_serde_qspna', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070412'}, row_filter=None, schema_name='hiveserde_in_place_qspna', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_qspna/parquet_serde_qspna', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:11 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_qspna.orc_serde_qspna: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_qspna/orc_serde_qspna 11:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_qspna.orc_serde_qspna', metastore_id=None, name='orc_serde_qspna', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070412'}, row_filter=None, schema_name='hiveserde_in_place_qspna', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_qspna/orc_serde_qspna', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:12 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_qspna.avro_serde_qspna: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_qspna/avro_serde_qspna 11:12 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_qspna.avro_serde_qspna', metastore_id=None, name='avro_serde_qspna', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070412'}, row_filter=None, schema_name='hiveserde_in_place_qspna', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_qspna/avro_serde_qspna', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:12 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720091529707, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c2jer', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_c2jer', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720091529707, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 11:12 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_c2jer.hiveserde_in_place_qspna: https://DATABRICKS_HOST/explore/data/ucx_c2jer/hiveserde_in_place_qspna 11:12 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_c2jer', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c2jer.hiveserde_in_place_qspna', metastore_id=None, name='hiveserde_in_place_qspna', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:12 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sjcey: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sjcey 11:12 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sjcey', metastore_id=None, name='ucx_sjcey', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:14 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.lYit/config.yml) doesn't exist. 11:14 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 11:14 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 11:14 INFO [databricks.labs.ucx.install] Fetching installations... 11:14 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.lYit is corrupted. Skipping... 11:14 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 11:14 DEBUG [tests.integration.conftest] Waiting for clusters to start... 11:14 DEBUG [tests.integration.conftest] Waiting for clusters to start... 11:14 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+7820240704111431 11:14 INFO [databricks.labs.ucx.install] Creating ucx schemas... 11:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 11:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 11:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 11:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 11:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 11:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 11:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 11:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 11:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 11:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 11:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 11:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 11:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 11:16 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.lYit/README for the next steps. 11:16 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-external-tables-ctas job: https://DATABRICKS_HOST#job/377537411344946 11:36 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_storage_dir fixtures 11:36 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_storage_dir fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_qspna 11:36 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_dbfs_data_copy fixtures 11:36 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/bYpm 11:36 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 cluster fixtures 11:36 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 catalog fixtures 11:36 DEBUG [databricks.labs.ucx.mixins.fixtures] removing catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720091529707, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c2jer', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_c2jer', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720091529707, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 11:36 INFO [databricks.labs.ucx.install] Deleting UCX v0.27.2+7820240704111431 from https://DATABRICKS_HOST 11:36 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_sjcey 11:36 INFO [databricks.labs.ucx.install] Deleting jobs 11:36 INFO [databricks.labs.ucx.install] Deleting experimental-workflow-linter job_id=985773791956166. 11:36 INFO [databricks.labs.ucx.install] Deleting assessment job_id=578133426256508. 11:36 INFO [databricks.labs.ucx.install] Deleting migrate-external-hiveserde-tables-in-place-experimental job_id=1118736194577322. 11:36 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=1047003928451800. 11:36 INFO [databricks.labs.ucx.install] Deleting migrate-external-tables-ctas job_id=377537411344946. 11:36 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=659028433477073. 11:36 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=251767359897663. 11:36 INFO [databricks.labs.ucx.install] Deleting migrate-data-reconciliation job_id=603817505224868. 11:36 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=375851966703913. 11:36 INFO [databricks.labs.ucx.install] Deleting scan-tables-in-mounts-experimental job_id=738605080522223. 11:36 INFO [databricks.labs.ucx.install] Deleting failing job_id=222010469182722. 11:36 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=560030168195632. 11:36 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=330875643557737. 11:36 INFO [databricks.labs.ucx.install] Deleting cluster policy 11:36 INFO [databricks.labs.ucx.install] Deleting secret scope 11:36 INFO [databricks.labs.ucx.install] UnInstalling UCX complete 11:36 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace user fixtures 11:36 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 account group fixtures 11:36 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures 11:36 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 11:36 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 table fixtures 11:36 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_qspna.parquet_serde_qspna', metastore_id=None, name='parquet_serde_qspna', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070412'}, row_filter=None, schema_name='hiveserde_in_place_qspna', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_qspna/parquet_serde_qspna', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:36 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_qspna.orc_serde_qspna', metastore_id=None, name='orc_serde_qspna', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070412'}, row_filter=None, schema_name='hiveserde_in_place_qspna', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_qspna/orc_serde_qspna', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:37 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_qspna.avro_serde_qspna', metastore_id=None, name='avro_serde_qspna', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070412'}, row_filter=None, schema_name='hiveserde_in_place_qspna', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_qspna/avro_serde_qspna', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:37 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 schema fixtures 11:37 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.hiveserde_in_place_qspna', metastore_id=None, name='hiveserde_in_place_qspna', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:37 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_c2jer', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c2jer.hiveserde_in_place_qspna', metastore_id=None, name='hiveserde_in_place_qspna', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:37 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sjcey', metastore_id=None, name='ucx_sjcey', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw3] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```
❌ test_table_migration_job_refreshes_migration_status[regular-migrate-tables]: TimeoutError: Timed out after 0:05:00 (19m16.125s) ``` TimeoutError: Timed out after 0:05:00 11:21 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/oCiO 11:21 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.migrate_3e9ju: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_3e9ju 11:21 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_3e9ju', metastore_id=None, name='migrate_3e9ju', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:21 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_3e9ju.ucx_tkyb5: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_3e9ju/ucx_tkyb5 11:21 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_3e9ju.ucx_tkyb5', metastore_id=None, name='ucx_tkyb5', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070412'}, row_filter=None, schema_name='migrate_3e9ju', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_3e9ju/ucx_tkyb5', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:21 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_3e9ju.ucx_tfsud: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_3e9ju/ucx_tfsud 11:21 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_3e9ju.ucx_tfsud', metastore_id=None, name='ucx_tfsud', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070412'}, row_filter=None, schema_name='migrate_3e9ju', sql_path=None, storage_credential_name=None, storage_location='dbfs:/tmp/ucx_test_jqKb', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:21 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_3e9ju.ucx_t3pgh: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_3e9ju/ucx_t3pgh 11:21 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_3e9ju.ucx_t3pgh', metastore_id=None, name='ucx_t3pgh', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070412'}, row_filter=None, schema_name='migrate_3e9ju', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/oCiO', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:22 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_3e9ju.ucx_ticmw: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_3e9ju/ucx_ticmw 11:22 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_3e9ju.ucx_ticmw', metastore_id=None, name='ucx_ticmw', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070412'}, row_filter=None, schema_name='migrate_3e9ju', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_3e9ju.ucx_tkyb5', view_dependencies=None) 11:22 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_3e9ju.ucx_tv0no: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_3e9ju/ucx_tv0no 11:22 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_3e9ju.ucx_tv0no', metastore_id=None, name='ucx_tv0no', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070412'}, row_filter=None, schema_name='migrate_3e9ju', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_3e9ju.ucx_ticmw', view_dependencies=None) 11:22 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720092137862, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c129k', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_c129k', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720092137862, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 11:22 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_c129k.migrate_3e9ju: https://DATABRICKS_HOST/explore/data/ucx_c129k/migrate_3e9ju 11:22 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_c129k', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c129k.migrate_3e9ju', metastore_id=None, name='migrate_3e9ju', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:23 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sqfuh: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sqfuh 11:23 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sqfuh', metastore_id=None, name='ucx_sqfuh', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw2] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 11:21 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/oCiO 11:21 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.migrate_3e9ju: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_3e9ju 11:21 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_3e9ju', metastore_id=None, name='migrate_3e9ju', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:21 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_3e9ju.ucx_tkyb5: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_3e9ju/ucx_tkyb5 11:21 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_3e9ju.ucx_tkyb5', metastore_id=None, name='ucx_tkyb5', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070412'}, row_filter=None, schema_name='migrate_3e9ju', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_3e9ju/ucx_tkyb5', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:21 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_3e9ju.ucx_tfsud: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_3e9ju/ucx_tfsud 11:21 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_3e9ju.ucx_tfsud', metastore_id=None, name='ucx_tfsud', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070412'}, row_filter=None, schema_name='migrate_3e9ju', sql_path=None, storage_credential_name=None, storage_location='dbfs:/tmp/ucx_test_jqKb', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:21 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_3e9ju.ucx_t3pgh: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_3e9ju/ucx_t3pgh 11:21 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_3e9ju.ucx_t3pgh', metastore_id=None, name='ucx_t3pgh', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070412'}, row_filter=None, schema_name='migrate_3e9ju', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/oCiO', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:22 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_3e9ju.ucx_ticmw: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_3e9ju/ucx_ticmw 11:22 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_3e9ju.ucx_ticmw', metastore_id=None, name='ucx_ticmw', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070412'}, row_filter=None, schema_name='migrate_3e9ju', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_3e9ju.ucx_tkyb5', view_dependencies=None) 11:22 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_3e9ju.ucx_tv0no: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_3e9ju/ucx_tv0no 11:22 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_3e9ju.ucx_tv0no', metastore_id=None, name='ucx_tv0no', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070412'}, row_filter=None, schema_name='migrate_3e9ju', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_3e9ju.ucx_ticmw', view_dependencies=None) 11:22 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720092137862, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c129k', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_c129k', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720092137862, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 11:22 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_c129k.migrate_3e9ju: https://DATABRICKS_HOST/explore/data/ucx_c129k/migrate_3e9ju 11:22 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_c129k', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c129k.migrate_3e9ju', metastore_id=None, name='migrate_3e9ju', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:23 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sqfuh: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sqfuh 11:23 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sqfuh', metastore_id=None, name='ucx_sqfuh', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:24 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.EMWk/config.yml) doesn't exist. 11:24 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 11:24 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 11:24 INFO [databricks.labs.ucx.install] Fetching installations... 11:24 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.EMWk is corrupted. Skipping... 11:24 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 11:24 DEBUG [tests.integration.conftest] Waiting for clusters to start... 11:24 DEBUG [tests.integration.conftest] Waiting for clusters to start... 11:26 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+7820240704112600 11:26 INFO [databricks.labs.ucx.install] Creating ucx schemas... 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 11:27 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.EMWk/README for the next steps. 11:27 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-tables job: https://DATABRICKS_HOST#job/531140761216011 11:21 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/oCiO 11:21 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.migrate_3e9ju: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_3e9ju 11:21 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_3e9ju', metastore_id=None, name='migrate_3e9ju', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:21 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_3e9ju.ucx_tkyb5: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_3e9ju/ucx_tkyb5 11:21 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_3e9ju.ucx_tkyb5', metastore_id=None, name='ucx_tkyb5', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070412'}, row_filter=None, schema_name='migrate_3e9ju', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_3e9ju/ucx_tkyb5', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:21 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_3e9ju.ucx_tfsud: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_3e9ju/ucx_tfsud 11:21 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_3e9ju.ucx_tfsud', metastore_id=None, name='ucx_tfsud', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070412'}, row_filter=None, schema_name='migrate_3e9ju', sql_path=None, storage_credential_name=None, storage_location='dbfs:/tmp/ucx_test_jqKb', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:21 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_3e9ju.ucx_t3pgh: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_3e9ju/ucx_t3pgh 11:21 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_3e9ju.ucx_t3pgh', metastore_id=None, name='ucx_t3pgh', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070412'}, row_filter=None, schema_name='migrate_3e9ju', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/oCiO', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:22 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_3e9ju.ucx_ticmw: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_3e9ju/ucx_ticmw 11:22 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_3e9ju.ucx_ticmw', metastore_id=None, name='ucx_ticmw', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070412'}, row_filter=None, schema_name='migrate_3e9ju', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_3e9ju.ucx_tkyb5', view_dependencies=None) 11:22 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_3e9ju.ucx_tv0no: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_3e9ju/ucx_tv0no 11:22 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_3e9ju.ucx_tv0no', metastore_id=None, name='ucx_tv0no', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070412'}, row_filter=None, schema_name='migrate_3e9ju', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_3e9ju.ucx_ticmw', view_dependencies=None) 11:22 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720092137862, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c129k', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_c129k', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720092137862, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 11:22 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_c129k.migrate_3e9ju: https://DATABRICKS_HOST/explore/data/ucx_c129k/migrate_3e9ju 11:22 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_c129k', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c129k.migrate_3e9ju', metastore_id=None, name='migrate_3e9ju', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:23 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sqfuh: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sqfuh 11:23 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sqfuh', metastore_id=None, name='ucx_sqfuh', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:24 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.EMWk/config.yml) doesn't exist. 11:24 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 11:24 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 11:24 INFO [databricks.labs.ucx.install] Fetching installations... 11:24 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.EMWk is corrupted. Skipping... 11:24 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 11:24 DEBUG [tests.integration.conftest] Waiting for clusters to start... 11:24 DEBUG [tests.integration.conftest] Waiting for clusters to start... 11:26 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+7820240704112600 11:26 INFO [databricks.labs.ucx.install] Creating ucx schemas... 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 11:27 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.EMWk/README for the next steps. 11:27 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-tables job: https://DATABRICKS_HOST#job/531140761216011 11:38 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 make_storage_dir fixtures 11:38 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_dbfs_data_copy fixtures 11:38 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/oCiO 11:38 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 cluster fixtures 11:38 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 catalog fixtures 11:38 DEBUG [databricks.labs.ucx.mixins.fixtures] removing catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720092137862, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c129k', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_c129k', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720092137862, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 11:38 INFO [databricks.labs.ucx.install] Deleting UCX v0.27.2+7820240704112600 from https://DATABRICKS_HOST 11:38 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_sqfuh 11:38 INFO [databricks.labs.ucx.install] Deleting jobs 11:38 INFO [databricks.labs.ucx.install] Deleting migrate-external-hiveserde-tables-in-place-experimental job_id=959501634463168. 11:38 INFO [databricks.labs.ucx.install] Deleting migrate-data-reconciliation job_id=881744347810963. 11:38 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=1042508755852188. 11:38 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=667346736010210. 11:38 INFO [databricks.labs.ucx.install] Deleting experimental-workflow-linter job_id=552282259702533. 11:38 INFO [databricks.labs.ucx.install] Deleting scan-tables-in-mounts-experimental job_id=750336000608092. 11:38 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=1087974429171627. 11:38 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=416978412900476. 11:38 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=531140761216011. 11:38 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=19238584743626. 11:38 INFO [databricks.labs.ucx.install] Deleting failing job_id=1071653821491135. 11:38 INFO [databricks.labs.ucx.install] Deleting migrate-external-tables-ctas job_id=359219267292439. 11:38 INFO [databricks.labs.ucx.install] Deleting assessment job_id=498300467849265. 11:38 INFO [databricks.labs.ucx.install] Deleting cluster policy 11:38 INFO [databricks.labs.ucx.install] Deleting secret scope 11:38 INFO [databricks.labs.ucx.install] UnInstalling UCX complete 11:38 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace user fixtures 11:38 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 account group fixtures 11:38 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures 11:38 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 11:38 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 5 table fixtures 11:38 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_3e9ju.ucx_tkyb5', metastore_id=None, name='ucx_tkyb5', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070412'}, row_filter=None, schema_name='migrate_3e9ju', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_3e9ju/ucx_tkyb5', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:38 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_3e9ju.ucx_tfsud', metastore_id=None, name='ucx_tfsud', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070412'}, row_filter=None, schema_name='migrate_3e9ju', sql_path=None, storage_credential_name=None, storage_location='dbfs:/tmp/ucx_test_jqKb', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:39 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_3e9ju.ucx_t3pgh', metastore_id=None, name='ucx_t3pgh', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070412'}, row_filter=None, schema_name='migrate_3e9ju', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/oCiO', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:39 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_3e9ju.ucx_ticmw', metastore_id=None, name='ucx_ticmw', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070412'}, row_filter=None, schema_name='migrate_3e9ju', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_3e9ju.ucx_tkyb5', view_dependencies=None) 11:39 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while table TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_3e9ju.ucx_ticmw', metastore_id=None, name='ucx_ticmw', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070412'}, row_filter=None, schema_name='migrate_3e9ju', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_3e9ju.ucx_tkyb5', view_dependencies=None) teardown: [WRONG_COMMAND_FOR_OBJECT_TYPE] The operation DROP TABLE requires a EXTERNAL or MANAGED. But hive_metastore.migrate_3e9ju.ucx_ticmw is a VIEW. Use DROP VIEW instead. SQLSTATE: 42809 11:39 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_3e9ju.ucx_tv0no', metastore_id=None, name='ucx_tv0no', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070412'}, row_filter=None, schema_name='migrate_3e9ju', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_3e9ju.ucx_ticmw', view_dependencies=None) 11:39 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while table TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_3e9ju.ucx_tv0no', metastore_id=None, name='ucx_tv0no', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070412'}, row_filter=None, schema_name='migrate_3e9ju', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_3e9ju.ucx_ticmw', view_dependencies=None) teardown: [WRONG_COMMAND_FOR_OBJECT_TYPE] The operation DROP TABLE requires a EXTERNAL or MANAGED. But hive_metastore.migrate_3e9ju.ucx_tv0no is a VIEW. Use DROP VIEW instead. SQLSTATE: 42809 11:39 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 schema fixtures 11:39 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_3e9ju', metastore_id=None, name='migrate_3e9ju', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:39 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_c129k', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c129k.migrate_3e9ju', metastore_id=None, name='migrate_3e9ju', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:40 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sqfuh', metastore_id=None, name='ucx_sqfuh', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw2] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```
❌ test_running_real_workflow_linter_job: TimeoutError: timed out after 0:20:00: (22m10.128s) ``` TimeoutError: timed out after 0:20:00: [gw4] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 11:20 DEBUG [databricks.labs.ucx.mixins.fixtures] added directory fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-HmLP 11:20 DEBUG [databricks.labs.ucx.mixins.fixtures] added notebook fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-HmLP/notebook.ipynb 11:20 INFO [databricks.labs.ucx.mixins.fixtures] Job: https://DATABRICKS_HOST#job/891460399056494 11:20 DEBUG [databricks.labs.ucx.mixins.fixtures] added job fixture: CreateResponse(job_id=891460399056494) 11:20 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sf8g5: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sf8g5 11:20 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sf8g5', metastore_id=None, name='ucx_sf8g5', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:20 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.I5i9/config.yml) doesn't exist. 11:20 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 11:20 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 11:20 INFO [databricks.labs.ucx.install] Fetching installations... 11:21 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 11:21 DEBUG [tests.integration.conftest] Waiting for clusters to start... 11:21 DEBUG [tests.integration.conftest] Waiting for clusters to start... 11:21 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+7820240704112104 11:21 INFO [databricks.labs.ucx.install] Creating ucx schemas... 11:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 11:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 11:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 11:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 11:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 11:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 11:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 11:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 11:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 11:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 11:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 11:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 11:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 11:22 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.I5i9/README for the next steps. 11:22 DEBUG [databricks.labs.ucx.installer.workflows] starting experimental-workflow-linter job: https://DATABRICKS_HOST#job/26204220351421 11:20 DEBUG [databricks.labs.ucx.mixins.fixtures] added directory fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-HmLP 11:20 DEBUG [databricks.labs.ucx.mixins.fixtures] added notebook fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-HmLP/notebook.ipynb 11:20 INFO [databricks.labs.ucx.mixins.fixtures] Job: https://DATABRICKS_HOST#job/891460399056494 11:20 DEBUG [databricks.labs.ucx.mixins.fixtures] added job fixture: CreateResponse(job_id=891460399056494) 11:20 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sf8g5: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sf8g5 11:20 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sf8g5', metastore_id=None, name='ucx_sf8g5', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:20 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.I5i9/config.yml) doesn't exist. 11:20 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 11:20 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 11:20 INFO [databricks.labs.ucx.install] Fetching installations... 11:21 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 11:21 DEBUG [tests.integration.conftest] Waiting for clusters to start... 11:21 DEBUG [tests.integration.conftest] Waiting for clusters to start... 11:21 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+7820240704112104 11:21 INFO [databricks.labs.ucx.install] Creating ucx schemas... 11:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 11:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 11:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 11:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 11:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 11:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 11:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 11:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 11:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 11:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 11:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 11:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 11:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 11:22 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.I5i9/README for the next steps. 11:22 DEBUG [databricks.labs.ucx.installer.workflows] starting experimental-workflow-linter job: https://DATABRICKS_HOST#job/26204220351421 11:42 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 job fixtures 11:42 DEBUG [databricks.labs.ucx.mixins.fixtures] removing job fixture: CreateResponse(job_id=891460399056494) 11:42 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 directory fixtures 11:42 DEBUG [databricks.labs.ucx.mixins.fixtures] removing directory fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-HmLP 11:42 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 notebook fixtures 11:42 DEBUG [databricks.labs.ucx.mixins.fixtures] removing notebook fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-HmLP/notebook.ipynb 11:42 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while notebook /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-HmLP/notebook.ipynb teardown: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-HmLP/notebook.ipynb) doesn't exist. 11:42 INFO [databricks.labs.ucx.install] Deleting UCX v0.27.2+7820240704112104 from https://DATABRICKS_HOST 11:42 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_sf8g5 11:42 INFO [databricks.labs.ucx.install] Deleting jobs 11:42 INFO [databricks.labs.ucx.install] Deleting assessment job_id=638559805032992. 11:42 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=1011429453121056. 11:42 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=366925002220664. 11:42 INFO [databricks.labs.ucx.install] Deleting experimental-workflow-linter job_id=26204220351421. 11:42 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=54977038308889. 11:42 INFO [databricks.labs.ucx.install] Deleting migrate-external-tables-ctas job_id=88963596049135. 11:42 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=113576880799747. 11:42 INFO [databricks.labs.ucx.install] Deleting migrate-data-reconciliation job_id=812910072810462. 11:42 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=1026028081011238. 11:42 INFO [databricks.labs.ucx.install] Deleting migrate-external-hiveserde-tables-in-place-experimental job_id=253388615798496. 11:42 INFO [databricks.labs.ucx.install] Deleting failing job_id=1075199099664535. 11:42 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=14101323339319. 11:42 INFO [databricks.labs.ucx.install] Deleting scan-tables-in-mounts-experimental job_id=234383507447090. 11:42 INFO [databricks.labs.ucx.install] Deleting cluster policy 11:42 INFO [databricks.labs.ucx.install] Deleting secret scope 11:42 INFO [databricks.labs.ucx.install] UnInstalling UCX complete 11:42 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace user fixtures 11:42 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 account group fixtures 11:42 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures 11:42 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 11:42 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 11:42 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 schema fixtures 11:42 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sf8g5', metastore_id=None, name='ucx_sf8g5', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw4] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```
❌ test_clusters[True]: databricks.labs.blueprint.parallel.ManyError: Detected 1 failures: NotImplemented: Permission migration API is not enabled for workspace: 7342989205138882 (30.437s) ``` databricks.labs.blueprint.parallel.ManyError: Detected 1 failures: NotImplemented: Permission migration API is not enabled for workspace: 7342989205138882 11:47 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group sdk-AVGD: https://DATABRICKS_HOST#setting/accounts/groups/153490191460328 11:47 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='sdk-AVGD', entitlements=[], external_id=None, groups=[], id='153490191460328', members=[], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 11:47 INFO [databricks.labs.ucx.mixins.fixtures] Account group sdk-ZYdF: https://accounts.CLOUD_ENVdatabricks.net/users/groups/311750035064753/members 11:47 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='sdk-ZYdF', entitlements=[], external_id=None, groups=[], id='311750035064753', members=[], meta=None, roles=[], schemas=[]) [gw4] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 11:47 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group sdk-AVGD: https://DATABRICKS_HOST#setting/accounts/groups/153490191460328 11:47 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='sdk-AVGD', entitlements=[], external_id=None, groups=[], id='153490191460328', members=[], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 11:47 INFO [databricks.labs.ucx.mixins.fixtures] Account group sdk-ZYdF: https://accounts.CLOUD_ENVdatabricks.net/users/groups/311750035064753/members 11:47 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='sdk-ZYdF', entitlements=[], external_id=None, groups=[], id='311750035064753', members=[], meta=None, roles=[], schemas=[]) 11:47 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: 11:47 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0704-114716-erd1i02p [group_name admins CAN_MANAGE] -> [group_name sdk-AVGD CAN_MANAGE] 11:47 INFO [databricks.labs.ucx.workspace_access.groups] Migrating permissions for 1 account groups. 11:47 INFO [databricks.labs.ucx.workspace_access.groups] Migrating permissions: sdk-AVGD (workspace) -> sdk-ZYdF (account) starting 11:47 ERROR [databricks.labs.ucx.workspace_access.groups] Migration of group permissions failed: sdk-AVGD (workspace) -> sdk-ZYdF (account) Traceback (most recent call last): File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 115, in _apply_to_groups group_permissions = self._migrate_group_permissions_paginated(ws, name_in_workspace, name_in_account) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 138, in _migrate_group_permissions_paginated result = ws.permission_migration.migrate_permissions( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/iam.py", line 2533, in migrate_permissions res = self._api.do('POST', '/api/2.0/permissionmigration', body=body, headers=headers) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 153, in do response = retryable(self._perform)(method, File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 264, in _perform raise self._make_nicer_error(response=response, **payload) from None databricks.sdk.errors.platform.NotImplemented: Permission migration API is not enabled for workspace: 7342989205138882 11:47 INFO [databricks.labs.ucx.workspace_access.groups] Migrated 0 permissions for 0/1 groups successfully. 11:47 ERROR [databricks.labs.ucx.workspace_access.groups] Migrating permissions failed for 1/1 groups. 11:47 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group sdk-AVGD: https://DATABRICKS_HOST#setting/accounts/groups/153490191460328 11:47 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='sdk-AVGD', entitlements=[], external_id=None, groups=[], id='153490191460328', members=[], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 11:47 INFO [databricks.labs.ucx.mixins.fixtures] Account group sdk-ZYdF: https://accounts.CLOUD_ENVdatabricks.net/users/groups/311750035064753/members 11:47 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='sdk-ZYdF', entitlements=[], external_id=None, groups=[], id='311750035064753', members=[], meta=None, roles=[], schemas=[]) 11:47 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: 11:47 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0704-114716-erd1i02p [group_name admins CAN_MANAGE] -> [group_name sdk-AVGD CAN_MANAGE] 11:47 INFO [databricks.labs.ucx.workspace_access.groups] Migrating permissions for 1 account groups. 11:47 INFO [databricks.labs.ucx.workspace_access.groups] Migrating permissions: sdk-AVGD (workspace) -> sdk-ZYdF (account) starting 11:47 ERROR [databricks.labs.ucx.workspace_access.groups] Migration of group permissions failed: sdk-AVGD (workspace) -> sdk-ZYdF (account) Traceback (most recent call last): File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 115, in _apply_to_groups group_permissions = self._migrate_group_permissions_paginated(ws, name_in_workspace, name_in_account) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 138, in _migrate_group_permissions_paginated result = ws.permission_migration.migrate_permissions( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/iam.py", line 2533, in migrate_permissions res = self._api.do('POST', '/api/2.0/permissionmigration', body=body, headers=headers) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 153, in do response = retryable(self._perform)(method, File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 264, in _perform raise self._make_nicer_error(response=response, **payload) from None databricks.sdk.errors.platform.NotImplemented: Permission migration API is not enabled for workspace: 7342989205138882 11:47 INFO [databricks.labs.ucx.workspace_access.groups] Migrated 0 permissions for 0/1 groups successfully. 11:47 ERROR [databricks.labs.ucx.workspace_access.groups] Migrating permissions failed for 1/1 groups. 11:47 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster permissions fixtures 11:47 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster permissions fixture: 0704-114716-erd1i02p [group_name admins CAN_MANAGE] -> [group_name sdk-AVGD CAN_MANAGE] 11:47 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster fixtures 11:47 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster fixture: 11:47 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 account group fixtures 11:47 DEBUG [databricks.labs.ucx.mixins.fixtures] removing account group fixture: Group(display_name='sdk-ZYdF', entitlements=[], external_id=None, groups=[], id='311750035064753', members=[], meta=None, roles=[], schemas=[]) 11:47 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace group fixtures 11:47 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace group fixture: Group(display_name='sdk-AVGD', entitlements=[], external_id=None, groups=[], id='153490191460328', members=[], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) [gw4] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```
❌ test_jobs[True]: databricks.labs.blueprint.parallel.ManyError: Detected 1 failures: NotImplemented: Permission migration API is not enabled for workspace: 7342989205138882 (9.778s) ``` databricks.labs.blueprint.parallel.ManyError: Detected 1 failures: NotImplemented: Permission migration API is not enabled for workspace: 7342989205138882 11:48 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group sdk-Eyv2: https://DATABRICKS_HOST#setting/accounts/groups/41683601062373 11:48 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='sdk-Eyv2', entitlements=[], external_id=None, groups=[], id='41683601062373', members=[], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 11:48 INFO [databricks.labs.ucx.mixins.fixtures] Account group sdk-y0a8: https://accounts.CLOUD_ENVdatabricks.net/users/groups/715899761245574/members 11:48 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='sdk-y0a8', entitlements=[], external_id=None, groups=[], id='715899761245574', members=[], meta=None, roles=[], schemas=[]) [gw4] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 11:48 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group sdk-Eyv2: https://DATABRICKS_HOST#setting/accounts/groups/41683601062373 11:48 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='sdk-Eyv2', entitlements=[], external_id=None, groups=[], id='41683601062373', members=[], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 11:48 INFO [databricks.labs.ucx.mixins.fixtures] Account group sdk-y0a8: https://accounts.CLOUD_ENVdatabricks.net/users/groups/715899761245574/members 11:48 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='sdk-y0a8', entitlements=[], external_id=None, groups=[], id='715899761245574', members=[], meta=None, roles=[], schemas=[]) 11:48 DEBUG [databricks.labs.ucx.mixins.fixtures] added notebook fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-4GSU 11:48 INFO [databricks.labs.ucx.mixins.fixtures] Job: https://DATABRICKS_HOST#job/832990276334966 11:48 DEBUG [databricks.labs.ucx.mixins.fixtures] added job fixture: CreateResponse(job_id=832990276334966) 11:48 DEBUG [databricks.labs.ucx.mixins.fixtures] added job permissions fixture: 832990276334966 [group_name admins CAN_MANAGE] -> [group_name sdk-Eyv2 CAN_MANAGE] 11:48 INFO [databricks.labs.ucx.workspace_access.groups] Migrating permissions for 1 account groups. 11:48 INFO [databricks.labs.ucx.workspace_access.groups] Migrating permissions: sdk-Eyv2 (workspace) -> sdk-y0a8 (account) starting 11:48 ERROR [databricks.labs.ucx.workspace_access.groups] Migration of group permissions failed: sdk-Eyv2 (workspace) -> sdk-y0a8 (account) Traceback (most recent call last): File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 115, in _apply_to_groups group_permissions = self._migrate_group_permissions_paginated(ws, name_in_workspace, name_in_account) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 138, in _migrate_group_permissions_paginated result = ws.permission_migration.migrate_permissions( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/iam.py", line 2533, in migrate_permissions res = self._api.do('POST', '/api/2.0/permissionmigration', body=body, headers=headers) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 153, in do response = retryable(self._perform)(method, File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 264, in _perform raise self._make_nicer_error(response=response, **payload) from None databricks.sdk.errors.platform.NotImplemented: Permission migration API is not enabled for workspace: 7342989205138882 11:48 INFO [databricks.labs.ucx.workspace_access.groups] Migrated 0 permissions for 0/1 groups successfully. 11:48 ERROR [databricks.labs.ucx.workspace_access.groups] Migrating permissions failed for 1/1 groups. 11:48 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group sdk-Eyv2: https://DATABRICKS_HOST#setting/accounts/groups/41683601062373 11:48 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='sdk-Eyv2', entitlements=[], external_id=None, groups=[], id='41683601062373', members=[], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 11:48 INFO [databricks.labs.ucx.mixins.fixtures] Account group sdk-y0a8: https://accounts.CLOUD_ENVdatabricks.net/users/groups/715899761245574/members 11:48 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='sdk-y0a8', entitlements=[], external_id=None, groups=[], id='715899761245574', members=[], meta=None, roles=[], schemas=[]) 11:48 DEBUG [databricks.labs.ucx.mixins.fixtures] added notebook fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-4GSU 11:48 INFO [databricks.labs.ucx.mixins.fixtures] Job: https://DATABRICKS_HOST#job/832990276334966 11:48 DEBUG [databricks.labs.ucx.mixins.fixtures] added job fixture: CreateResponse(job_id=832990276334966) 11:48 DEBUG [databricks.labs.ucx.mixins.fixtures] added job permissions fixture: 832990276334966 [group_name admins CAN_MANAGE] -> [group_name sdk-Eyv2 CAN_MANAGE] 11:48 INFO [databricks.labs.ucx.workspace_access.groups] Migrating permissions for 1 account groups. 11:48 INFO [databricks.labs.ucx.workspace_access.groups] Migrating permissions: sdk-Eyv2 (workspace) -> sdk-y0a8 (account) starting 11:48 ERROR [databricks.labs.ucx.workspace_access.groups] Migration of group permissions failed: sdk-Eyv2 (workspace) -> sdk-y0a8 (account) Traceback (most recent call last): File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 115, in _apply_to_groups group_permissions = self._migrate_group_permissions_paginated(ws, name_in_workspace, name_in_account) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 138, in _migrate_group_permissions_paginated result = ws.permission_migration.migrate_permissions( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/iam.py", line 2533, in migrate_permissions res = self._api.do('POST', '/api/2.0/permissionmigration', body=body, headers=headers) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 153, in do response = retryable(self._perform)(method, File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 264, in _perform raise self._make_nicer_error(response=response, **payload) from None databricks.sdk.errors.platform.NotImplemented: Permission migration API is not enabled for workspace: 7342989205138882 11:48 INFO [databricks.labs.ucx.workspace_access.groups] Migrated 0 permissions for 0/1 groups successfully. 11:48 ERROR [databricks.labs.ucx.workspace_access.groups] Migrating permissions failed for 1/1 groups. 11:48 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 job permissions fixtures 11:48 DEBUG [databricks.labs.ucx.mixins.fixtures] removing job permissions fixture: 832990276334966 [group_name admins CAN_MANAGE] -> [group_name sdk-Eyv2 CAN_MANAGE] 11:48 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while job permissions 832990276334966 [group_name admins CAN_MANAGE] -> [group_name sdk-Eyv2 CAN_MANAGE] teardown: The job must have exactly one owner. 11:48 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 job fixtures 11:48 DEBUG [databricks.labs.ucx.mixins.fixtures] removing job fixture: CreateResponse(job_id=832990276334966) 11:48 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 notebook fixtures 11:48 DEBUG [databricks.labs.ucx.mixins.fixtures] removing notebook fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-4GSU 11:48 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 account group fixtures 11:48 DEBUG [databricks.labs.ucx.mixins.fixtures] removing account group fixture: Group(display_name='sdk-y0a8', entitlements=[], external_id=None, groups=[], id='715899761245574', members=[], meta=None, roles=[], schemas=[]) 11:48 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace group fixtures 11:48 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace group fixture: Group(display_name='sdk-Eyv2', entitlements=[], external_id=None, groups=[], id='41683601062373', members=[], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) [gw4] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```
❌ test_pipelines[True]: databricks.labs.blueprint.parallel.ManyError: Detected 1 failures: NotImplemented: Permission migration API is not enabled for workspace: 7342989205138882 (9.663s) ``` databricks.labs.blueprint.parallel.ManyError: Detected 1 failures: NotImplemented: Permission migration API is not enabled for workspace: 7342989205138882 11:49 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group sdk-2wPb: https://DATABRICKS_HOST#setting/accounts/groups/709224643848749 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='sdk-2wPb', entitlements=[], external_id=None, groups=[], id='709224643848749', members=[], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 11:49 INFO [databricks.labs.ucx.mixins.fixtures] Account group sdk-ZD8z: https://accounts.CLOUD_ENVdatabricks.net/users/groups/254615983818732/members 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='sdk-ZD8z', entitlements=[], external_id=None, groups=[], id='254615983818732', members=[], meta=None, roles=[], schemas=[]) [gw4] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 11:49 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group sdk-2wPb: https://DATABRICKS_HOST#setting/accounts/groups/709224643848749 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='sdk-2wPb', entitlements=[], external_id=None, groups=[], id='709224643848749', members=[], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 11:49 INFO [databricks.labs.ucx.mixins.fixtures] Account group sdk-ZD8z: https://accounts.CLOUD_ENVdatabricks.net/users/groups/254615983818732/members 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='sdk-ZD8z', entitlements=[], external_id=None, groups=[], id='254615983818732', members=[], meta=None, roles=[], schemas=[]) 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added notebook fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-VCWY 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added delta live table fixture: CreatePipelineResponse(effective_settings=None, pipeline_id='17720e5e-475d-49a0-8a3b-5204ac28e2dd') 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added pipeline permissions fixture: 17720e5e-475d-49a0-8a3b-5204ac28e2dd [group_name admins CAN_MANAGE] -> [group_name sdk-2wPb CAN_MANAGE] 11:49 INFO [databricks.labs.ucx.workspace_access.groups] Migrating permissions for 1 account groups. 11:49 INFO [databricks.labs.ucx.workspace_access.groups] Migrating permissions: sdk-2wPb (workspace) -> sdk-ZD8z (account) starting 11:49 ERROR [databricks.labs.ucx.workspace_access.groups] Migration of group permissions failed: sdk-2wPb (workspace) -> sdk-ZD8z (account) Traceback (most recent call last): File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 115, in _apply_to_groups group_permissions = self._migrate_group_permissions_paginated(ws, name_in_workspace, name_in_account) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 138, in _migrate_group_permissions_paginated result = ws.permission_migration.migrate_permissions( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/iam.py", line 2533, in migrate_permissions res = self._api.do('POST', '/api/2.0/permissionmigration', body=body, headers=headers) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 153, in do response = retryable(self._perform)(method, File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 264, in _perform raise self._make_nicer_error(response=response, **payload) from None databricks.sdk.errors.platform.NotImplemented: Permission migration API is not enabled for workspace: 7342989205138882 11:49 INFO [databricks.labs.ucx.workspace_access.groups] Migrated 0 permissions for 0/1 groups successfully. 11:49 ERROR [databricks.labs.ucx.workspace_access.groups] Migrating permissions failed for 1/1 groups. 11:49 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group sdk-2wPb: https://DATABRICKS_HOST#setting/accounts/groups/709224643848749 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='sdk-2wPb', entitlements=[], external_id=None, groups=[], id='709224643848749', members=[], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 11:49 INFO [databricks.labs.ucx.mixins.fixtures] Account group sdk-ZD8z: https://accounts.CLOUD_ENVdatabricks.net/users/groups/254615983818732/members 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='sdk-ZD8z', entitlements=[], external_id=None, groups=[], id='254615983818732', members=[], meta=None, roles=[], schemas=[]) 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added notebook fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-VCWY 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added delta live table fixture: CreatePipelineResponse(effective_settings=None, pipeline_id='17720e5e-475d-49a0-8a3b-5204ac28e2dd') 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added pipeline permissions fixture: 17720e5e-475d-49a0-8a3b-5204ac28e2dd [group_name admins CAN_MANAGE] -> [group_name sdk-2wPb CAN_MANAGE] 11:49 INFO [databricks.labs.ucx.workspace_access.groups] Migrating permissions for 1 account groups. 11:49 INFO [databricks.labs.ucx.workspace_access.groups] Migrating permissions: sdk-2wPb (workspace) -> sdk-ZD8z (account) starting 11:49 ERROR [databricks.labs.ucx.workspace_access.groups] Migration of group permissions failed: sdk-2wPb (workspace) -> sdk-ZD8z (account) Traceback (most recent call last): File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 115, in _apply_to_groups group_permissions = self._migrate_group_permissions_paginated(ws, name_in_workspace, name_in_account) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 138, in _migrate_group_permissions_paginated result = ws.permission_migration.migrate_permissions( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/iam.py", line 2533, in migrate_permissions res = self._api.do('POST', '/api/2.0/permissionmigration', body=body, headers=headers) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 153, in do response = retryable(self._perform)(method, File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 264, in _perform raise self._make_nicer_error(response=response, **payload) from None databricks.sdk.errors.platform.NotImplemented: Permission migration API is not enabled for workspace: 7342989205138882 11:49 INFO [databricks.labs.ucx.workspace_access.groups] Migrated 0 permissions for 0/1 groups successfully. 11:49 ERROR [databricks.labs.ucx.workspace_access.groups] Migrating permissions failed for 1/1 groups. 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 pipeline permissions fixtures 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] removing pipeline permissions fixture: 17720e5e-475d-49a0-8a3b-5204ac28e2dd [group_name admins CAN_MANAGE] -> [group_name sdk-2wPb CAN_MANAGE] 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while pipeline permissions 17720e5e-475d-49a0-8a3b-5204ac28e2dd [group_name admins CAN_MANAGE] -> [group_name sdk-2wPb CAN_MANAGE] teardown: The pipeline must have exactly one owner. 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 delta live table fixtures 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] removing delta live table fixture: CreatePipelineResponse(effective_settings=None, pipeline_id='17720e5e-475d-49a0-8a3b-5204ac28e2dd') 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 notebook fixtures 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] removing notebook fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-VCWY 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 account group fixtures 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] removing account group fixture: Group(display_name='sdk-ZD8z', entitlements=[], external_id=None, groups=[], id='254615983818732', members=[], meta=None, roles=[], schemas=[]) 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace group fixtures 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace group fixture: Group(display_name='sdk-2wPb', entitlements=[], external_id=None, groups=[], id='709224643848749', members=[], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) [gw4] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```
❌ test_cluster_policies[True]: databricks.labs.blueprint.parallel.ManyError: Detected 1 failures: NotImplemented: Permission migration API is not enabled for workspace: 7342989205138882 (8.333s) ``` databricks.labs.blueprint.parallel.ManyError: Detected 1 failures: NotImplemented: Permission migration API is not enabled for workspace: 7342989205138882 11:49 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group sdk-wwOZ: https://DATABRICKS_HOST#setting/accounts/groups/1120351503954114 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='sdk-wwOZ', entitlements=[], external_id=None, groups=[], id='1120351503954114', members=[], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 11:49 INFO [databricks.labs.ucx.mixins.fixtures] Account group sdk-eSXd: https://accounts.CLOUD_ENVdatabricks.net/users/groups/167513310454259/members 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='sdk-eSXd', entitlements=[], external_id=None, groups=[], id='167513310454259', members=[], meta=None, roles=[], schemas=[]) [gw4] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 11:49 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group sdk-wwOZ: https://DATABRICKS_HOST#setting/accounts/groups/1120351503954114 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='sdk-wwOZ', entitlements=[], external_id=None, groups=[], id='1120351503954114', members=[], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 11:49 INFO [databricks.labs.ucx.mixins.fixtures] Account group sdk-eSXd: https://accounts.CLOUD_ENVdatabricks.net/users/groups/167513310454259/members 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='sdk-eSXd', entitlements=[], external_id=None, groups=[], id='167513310454259', members=[], meta=None, roles=[], schemas=[]) 11:49 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/001B664719A264C0 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='001B664719A264C0') 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 001B664719A264C0 [group_name admins CAN_USE] -> [group_name sdk-wwOZ CAN_USE] 11:49 INFO [databricks.labs.ucx.workspace_access.groups] Migrating permissions for 1 account groups. 11:49 INFO [databricks.labs.ucx.workspace_access.groups] Migrating permissions: sdk-wwOZ (workspace) -> sdk-eSXd (account) starting 11:49 ERROR [databricks.labs.ucx.workspace_access.groups] Migration of group permissions failed: sdk-wwOZ (workspace) -> sdk-eSXd (account) Traceback (most recent call last): File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 115, in _apply_to_groups group_permissions = self._migrate_group_permissions_paginated(ws, name_in_workspace, name_in_account) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 138, in _migrate_group_permissions_paginated result = ws.permission_migration.migrate_permissions( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/iam.py", line 2533, in migrate_permissions res = self._api.do('POST', '/api/2.0/permissionmigration', body=body, headers=headers) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 153, in do response = retryable(self._perform)(method, File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 264, in _perform raise self._make_nicer_error(response=response, **payload) from None databricks.sdk.errors.platform.NotImplemented: Permission migration API is not enabled for workspace: 7342989205138882 11:49 INFO [databricks.labs.ucx.workspace_access.groups] Migrated 0 permissions for 0/1 groups successfully. 11:49 ERROR [databricks.labs.ucx.workspace_access.groups] Migrating permissions failed for 1/1 groups. 11:49 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group sdk-wwOZ: https://DATABRICKS_HOST#setting/accounts/groups/1120351503954114 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='sdk-wwOZ', entitlements=[], external_id=None, groups=[], id='1120351503954114', members=[], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 11:49 INFO [databricks.labs.ucx.mixins.fixtures] Account group sdk-eSXd: https://accounts.CLOUD_ENVdatabricks.net/users/groups/167513310454259/members 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='sdk-eSXd', entitlements=[], external_id=None, groups=[], id='167513310454259', members=[], meta=None, roles=[], schemas=[]) 11:49 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/001B664719A264C0 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='001B664719A264C0') 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 001B664719A264C0 [group_name admins CAN_USE] -> [group_name sdk-wwOZ CAN_USE] 11:49 INFO [databricks.labs.ucx.workspace_access.groups] Migrating permissions for 1 account groups. 11:49 INFO [databricks.labs.ucx.workspace_access.groups] Migrating permissions: sdk-wwOZ (workspace) -> sdk-eSXd (account) starting 11:49 ERROR [databricks.labs.ucx.workspace_access.groups] Migration of group permissions failed: sdk-wwOZ (workspace) -> sdk-eSXd (account) Traceback (most recent call last): File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 115, in _apply_to_groups group_permissions = self._migrate_group_permissions_paginated(ws, name_in_workspace, name_in_account) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 138, in _migrate_group_permissions_paginated result = ws.permission_migration.migrate_permissions( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/iam.py", line 2533, in migrate_permissions res = self._api.do('POST', '/api/2.0/permissionmigration', body=body, headers=headers) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 153, in do response = retryable(self._perform)(method, File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 264, in _perform raise self._make_nicer_error(response=response, **payload) from None databricks.sdk.errors.platform.NotImplemented: Permission migration API is not enabled for workspace: 7342989205138882 11:49 INFO [databricks.labs.ucx.workspace_access.groups] Migrated 0 permissions for 0/1 groups successfully. 11:49 ERROR [databricks.labs.ucx.workspace_access.groups] Migrating permissions failed for 1/1 groups. 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster_policy permissions fixtures 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster_policy permissions fixture: 001B664719A264C0 [group_name admins CAN_USE] -> [group_name sdk-wwOZ CAN_USE] 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster policy fixtures 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster policy fixture: CreatePolicyResponse(policy_id='001B664719A264C0') 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 account group fixtures 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] removing account group fixture: Group(display_name='sdk-eSXd', entitlements=[], external_id=None, groups=[], id='167513310454259', members=[], meta=None, roles=[], schemas=[]) 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace group fixtures 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace group fixture: Group(display_name='sdk-wwOZ', entitlements=[], external_id=None, groups=[], id='1120351503954114', members=[], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) [gw4] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```
❌ test_warehouses[True]: databricks.labs.blueprint.parallel.ManyError: Detected 1 failures: NotImplemented: Permission migration API is not enabled for workspace: 7342989205138882 (8.199s) ``` databricks.labs.blueprint.parallel.ManyError: Detected 1 failures: NotImplemented: Permission migration API is not enabled for workspace: 7342989205138882 11:49 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group sdk-qwaz: https://DATABRICKS_HOST#setting/accounts/groups/461790233180264 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='sdk-qwaz', entitlements=[], external_id=None, groups=[], id='461790233180264', members=[], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 11:49 INFO [databricks.labs.ucx.mixins.fixtures] Account group sdk-fv26: https://accounts.CLOUD_ENVdatabricks.net/users/groups/278498026437890/members 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='sdk-fv26', entitlements=[], external_id=None, groups=[], id='278498026437890', members=[], meta=None, roles=[], schemas=[]) [gw4] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 11:49 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group sdk-qwaz: https://DATABRICKS_HOST#setting/accounts/groups/461790233180264 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='sdk-qwaz', entitlements=[], external_id=None, groups=[], id='461790233180264', members=[], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 11:49 INFO [databricks.labs.ucx.mixins.fixtures] Account group sdk-fv26: https://accounts.CLOUD_ENVdatabricks.net/users/groups/278498026437890/members 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='sdk-fv26', entitlements=[], external_id=None, groups=[], id='278498026437890', members=[], meta=None, roles=[], schemas=[]) 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added warehouse fixture: 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added warehouse permissions fixture: 8fce92382a510082 [group_name admins CAN_MANAGE] -> [group_name sdk-qwaz CAN_MANAGE] 11:49 INFO [databricks.labs.ucx.workspace_access.groups] Migrating permissions for 1 account groups. 11:49 INFO [databricks.labs.ucx.workspace_access.groups] Migrating permissions: sdk-qwaz (workspace) -> sdk-fv26 (account) starting 11:49 ERROR [databricks.labs.ucx.workspace_access.groups] Migration of group permissions failed: sdk-qwaz (workspace) -> sdk-fv26 (account) Traceback (most recent call last): File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 115, in _apply_to_groups group_permissions = self._migrate_group_permissions_paginated(ws, name_in_workspace, name_in_account) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 138, in _migrate_group_permissions_paginated result = ws.permission_migration.migrate_permissions( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/iam.py", line 2533, in migrate_permissions res = self._api.do('POST', '/api/2.0/permissionmigration', body=body, headers=headers) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 153, in do response = retryable(self._perform)(method, File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 264, in _perform raise self._make_nicer_error(response=response, **payload) from None databricks.sdk.errors.platform.NotImplemented: Permission migration API is not enabled for workspace: 7342989205138882 11:49 INFO [databricks.labs.ucx.workspace_access.groups] Migrated 0 permissions for 0/1 groups successfully. 11:49 ERROR [databricks.labs.ucx.workspace_access.groups] Migrating permissions failed for 1/1 groups. 11:49 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group sdk-qwaz: https://DATABRICKS_HOST#setting/accounts/groups/461790233180264 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='sdk-qwaz', entitlements=[], external_id=None, groups=[], id='461790233180264', members=[], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 11:49 INFO [databricks.labs.ucx.mixins.fixtures] Account group sdk-fv26: https://accounts.CLOUD_ENVdatabricks.net/users/groups/278498026437890/members 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='sdk-fv26', entitlements=[], external_id=None, groups=[], id='278498026437890', members=[], meta=None, roles=[], schemas=[]) 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added warehouse fixture: 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added warehouse permissions fixture: 8fce92382a510082 [group_name admins CAN_MANAGE] -> [group_name sdk-qwaz CAN_MANAGE] 11:49 INFO [databricks.labs.ucx.workspace_access.groups] Migrating permissions for 1 account groups. 11:49 INFO [databricks.labs.ucx.workspace_access.groups] Migrating permissions: sdk-qwaz (workspace) -> sdk-fv26 (account) starting 11:49 ERROR [databricks.labs.ucx.workspace_access.groups] Migration of group permissions failed: sdk-qwaz (workspace) -> sdk-fv26 (account) Traceback (most recent call last): File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 115, in _apply_to_groups group_permissions = self._migrate_group_permissions_paginated(ws, name_in_workspace, name_in_account) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 138, in _migrate_group_permissions_paginated result = ws.permission_migration.migrate_permissions( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/iam.py", line 2533, in migrate_permissions res = self._api.do('POST', '/api/2.0/permissionmigration', body=body, headers=headers) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 153, in do response = retryable(self._perform)(method, File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 264, in _perform raise self._make_nicer_error(response=response, **payload) from None databricks.sdk.errors.platform.NotImplemented: Permission migration API is not enabled for workspace: 7342989205138882 11:49 INFO [databricks.labs.ucx.workspace_access.groups] Migrated 0 permissions for 0/1 groups successfully. 11:49 ERROR [databricks.labs.ucx.workspace_access.groups] Migrating permissions failed for 1/1 groups. 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 warehouse permissions fixtures 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] removing warehouse permissions fixture: 8fce92382a510082 [group_name admins CAN_MANAGE] -> [group_name sdk-qwaz CAN_MANAGE] 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 warehouse fixtures 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] removing warehouse fixture: 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 account group fixtures 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] removing account group fixture: Group(display_name='sdk-fv26', entitlements=[], external_id=None, groups=[], id='278498026437890', members=[], meta=None, roles=[], schemas=[]) 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace group fixtures 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace group fixture: Group(display_name='sdk-qwaz', entitlements=[], external_id=None, groups=[], id='461790233180264', members=[], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) [gw4] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```
❌ test_models[True]: databricks.labs.blueprint.parallel.ManyError: Detected 1 failures: NotImplemented: Permission migration API is not enabled for workspace: 7342989205138882 (11.907s) ``` databricks.labs.blueprint.parallel.ManyError: Detected 1 failures: NotImplemented: Permission migration API is not enabled for workspace: 7342989205138882 11:49 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group sdk-SNOc: https://DATABRICKS_HOST#setting/accounts/groups/778724837045004 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='sdk-SNOc', entitlements=[], external_id=None, groups=[], id='778724837045004', members=[], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 11:49 INFO [databricks.labs.ucx.mixins.fixtures] Account group sdk-cakR: https://accounts.CLOUD_ENVdatabricks.net/users/groups/434037639673163/members 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='sdk-cakR', entitlements=[], external_id=None, groups=[], id='434037639673163', members=[], meta=None, roles=[], schemas=[]) [gw4] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 11:49 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group sdk-SNOc: https://DATABRICKS_HOST#setting/accounts/groups/778724837045004 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='sdk-SNOc', entitlements=[], external_id=None, groups=[], id='778724837045004', members=[], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 11:49 INFO [databricks.labs.ucx.mixins.fixtures] Account group sdk-cakR: https://accounts.CLOUD_ENVdatabricks.net/users/groups/434037639673163/members 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='sdk-cakR', entitlements=[], external_id=None, groups=[], id='434037639673163', members=[], meta=None, roles=[], schemas=[]) 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] added model fixture: ModelDatabricks(creation_timestamp=1720093800518, description=None, id='2a7f6e37f1814cd18fd56668c3d1b6bb', last_updated_timestamp=1720093800518, latest_versions=[], name='sdk-xFA7', permission_level=, tags=[], user_id='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] added registered_model permissions fixture: 2a7f6e37f1814cd18fd56668c3d1b6bb [group_name admins CAN_MANAGE] -> [group_name sdk-SNOc CAN_MANAGE] 11:50 INFO [databricks.labs.ucx.workspace_access.groups] Migrating permissions for 1 account groups. 11:50 INFO [databricks.labs.ucx.workspace_access.groups] Migrating permissions: sdk-SNOc (workspace) -> sdk-cakR (account) starting 11:50 ERROR [databricks.labs.ucx.workspace_access.groups] Migration of group permissions failed: sdk-SNOc (workspace) -> sdk-cakR (account) Traceback (most recent call last): File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 115, in _apply_to_groups group_permissions = self._migrate_group_permissions_paginated(ws, name_in_workspace, name_in_account) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 138, in _migrate_group_permissions_paginated result = ws.permission_migration.migrate_permissions( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/iam.py", line 2533, in migrate_permissions res = self._api.do('POST', '/api/2.0/permissionmigration', body=body, headers=headers) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 153, in do response = retryable(self._perform)(method, File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 264, in _perform raise self._make_nicer_error(response=response, **payload) from None databricks.sdk.errors.platform.NotImplemented: Permission migration API is not enabled for workspace: 7342989205138882 11:50 INFO [databricks.labs.ucx.workspace_access.groups] Migrated 0 permissions for 0/1 groups successfully. 11:50 ERROR [databricks.labs.ucx.workspace_access.groups] Migrating permissions failed for 1/1 groups. 11:49 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group sdk-SNOc: https://DATABRICKS_HOST#setting/accounts/groups/778724837045004 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='sdk-SNOc', entitlements=[], external_id=None, groups=[], id='778724837045004', members=[], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 11:49 INFO [databricks.labs.ucx.mixins.fixtures] Account group sdk-cakR: https://accounts.CLOUD_ENVdatabricks.net/users/groups/434037639673163/members 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='sdk-cakR', entitlements=[], external_id=None, groups=[], id='434037639673163', members=[], meta=None, roles=[], schemas=[]) 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] added model fixture: ModelDatabricks(creation_timestamp=1720093800518, description=None, id='2a7f6e37f1814cd18fd56668c3d1b6bb', last_updated_timestamp=1720093800518, latest_versions=[], name='sdk-xFA7', permission_level=, tags=[], user_id='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] added registered_model permissions fixture: 2a7f6e37f1814cd18fd56668c3d1b6bb [group_name admins CAN_MANAGE] -> [group_name sdk-SNOc CAN_MANAGE] 11:50 INFO [databricks.labs.ucx.workspace_access.groups] Migrating permissions for 1 account groups. 11:50 INFO [databricks.labs.ucx.workspace_access.groups] Migrating permissions: sdk-SNOc (workspace) -> sdk-cakR (account) starting 11:50 ERROR [databricks.labs.ucx.workspace_access.groups] Migration of group permissions failed: sdk-SNOc (workspace) -> sdk-cakR (account) Traceback (most recent call last): File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 115, in _apply_to_groups group_permissions = self._migrate_group_permissions_paginated(ws, name_in_workspace, name_in_account) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 138, in _migrate_group_permissions_paginated result = ws.permission_migration.migrate_permissions( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/iam.py", line 2533, in migrate_permissions res = self._api.do('POST', '/api/2.0/permissionmigration', body=body, headers=headers) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 153, in do response = retryable(self._perform)(method, File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 264, in _perform raise self._make_nicer_error(response=response, **payload) from None databricks.sdk.errors.platform.NotImplemented: Permission migration API is not enabled for workspace: 7342989205138882 11:50 INFO [databricks.labs.ucx.workspace_access.groups] Migrated 0 permissions for 0/1 groups successfully. 11:50 ERROR [databricks.labs.ucx.workspace_access.groups] Migrating permissions failed for 1/1 groups. 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 registered_model permissions fixtures 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] removing registered_model permissions fixture: 2a7f6e37f1814cd18fd56668c3d1b6bb [group_name admins CAN_MANAGE] -> [group_name sdk-SNOc CAN_MANAGE] 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 model fixtures 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] removing model fixture: ModelDatabricks(creation_timestamp=1720093800518, description=None, id='2a7f6e37f1814cd18fd56668c3d1b6bb', last_updated_timestamp=1720093800518, latest_versions=[], name='sdk-xFA7', permission_level=, tags=[], user_id='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while model ModelDatabricks(creation_timestamp=1720093800518, description=None, id='2a7f6e37f1814cd18fd56668c3d1b6bb', last_updated_timestamp=1720093800518, latest_versions=[], name='sdk-xFA7', permission_level=, tags=[], user_id='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') teardown: RegisteredModel '2a7f6e37f1814cd18fd56668c3d1b6bb' does not exist. It might have been deleted. 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 account group fixtures 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] removing account group fixture: Group(display_name='sdk-cakR', entitlements=[], external_id=None, groups=[], id='434037639673163', members=[], meta=None, roles=[], schemas=[]) 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace group fixtures 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace group fixture: Group(display_name='sdk-SNOc', entitlements=[], external_id=None, groups=[], id='778724837045004', members=[], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) [gw4] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```
❌ test_experiments[True]: databricks.labs.blueprint.parallel.ManyError: Detected 1 failures: NotImplemented: Permission migration API is not enabled for workspace: 7342989205138882 (10.052s) ``` databricks.labs.blueprint.parallel.ManyError: Detected 1 failures: NotImplemented: Permission migration API is not enabled for workspace: 7342989205138882 11:50 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group sdk-1tTK: https://DATABRICKS_HOST#setting/accounts/groups/977414390393573 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='sdk-1tTK', entitlements=[], external_id=None, groups=[], id='977414390393573', members=[], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 11:50 INFO [databricks.labs.ucx.mixins.fixtures] Account group sdk-dY5a: https://accounts.CLOUD_ENVdatabricks.net/users/groups/786851600081621/members 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='sdk-dY5a', entitlements=[], external_id=None, groups=[], id='786851600081621', members=[], meta=None, roles=[], schemas=[]) [gw4] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 11:50 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group sdk-1tTK: https://DATABRICKS_HOST#setting/accounts/groups/977414390393573 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='sdk-1tTK', entitlements=[], external_id=None, groups=[], id='977414390393573', members=[], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 11:50 INFO [databricks.labs.ucx.mixins.fixtures] Account group sdk-dY5a: https://accounts.CLOUD_ENVdatabricks.net/users/groups/786851600081621/members 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='sdk-dY5a', entitlements=[], external_id=None, groups=[], id='786851600081621', members=[], meta=None, roles=[], schemas=[]) 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] added experiment fixture: CreateExperimentResponse(experiment_id='2675562345715136') 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] added experiment permissions fixture: 2675562345715136 [service_principal_name 0a330eb5-dd51-4d97-b6e4-c474356b1d5d CAN_MANAGE, group_name admins CAN_MANAGE] -> [group_name sdk-1tTK CAN_MANAGE] 11:50 INFO [databricks.labs.ucx.workspace_access.groups] Migrating permissions for 1 account groups. 11:50 INFO [databricks.labs.ucx.workspace_access.groups] Migrating permissions: sdk-1tTK (workspace) -> sdk-dY5a (account) starting 11:50 ERROR [databricks.labs.ucx.workspace_access.groups] Migration of group permissions failed: sdk-1tTK (workspace) -> sdk-dY5a (account) Traceback (most recent call last): File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 115, in _apply_to_groups group_permissions = self._migrate_group_permissions_paginated(ws, name_in_workspace, name_in_account) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 138, in _migrate_group_permissions_paginated result = ws.permission_migration.migrate_permissions( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/iam.py", line 2533, in migrate_permissions res = self._api.do('POST', '/api/2.0/permissionmigration', body=body, headers=headers) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 153, in do response = retryable(self._perform)(method, File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 264, in _perform raise self._make_nicer_error(response=response, **payload) from None databricks.sdk.errors.platform.NotImplemented: Permission migration API is not enabled for workspace: 7342989205138882 11:50 INFO [databricks.labs.ucx.workspace_access.groups] Migrated 0 permissions for 0/1 groups successfully. 11:50 ERROR [databricks.labs.ucx.workspace_access.groups] Migrating permissions failed for 1/1 groups. 11:50 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group sdk-1tTK: https://DATABRICKS_HOST#setting/accounts/groups/977414390393573 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='sdk-1tTK', entitlements=[], external_id=None, groups=[], id='977414390393573', members=[], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 11:50 INFO [databricks.labs.ucx.mixins.fixtures] Account group sdk-dY5a: https://accounts.CLOUD_ENVdatabricks.net/users/groups/786851600081621/members 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='sdk-dY5a', entitlements=[], external_id=None, groups=[], id='786851600081621', members=[], meta=None, roles=[], schemas=[]) 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] added experiment fixture: CreateExperimentResponse(experiment_id='2675562345715136') 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] added experiment permissions fixture: 2675562345715136 [service_principal_name 0a330eb5-dd51-4d97-b6e4-c474356b1d5d CAN_MANAGE, group_name admins CAN_MANAGE] -> [group_name sdk-1tTK CAN_MANAGE] 11:50 INFO [databricks.labs.ucx.workspace_access.groups] Migrating permissions for 1 account groups. 11:50 INFO [databricks.labs.ucx.workspace_access.groups] Migrating permissions: sdk-1tTK (workspace) -> sdk-dY5a (account) starting 11:50 ERROR [databricks.labs.ucx.workspace_access.groups] Migration of group permissions failed: sdk-1tTK (workspace) -> sdk-dY5a (account) Traceback (most recent call last): File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 115, in _apply_to_groups group_permissions = self._migrate_group_permissions_paginated(ws, name_in_workspace, name_in_account) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 138, in _migrate_group_permissions_paginated result = ws.permission_migration.migrate_permissions( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/iam.py", line 2533, in migrate_permissions res = self._api.do('POST', '/api/2.0/permissionmigration', body=body, headers=headers) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 153, in do response = retryable(self._perform)(method, File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 264, in _perform raise self._make_nicer_error(response=response, **payload) from None databricks.sdk.errors.platform.NotImplemented: Permission migration API is not enabled for workspace: 7342989205138882 11:50 INFO [databricks.labs.ucx.workspace_access.groups] Migrated 0 permissions for 0/1 groups successfully. 11:50 ERROR [databricks.labs.ucx.workspace_access.groups] Migrating permissions failed for 1/1 groups. 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 experiment permissions fixtures 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] removing experiment permissions fixture: 2675562345715136 [service_principal_name 0a330eb5-dd51-4d97-b6e4-c474356b1d5d CAN_MANAGE, group_name admins CAN_MANAGE] -> [group_name sdk-1tTK CAN_MANAGE] 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 experiment fixtures 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] removing experiment fixture: CreateExperimentResponse(experiment_id='2675562345715136') 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 account group fixtures 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] removing account group fixture: Group(display_name='sdk-dY5a', entitlements=[], external_id=None, groups=[], id='786851600081621', members=[], meta=None, roles=[], schemas=[]) 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace group fixtures 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace group fixture: Group(display_name='sdk-1tTK', entitlements=[], external_id=None, groups=[], id='977414390393573', members=[], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) [gw4] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```
❌ test_directories[True]: databricks.labs.blueprint.parallel.ManyError: Detected 1 failures: NotImplemented: Permission migration API is not enabled for workspace: 7342989205138882 (13.136s) ``` databricks.labs.blueprint.parallel.ManyError: Detected 1 failures: NotImplemented: Permission migration API is not enabled for workspace: 7342989205138882 11:50 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sldzk: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sldzk 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sldzk', metastore_id=None, name='ucx_sldzk', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:50 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group sdk-006r: https://DATABRICKS_HOST#setting/accounts/groups/675237672266185 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='sdk-006r', entitlements=[], external_id=None, groups=[], id='675237672266185', members=[], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 11:50 INFO [databricks.labs.ucx.mixins.fixtures] Account group sdk-cmBs: https://accounts.CLOUD_ENVdatabricks.net/users/groups/546277857658139/members 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='sdk-cmBs', entitlements=[], external_id=None, groups=[], id='546277857658139', members=[], meta=None, roles=[], schemas=[]) [gw4] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 11:50 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sldzk: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sldzk 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sldzk', metastore_id=None, name='ucx_sldzk', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:50 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group sdk-006r: https://DATABRICKS_HOST#setting/accounts/groups/675237672266185 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='sdk-006r', entitlements=[], external_id=None, groups=[], id='675237672266185', members=[], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 11:50 INFO [databricks.labs.ucx.mixins.fixtures] Account group sdk-cmBs: https://accounts.CLOUD_ENVdatabricks.net/users/groups/546277857658139/members 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='sdk-cmBs', entitlements=[], external_id=None, groups=[], id='546277857658139', members=[], meta=None, roles=[], schemas=[]) 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] added directory fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-Rfor 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] added directory permissions fixture: 2675562345715161 [service_principal_name 0a330eb5-dd51-4d97-b6e4-c474356b1d5d CAN_MANAGE, group_name admins CAN_MANAGE] -> [group_name sdk-006r CAN_MANAGE] 11:50 INFO [databricks.labs.ucx.workspace_access.groups] Migrating permissions for 1 account groups. 11:50 INFO [databricks.labs.ucx.workspace_access.groups] Migrating permissions: sdk-006r (workspace) -> sdk-cmBs (account) starting 11:50 ERROR [databricks.labs.ucx.workspace_access.groups] Migration of group permissions failed: sdk-006r (workspace) -> sdk-cmBs (account) Traceback (most recent call last): File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 115, in _apply_to_groups group_permissions = self._migrate_group_permissions_paginated(ws, name_in_workspace, name_in_account) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 138, in _migrate_group_permissions_paginated result = ws.permission_migration.migrate_permissions( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/iam.py", line 2533, in migrate_permissions res = self._api.do('POST', '/api/2.0/permissionmigration', body=body, headers=headers) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 153, in do response = retryable(self._perform)(method, File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 264, in _perform raise self._make_nicer_error(response=response, **payload) from None databricks.sdk.errors.platform.NotImplemented: Permission migration API is not enabled for workspace: 7342989205138882 11:50 INFO [databricks.labs.ucx.workspace_access.groups] Migrated 0 permissions for 0/1 groups successfully. 11:50 ERROR [databricks.labs.ucx.workspace_access.groups] Migrating permissions failed for 1/1 groups. 11:50 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sldzk: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sldzk 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sldzk', metastore_id=None, name='ucx_sldzk', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:50 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group sdk-006r: https://DATABRICKS_HOST#setting/accounts/groups/675237672266185 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='sdk-006r', entitlements=[], external_id=None, groups=[], id='675237672266185', members=[], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 11:50 INFO [databricks.labs.ucx.mixins.fixtures] Account group sdk-cmBs: https://accounts.CLOUD_ENVdatabricks.net/users/groups/546277857658139/members 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='sdk-cmBs', entitlements=[], external_id=None, groups=[], id='546277857658139', members=[], meta=None, roles=[], schemas=[]) 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] added directory fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-Rfor 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] added directory permissions fixture: 2675562345715161 [service_principal_name 0a330eb5-dd51-4d97-b6e4-c474356b1d5d CAN_MANAGE, group_name admins CAN_MANAGE] -> [group_name sdk-006r CAN_MANAGE] 11:50 INFO [databricks.labs.ucx.workspace_access.groups] Migrating permissions for 1 account groups. 11:50 INFO [databricks.labs.ucx.workspace_access.groups] Migrating permissions: sdk-006r (workspace) -> sdk-cmBs (account) starting 11:50 ERROR [databricks.labs.ucx.workspace_access.groups] Migration of group permissions failed: sdk-006r (workspace) -> sdk-cmBs (account) Traceback (most recent call last): File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 115, in _apply_to_groups group_permissions = self._migrate_group_permissions_paginated(ws, name_in_workspace, name_in_account) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 138, in _migrate_group_permissions_paginated result = ws.permission_migration.migrate_permissions( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/iam.py", line 2533, in migrate_permissions res = self._api.do('POST', '/api/2.0/permissionmigration', body=body, headers=headers) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 153, in do response = retryable(self._perform)(method, File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 264, in _perform raise self._make_nicer_error(response=response, **payload) from None databricks.sdk.errors.platform.NotImplemented: Permission migration API is not enabled for workspace: 7342989205138882 11:50 INFO [databricks.labs.ucx.workspace_access.groups] Migrated 0 permissions for 0/1 groups successfully. 11:50 ERROR [databricks.labs.ucx.workspace_access.groups] Migrating permissions failed for 1/1 groups. 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 directory permissions fixtures 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] removing directory permissions fixture: 2675562345715161 [service_principal_name 0a330eb5-dd51-4d97-b6e4-c474356b1d5d CAN_MANAGE, group_name admins CAN_MANAGE] -> [group_name sdk-006r CAN_MANAGE] 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 directory fixtures 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] removing directory fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-Rfor 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 account group fixtures 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] removing account group fixture: Group(display_name='sdk-cmBs', entitlements=[], external_id=None, groups=[], id='546277857658139', members=[], meta=None, roles=[], schemas=[]) 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace group fixtures 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace group fixture: Group(display_name='sdk-006r', entitlements=[], external_id=None, groups=[], id='675237672266185', members=[], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 schema fixtures 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sldzk', metastore_id=None, name='ucx_sldzk', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw4] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```

Running from acceptance #4320

ericvergnaud commented 1 week ago

duplicate of #2050