search

databrickslabs / ucx

Your best companion for upgrading to Unity Catalog. UCX will guide you, the Databricks customer, through the process of upgrading your account, groups, workspaces, jobs etc. to Unity Catalog.
Other
193 stars 69 forks source link

whitelist glow #1973

Closed ericvergnaud closed 2 days ago

ericvergnaud commented 2 days ago

Changes

whitelist glow

Linked issues

Progresses #1901

Functionality

None

Tests

github-actions[bot] commented 2 days ago

❌ 96/100 passed, 4 failed, 22 skipped, 5h21m56s total

❌ test_create_catalog_schema_with_principal_acl_CLOUD_ENV: AssertionError: assert PrivilegeAssignment(principal='sdk-rl9volqr@example.com', privileges=[]) in [PrivilegeAssignment(principal='ucx_Gr6es', privileges=[]), PrivilegeAssignment(pr...HEMA'>]), PrivilegeAssignment(principal='sdk-ixs3zxyf@example.com', privileges=[])] (5m58.518s) ``` AssertionError: assert PrivilegeAssignment(principal='sdk-rl9volqr@example.com', privileges=[]) in [PrivilegeAssignment(principal='ucx_Gr6es', privileges=[]), PrivilegeAssignment(pr...HEMA'>]), PrivilegeAssignment(principal='sdk-ixs3zxyf@example.com', privileges=[])] + where [PrivilegeAssignment(principal='ucx_Gr6es', privileges=[]), PrivilegeAssignment(pr...HEMA'>]), PrivilegeAssignment(principal='sdk-ixs3zxyf@example.com', privileges=[])] = PermissionsList(privilege_assignments=[PrivilegeAssignment(principal='ucx_Gr6es', privileges=[]), PrivilegeAssignment(principal='sdk-ixs3zxyf@example.com', privileges=[])]).privilege_assignments 14:59 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/uW1o 14:59 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sm4ux: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sm4ux 14:59 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sm4ux', metastore_id=None, name='ucx_sm4ux', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 14:59 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_sm4ux.ucx_tbsl2: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sm4ux/ucx_tbsl2 14:59 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sm4ux.ucx_tbsl2', metastore_id=None, name='ucx_tbsl2', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='ucx_sm4ux', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/uW1o', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 14:59 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1719932395150, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_czym3', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_czym3', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719932395150, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 15:00 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_czym3.ucx_sm4ux: https://DATABRICKS_HOST/explore/data/ucx_czym3/ucx_sm4ux 15:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_czym3', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_czym3.ucx_sm4ux', metastore_id=None, name='ucx_sm4ux', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw9] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 14:59 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/uW1o 14:59 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sm4ux: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sm4ux 14:59 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sm4ux', metastore_id=None, name='ucx_sm4ux', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 14:59 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_sm4ux.ucx_tbsl2: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sm4ux/ucx_tbsl2 14:59 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sm4ux.ucx_tbsl2', metastore_id=None, name='ucx_tbsl2', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='ucx_sm4ux', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/uW1o', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 14:59 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1719932395150, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_czym3', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_czym3', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719932395150, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 15:00 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_czym3.ucx_sm4ux: https://DATABRICKS_HOST/explore/data/ucx_czym3/ucx_sm4ux 15:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_czym3', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_czym3.ucx_sm4ux', metastore_id=None, name='ucx_sm4ux', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: 15:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-ixs3zxyf@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-ixs3zxyf@example.com')], entitlements=[], external_id=None, groups=[], id='3859341039604396', name=Name(family_name=None, given_name='sdk-ixs3zxyf@example.com'), roles=[], schemas=[, ], user_name='sdk-ixs3zxyf@example.com') 15:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0702-150001-vev0wctg [group_name admins CAN_MANAGE] -> [user_name sdk-ixs3zxyf@example.com CAN_ATTACH_TO] 15:00 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sufay: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sufay 15:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sufay', metastore_id=None, name='ucx_sufay', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:00 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:00 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:00 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:00 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Listing existing UC catalogs and schemas 15:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: 15:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-eca6jft8@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-eca6jft8@example.com')], entitlements=[], external_id=None, groups=[], id='8450905182301832', name=Name(family_name=None, given_name='sdk-eca6jft8@example.com'), roles=[], schemas=[, ], user_name='sdk-eca6jft8@example.com') 15:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0702-150031-oirk2kc5 [group_name admins CAN_MANAGE] -> [user_name sdk-eca6jft8@example.com CAN_ATTACH_TO] 15:00 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Listing existing UC catalogs and schemas 15:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: 15:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-rl9volqr@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-rl9volqr@example.com')], entitlements=[], external_id=None, groups=[], id='358535285206792', name=Name(family_name=None, given_name='sdk-rl9volqr@example.com'), roles=[], schemas=[, ], user_name='sdk-rl9volqr@example.com') 15:01 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0702-150051-2onatj06 [group_name admins CAN_MANAGE] -> [user_name sdk-rl9volqr@example.com CAN_ATTACH_TO] 15:01 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Listing existing UC catalogs and schemas 15:01 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Preparing a list of UC catalogs and schema to be created 15:01 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sufay.tables] fetching tables inventory 15:01 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sufay.tables] crawling new batch for tables 15:01 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sm4ux] listing tables 15:01 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sm4ux.ucx_tbsl2] fetching table metadata 15:01 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sufay.tables] found 1 new records for tables 15:02 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_czym3.ucx_sm4ux') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_czym3.ucx_sm4ux TO `serge.smertin@databricks.com` 15:02 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_czym3.ucx_sm4ux') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_czym3.ucx_sm4ux TO `sdk-tza1ovpe@example.com` 15:02 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_czym3.ucx_sm4ux') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_czym3.ucx_sm4ux TO `ucx_Gr6es` 15:02 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_czym3.ucx_sm4ux') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_czym3.ucx_sm4ux TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d` 15:02 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_czym3.ucx_sm4ux') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_czym3.ucx_sm4ux TO `sdk-ixs3zxyf@example.com` 15:02 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_czym3') using SQL query: GRANT USE CATALOG ON CATALOG ucx_czym3 TO `sdk-tza1ovpe@example.com` 15:03 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_czym3') using SQL query: GRANT USE CATALOG ON CATALOG ucx_czym3 TO `sdk-ixs3zxyf@example.com` 15:03 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_czym3') using SQL query: GRANT USE CATALOG ON CATALOG ucx_czym3 TO `ucx_Gr6es` 15:03 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_czym3') using SQL query: GRANT USE CATALOG ON CATALOG ucx_czym3 TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d` 15:04 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_czym3') using SQL query: GRANT USE CATALOG ON CATALOG ucx_czym3 TO `serge.smertin@databricks.com` 14:59 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/uW1o 14:59 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sm4ux: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sm4ux 14:59 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sm4ux', metastore_id=None, name='ucx_sm4ux', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 14:59 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_sm4ux.ucx_tbsl2: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sm4ux/ucx_tbsl2 14:59 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sm4ux.ucx_tbsl2', metastore_id=None, name='ucx_tbsl2', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='ucx_sm4ux', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/uW1o', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 14:59 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1719932395150, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_czym3', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_czym3', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719932395150, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 15:00 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_czym3.ucx_sm4ux: https://DATABRICKS_HOST/explore/data/ucx_czym3/ucx_sm4ux 15:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_czym3', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_czym3.ucx_sm4ux', metastore_id=None, name='ucx_sm4ux', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: 15:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-ixs3zxyf@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-ixs3zxyf@example.com')], entitlements=[], external_id=None, groups=[], id='3859341039604396', name=Name(family_name=None, given_name='sdk-ixs3zxyf@example.com'), roles=[], schemas=[, ], user_name='sdk-ixs3zxyf@example.com') 15:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0702-150001-vev0wctg [group_name admins CAN_MANAGE] -> [user_name sdk-ixs3zxyf@example.com CAN_ATTACH_TO] 15:00 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sufay: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sufay 15:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sufay', metastore_id=None, name='ucx_sufay', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:00 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:00 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:00 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:00 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Listing existing UC catalogs and schemas 15:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: 15:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-eca6jft8@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-eca6jft8@example.com')], entitlements=[], external_id=None, groups=[], id='8450905182301832', name=Name(family_name=None, given_name='sdk-eca6jft8@example.com'), roles=[], schemas=[, ], user_name='sdk-eca6jft8@example.com') 15:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0702-150031-oirk2kc5 [group_name admins CAN_MANAGE] -> [user_name sdk-eca6jft8@example.com CAN_ATTACH_TO] 15:00 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Listing existing UC catalogs and schemas 15:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: 15:00 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-rl9volqr@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-rl9volqr@example.com')], entitlements=[], external_id=None, groups=[], id='358535285206792', name=Name(family_name=None, given_name='sdk-rl9volqr@example.com'), roles=[], schemas=[, ], user_name='sdk-rl9volqr@example.com') 15:01 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0702-150051-2onatj06 [group_name admins CAN_MANAGE] -> [user_name sdk-rl9volqr@example.com CAN_ATTACH_TO] 15:01 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Listing existing UC catalogs and schemas 15:01 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Preparing a list of UC catalogs and schema to be created 15:01 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sufay.tables] fetching tables inventory 15:01 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sufay.tables] crawling new batch for tables 15:01 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sm4ux] listing tables 15:01 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sm4ux.ucx_tbsl2] fetching table metadata 15:01 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sufay.tables] found 1 new records for tables 15:02 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_czym3.ucx_sm4ux') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_czym3.ucx_sm4ux TO `serge.smertin@databricks.com` 15:02 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_czym3.ucx_sm4ux') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_czym3.ucx_sm4ux TO `sdk-tza1ovpe@example.com` 15:02 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_czym3.ucx_sm4ux') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_czym3.ucx_sm4ux TO `ucx_Gr6es` 15:02 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_czym3.ucx_sm4ux') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_czym3.ucx_sm4ux TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d` 15:02 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_czym3.ucx_sm4ux') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_czym3.ucx_sm4ux TO `sdk-ixs3zxyf@example.com` 15:02 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_czym3') using SQL query: GRANT USE CATALOG ON CATALOG ucx_czym3 TO `sdk-tza1ovpe@example.com` 15:03 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_czym3') using SQL query: GRANT USE CATALOG ON CATALOG ucx_czym3 TO `sdk-ixs3zxyf@example.com` 15:03 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_czym3') using SQL query: GRANT USE CATALOG ON CATALOG ucx_czym3 TO `ucx_Gr6es` 15:03 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_czym3') using SQL query: GRANT USE CATALOG ON CATALOG ucx_czym3 TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d` 15:04 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_czym3') using SQL query: GRANT USE CATALOG ON CATALOG ucx_czym3 TO `serge.smertin@databricks.com` 15:04 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 cluster permissions fixtures 15:04 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster permissions fixture: 0702-150001-vev0wctg [group_name admins CAN_MANAGE] -> [user_name sdk-ixs3zxyf@example.com CAN_ATTACH_TO] 15:04 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster permissions fixture: 0702-150031-oirk2kc5 [group_name admins CAN_MANAGE] -> [user_name sdk-eca6jft8@example.com CAN_ATTACH_TO] 15:04 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster permissions fixture: 0702-150051-2onatj06 [group_name admins CAN_MANAGE] -> [user_name sdk-rl9volqr@example.com CAN_ATTACH_TO] 15:04 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 catalog fixtures 15:04 DEBUG [databricks.labs.ucx.mixins.fixtures] removing catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1719932395150, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_czym3', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_czym3', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719932395150, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 15:04 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_dbfs_data_copy fixtures 15:04 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/uW1o 15:04 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 cluster fixtures 15:04 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster fixture: 15:04 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster fixture: 15:04 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster fixture: 15:04 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures 15:04 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 15:04 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 table fixtures 15:04 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sm4ux.ucx_tbsl2', metastore_id=None, name='ucx_tbsl2', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='ucx_sm4ux', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/uW1o', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:04 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 schema fixtures 15:04 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sm4ux', metastore_id=None, name='ucx_sm4ux', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:04 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_czym3', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_czym3.ucx_sm4ux', metastore_id=None, name='ucx_sm4ux', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:05 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sufay', metastore_id=None, name='ucx_sufay', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:05 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 workspace user fixtures 15:05 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='sdk-ixs3zxyf@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-ixs3zxyf@example.com')], entitlements=[], external_id=None, groups=[], id='3859341039604396', name=Name(family_name=None, given_name='sdk-ixs3zxyf@example.com'), roles=[], schemas=[, ], user_name='sdk-ixs3zxyf@example.com') 15:05 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='sdk-eca6jft8@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-eca6jft8@example.com')], entitlements=[], external_id=None, groups=[], id='8450905182301832', name=Name(family_name=None, given_name='sdk-eca6jft8@example.com'), roles=[], schemas=[, ], user_name='sdk-eca6jft8@example.com') 15:05 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='sdk-rl9volqr@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-rl9volqr@example.com')], entitlements=[], external_id=None, groups=[], id='358535285206792', name=Name(family_name=None, given_name='sdk-rl9volqr@example.com'), roles=[], schemas=[, ], user_name='sdk-rl9volqr@example.com') [gw9] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```
❌ test_running_real_workflow_linter_job: TimeoutError: Timed out after 0:02:00 (15m13.554s) ``` TimeoutError: Timed out after 0:02:00 [gw0] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 15:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added directory fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-yOGZ 15:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added notebook fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-yOGZ/notebook.ipynb 15:11 INFO [databricks.labs.ucx.mixins.fixtures] Job: https://DATABRICKS_HOST#job/1045993443333549 15:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added job fixture: CreateResponse(job_id=1045993443333549) 15:12 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s56lk: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s56lk 15:12 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s56lk', metastore_id=None, name='ucx_s56lk', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:12 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.s6J1/config.yml) doesn't exist. 15:12 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 15:12 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 15:12 INFO [databricks.labs.ucx.install] Fetching installations... 15:12 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 15:12 DEBUG [tests.integration.conftest] Waiting for clusters to start... 15:12 DEBUG [tests.integration.conftest] Waiting for clusters to start... 15:12 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+2820240702151247 15:12 INFO [databricks.labs.ucx.install] Creating ucx schemas... 15:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 15:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 15:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 15:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 15:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 15:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 15:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 15:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 15:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 15:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 15:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 15:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 15:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 15:16 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.s6J1/README for the next steps. 15:16 DEBUG [databricks.labs.ucx.installer.workflows] starting experimental-workflow-linter job: https://DATABRICKS_HOST#job/581604506400453 15:24 DEBUG [databricks.labs.ucx.installer.workflows] Validating experimental-workflow-linter workflow: https://DATABRICKS_HOST#job/581604506400453 15:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added directory fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-yOGZ 15:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added notebook fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-yOGZ/notebook.ipynb 15:11 INFO [databricks.labs.ucx.mixins.fixtures] Job: https://DATABRICKS_HOST#job/1045993443333549 15:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added job fixture: CreateResponse(job_id=1045993443333549) 15:12 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s56lk: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s56lk 15:12 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s56lk', metastore_id=None, name='ucx_s56lk', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:12 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.s6J1/config.yml) doesn't exist. 15:12 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 15:12 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 15:12 INFO [databricks.labs.ucx.install] Fetching installations... 15:12 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 15:12 DEBUG [tests.integration.conftest] Waiting for clusters to start... 15:12 DEBUG [tests.integration.conftest] Waiting for clusters to start... 15:12 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+2820240702151247 15:12 INFO [databricks.labs.ucx.install] Creating ucx schemas... 15:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 15:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 15:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 15:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 15:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 15:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 15:15 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 15:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 15:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 15:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 15:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 15:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 15:16 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 15:16 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.s6J1/README for the next steps. 15:16 DEBUG [databricks.labs.ucx.installer.workflows] starting experimental-workflow-linter job: https://DATABRICKS_HOST#job/581604506400453 15:24 DEBUG [databricks.labs.ucx.installer.workflows] Validating experimental-workflow-linter workflow: https://DATABRICKS_HOST#job/581604506400453 15:25 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 job fixtures 15:25 DEBUG [databricks.labs.ucx.mixins.fixtures] removing job fixture: CreateResponse(job_id=1045993443333549) 15:25 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 directory fixtures 15:25 DEBUG [databricks.labs.ucx.mixins.fixtures] removing directory fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-yOGZ 15:25 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 notebook fixtures 15:25 DEBUG [databricks.labs.ucx.mixins.fixtures] removing notebook fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-yOGZ/notebook.ipynb 15:25 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while notebook /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-yOGZ/notebook.ipynb teardown: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-yOGZ/notebook.ipynb) doesn't exist. 15:25 INFO [databricks.labs.ucx.install] Deleting UCX v0.27.2+2820240702151247 from https://DATABRICKS_HOST 15:25 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_s56lk 15:25 INFO [databricks.labs.ucx.install] Deleting jobs 15:25 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=859379075716417. 15:25 INFO [databricks.labs.ucx.install] Deleting migrate-data-reconciliation job_id=345376216335061. 15:25 INFO [databricks.labs.ucx.install] Deleting failing job_id=826838127908920. 15:25 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=466502947443836. 15:25 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=392374417048329. 15:25 INFO [databricks.labs.ucx.install] Deleting migrate-external-hiveserde-tables-in-place-experimental job_id=924707708125838. 15:25 INFO [databricks.labs.ucx.install] Deleting scan-tables-in-mounts-experimental job_id=479711517060748. 15:25 INFO [databricks.labs.ucx.install] Deleting experimental-workflow-linter job_id=581604506400453. 15:25 INFO [databricks.labs.ucx.install] Deleting assessment job_id=315478591839942. 15:25 INFO [databricks.labs.ucx.install] Deleting migrate-external-tables-ctas job_id=113212244647914. 15:25 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=701147085593025. 15:25 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=743647133716945. 15:25 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=241445203824317. 15:25 INFO [databricks.labs.ucx.install] Deleting cluster policy 15:25 INFO [databricks.labs.ucx.install] Deleting secret scope 15:25 INFO [databricks.labs.ucx.install] UnInstalling UCX complete 15:25 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace user fixtures 15:25 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 account group fixtures 15:25 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures 15:25 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 15:25 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 15:25 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 schema fixtures 15:25 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s56lk', metastore_id=None, name='ucx_s56lk', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw0] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```
❌ test_table_migration_job_refreshes_migration_status[regular-migrate-tables]: AssertionError: No destination schema found for TableType.VIEW hive_metastore.migrate_haqeg.ucx_tziy1 given migration statuses Row(src_schema='migrate_haqeg', src_table='ucx_trzpz', dst_catalog='ucx_cp953', dst_schema='migrate_haqeg', dst_table='ucx_trzpz', update_ts='1719934293.127427') (28m3.643s) ``` AssertionError: No destination schema found for TableType.VIEW hive_metastore.migrate_haqeg.ucx_tziy1 given migration statuses Row(src_schema='migrate_haqeg', src_table='ucx_trzpz', dst_catalog='ucx_cp953', dst_schema='migrate_haqeg', dst_table='ucx_trzpz', update_ts='1719934293.127427') Row(src_schema='migrate_haqeg', src_table='ucx_thbmf', dst_catalog='ucx_cp953', dst_schema='migrate_haqeg', dst_table='ucx_thbmf', update_ts='1719934293.127427') Row(src_schema='migrate_haqeg', src_table='ucx_tqcqw', dst_catalog='ucx_cp953', dst_schema='migrate_haqeg', dst_table='ucx_tqcqw', update_ts='1719934293.127427') Row(src_schema='migrate_haqeg', src_table='ucx_tn3ux', dst_catalog='ucx_cp953', dst_schema='migrate_haqeg', dst_table='ucx_tn3ux', update_ts='1719934293.127427') Row(src_schema='migrate_haqeg', src_table='ucx_tziy1', dst_catalog=None, dst_schema=None, dst_table=None, update_ts='1719934293.127427') assert 1 == 0 + where 1 = len(['No destination schema found for TableType.VIEW hive_metastore.migrate_haqeg.ucx_tziy1']) 15:13 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/anrA 15:13 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.migrate_haqeg: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_haqeg 15:13 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_haqeg', metastore_id=None, name='migrate_haqeg', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:13 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_haqeg.ucx_trzpz: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_haqeg/ucx_trzpz 15:13 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_haqeg.ucx_trzpz', metastore_id=None, name='ucx_trzpz', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='migrate_haqeg', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_haqeg/ucx_trzpz', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:14 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_haqeg.ucx_thbmf: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_haqeg/ucx_thbmf 15:14 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_haqeg.ucx_thbmf', metastore_id=None, name='ucx_thbmf', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='migrate_haqeg', sql_path=None, storage_credential_name=None, storage_location='dbfs:/tmp/ucx_test_T0vx', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:14 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_haqeg.ucx_tqcqw: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_haqeg/ucx_tqcqw 15:14 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_haqeg.ucx_tqcqw', metastore_id=None, name='ucx_tqcqw', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='migrate_haqeg', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/anrA', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:15 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_haqeg.ucx_tn3ux: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_haqeg/ucx_tn3ux 15:15 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_haqeg.ucx_tn3ux', metastore_id=None, name='ucx_tn3ux', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='migrate_haqeg', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_haqeg.ucx_trzpz', view_dependencies=None) 15:16 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_haqeg.ucx_tziy1: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_haqeg/ucx_tziy1 15:16 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_haqeg.ucx_tziy1', metastore_id=None, name='ucx_tziy1', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='migrate_haqeg', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_haqeg.ucx_tn3ux', view_dependencies=None) 15:16 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1719933393016, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cp953', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cp953', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719933393016, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 15:17 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cp953.migrate_haqeg: https://DATABRICKS_HOST/explore/data/ucx_cp953/migrate_haqeg 15:17 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cp953', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cp953.migrate_haqeg', metastore_id=None, name='migrate_haqeg', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:17 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_szs2b: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_szs2b 15:17 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_szs2b', metastore_id=None, name='ucx_szs2b', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw3] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 15:13 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/anrA 15:13 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.migrate_haqeg: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_haqeg 15:13 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_haqeg', metastore_id=None, name='migrate_haqeg', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:13 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_haqeg.ucx_trzpz: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_haqeg/ucx_trzpz 15:13 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_haqeg.ucx_trzpz', metastore_id=None, name='ucx_trzpz', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='migrate_haqeg', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_haqeg/ucx_trzpz', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:14 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_haqeg.ucx_thbmf: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_haqeg/ucx_thbmf 15:14 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_haqeg.ucx_thbmf', metastore_id=None, name='ucx_thbmf', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='migrate_haqeg', sql_path=None, storage_credential_name=None, storage_location='dbfs:/tmp/ucx_test_T0vx', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:14 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_haqeg.ucx_tqcqw: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_haqeg/ucx_tqcqw 15:14 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_haqeg.ucx_tqcqw', metastore_id=None, name='ucx_tqcqw', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='migrate_haqeg', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/anrA', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:15 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_haqeg.ucx_tn3ux: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_haqeg/ucx_tn3ux 15:15 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_haqeg.ucx_tn3ux', metastore_id=None, name='ucx_tn3ux', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='migrate_haqeg', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_haqeg.ucx_trzpz', view_dependencies=None) 15:16 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_haqeg.ucx_tziy1: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_haqeg/ucx_tziy1 15:16 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_haqeg.ucx_tziy1', metastore_id=None, name='ucx_tziy1', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='migrate_haqeg', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_haqeg.ucx_tn3ux', view_dependencies=None) 15:16 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1719933393016, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cp953', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cp953', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719933393016, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 15:17 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cp953.migrate_haqeg: https://DATABRICKS_HOST/explore/data/ucx_cp953/migrate_haqeg 15:17 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cp953', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cp953.migrate_haqeg', metastore_id=None, name='migrate_haqeg', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:17 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_szs2b: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_szs2b 15:17 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_szs2b', metastore_id=None, name='ucx_szs2b', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:19 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.IMKN/config.yml) doesn't exist. 15:19 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 15:19 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 15:19 INFO [databricks.labs.ucx.install] Fetching installations... 15:19 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.IMKN is corrupted. Skipping... 15:19 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 15:19 DEBUG [tests.integration.conftest] Waiting for clusters to start... 15:19 DEBUG [tests.integration.conftest] Waiting for clusters to start... 15:19 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+2820240702151956 15:19 INFO [databricks.labs.ucx.install] Creating ucx schemas... 15:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 15:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 15:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 15:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 15:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 15:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 15:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 15:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 15:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 15:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 15:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 15:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 15:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 15:22 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.IMKN/README for the next steps. 15:22 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-tables job: https://DATABRICKS_HOST#job/964806190948560 15:13 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/anrA 15:13 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.migrate_haqeg: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_haqeg 15:13 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_haqeg', metastore_id=None, name='migrate_haqeg', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:13 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_haqeg.ucx_trzpz: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_haqeg/ucx_trzpz 15:13 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_haqeg.ucx_trzpz', metastore_id=None, name='ucx_trzpz', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='migrate_haqeg', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_haqeg/ucx_trzpz', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:14 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_haqeg.ucx_thbmf: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_haqeg/ucx_thbmf 15:14 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_haqeg.ucx_thbmf', metastore_id=None, name='ucx_thbmf', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='migrate_haqeg', sql_path=None, storage_credential_name=None, storage_location='dbfs:/tmp/ucx_test_T0vx', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:14 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_haqeg.ucx_tqcqw: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_haqeg/ucx_tqcqw 15:14 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_haqeg.ucx_tqcqw', metastore_id=None, name='ucx_tqcqw', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='migrate_haqeg', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/anrA', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:15 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_haqeg.ucx_tn3ux: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_haqeg/ucx_tn3ux 15:15 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_haqeg.ucx_tn3ux', metastore_id=None, name='ucx_tn3ux', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='migrate_haqeg', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_haqeg.ucx_trzpz', view_dependencies=None) 15:16 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_haqeg.ucx_tziy1: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_haqeg/ucx_tziy1 15:16 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_haqeg.ucx_tziy1', metastore_id=None, name='ucx_tziy1', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='migrate_haqeg', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_haqeg.ucx_tn3ux', view_dependencies=None) 15:16 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1719933393016, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cp953', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cp953', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719933393016, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 15:17 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cp953.migrate_haqeg: https://DATABRICKS_HOST/explore/data/ucx_cp953/migrate_haqeg 15:17 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cp953', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cp953.migrate_haqeg', metastore_id=None, name='migrate_haqeg', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:17 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_szs2b: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_szs2b 15:17 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_szs2b', metastore_id=None, name='ucx_szs2b', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:19 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.IMKN/config.yml) doesn't exist. 15:19 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 15:19 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 15:19 INFO [databricks.labs.ucx.install] Fetching installations... 15:19 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.IMKN is corrupted. Skipping... 15:19 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 15:19 DEBUG [tests.integration.conftest] Waiting for clusters to start... 15:19 DEBUG [tests.integration.conftest] Waiting for clusters to start... 15:19 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+2820240702151956 15:19 INFO [databricks.labs.ucx.install] Creating ucx schemas... 15:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 15:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 15:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 15:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 15:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 15:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 15:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 15:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 15:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 15:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 15:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 15:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 15:22 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 15:22 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.IMKN/README for the next steps. 15:22 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-tables job: https://DATABRICKS_HOST#job/964806190948560 15:36 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 make_storage_dir fixtures 15:36 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_dbfs_data_copy fixtures 15:36 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/anrA 15:36 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 cluster fixtures 15:36 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 catalog fixtures 15:36 DEBUG [databricks.labs.ucx.mixins.fixtures] removing catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1719933393016, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cp953', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cp953', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719933393016, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 15:36 INFO [databricks.labs.ucx.install] Deleting UCX v0.27.2+2820240702151956 from https://DATABRICKS_HOST 15:36 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_szs2b 15:37 INFO [databricks.labs.ucx.install] Deleting jobs 15:37 INFO [databricks.labs.ucx.install] Deleting migrate-external-hiveserde-tables-in-place-experimental job_id=291545696619902. 15:37 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=494105143285409. 15:37 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=622714701648303. 15:37 INFO [databricks.labs.ucx.install] Deleting experimental-workflow-linter job_id=922675466937888. 15:37 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=310977018470141. 15:37 INFO [databricks.labs.ucx.install] Deleting assessment job_id=30583501988883. 15:37 INFO [databricks.labs.ucx.install] Deleting migrate-external-tables-ctas job_id=410868510124089. 15:37 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=964806190948560. 15:37 INFO [databricks.labs.ucx.install] Deleting migrate-data-reconciliation job_id=517142463415963. 15:37 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=755245498018785. 15:37 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=136979167356902. 15:37 INFO [databricks.labs.ucx.install] Deleting scan-tables-in-mounts-experimental job_id=883688702231319. 15:37 INFO [databricks.labs.ucx.install] Deleting failing job_id=777597362107560. 15:37 INFO [databricks.labs.ucx.install] Deleting cluster policy 15:37 INFO [databricks.labs.ucx.install] Deleting secret scope 15:37 INFO [databricks.labs.ucx.install] UnInstalling UCX complete 15:37 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace user fixtures 15:37 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 account group fixtures 15:37 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures 15:37 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 15:37 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 5 table fixtures 15:37 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_haqeg.ucx_trzpz', metastore_id=None, name='ucx_trzpz', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='migrate_haqeg', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_haqeg/ucx_trzpz', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:38 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_haqeg.ucx_thbmf', metastore_id=None, name='ucx_thbmf', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='migrate_haqeg', sql_path=None, storage_credential_name=None, storage_location='dbfs:/tmp/ucx_test_T0vx', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:38 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_haqeg.ucx_tqcqw', metastore_id=None, name='ucx_tqcqw', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='migrate_haqeg', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/anrA', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:39 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_haqeg.ucx_tn3ux', metastore_id=None, name='ucx_tn3ux', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='migrate_haqeg', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_haqeg.ucx_trzpz', view_dependencies=None) 15:39 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while table TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_haqeg.ucx_tn3ux', metastore_id=None, name='ucx_tn3ux', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='migrate_haqeg', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_haqeg.ucx_trzpz', view_dependencies=None) teardown: [WRONG_COMMAND_FOR_OBJECT_TYPE] The operation DROP TABLE requires a EXTERNAL or MANAGED. But hive_metastore.migrate_haqeg.ucx_tn3ux is a VIEW. Use DROP VIEW instead. SQLSTATE: 42809 15:39 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_haqeg.ucx_tziy1', metastore_id=None, name='ucx_tziy1', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='migrate_haqeg', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_haqeg.ucx_tn3ux', view_dependencies=None) 15:40 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while table TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_haqeg.ucx_tziy1', metastore_id=None, name='ucx_tziy1', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='migrate_haqeg', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_haqeg.ucx_tn3ux', view_dependencies=None) teardown: [WRONG_COMMAND_FOR_OBJECT_TYPE] The operation DROP TABLE requires a EXTERNAL or MANAGED. But hive_metastore.migrate_haqeg.ucx_tziy1 is a VIEW. Use DROP VIEW instead. SQLSTATE: 42809 15:40 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 schema fixtures 15:40 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_haqeg', metastore_id=None, name='migrate_haqeg', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:40 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cp953', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cp953.migrate_haqeg', metastore_id=None, name='migrate_haqeg', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:40 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_szs2b', metastore_id=None, name='ucx_szs2b', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw3] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```
❌ test_migrate_table_in_mount: databricks.sdk.errors.platform.BadRequest: [SCHEMA_ALREADY_EXISTS] Cannot create schema `mounted_TEST_MOUNT_NAME` because it already exists. (1m4.304s) ``` databricks.sdk.errors.platform.BadRequest: [SCHEMA_ALREADY_EXISTS] Cannot create schema `mounted_TEST_MOUNT_NAME` because it already exists. Choose a different name, drop the existing schema, or add the IF NOT EXISTS clause to tolerate pre-existing schema. SQLSTATE: 42P06 15:40 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sca8u: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sca8u 15:40 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sca8u', metastore_id=None, name='ucx_sca8u', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw6] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 15:40 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sca8u: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sca8u 15:40 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sca8u', metastore_id=None, name='ucx_sca8u', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:40 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sca8u: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sca8u 15:40 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sca8u', metastore_id=None, name='ucx_sca8u', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:41 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 account group fixtures 15:41 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures 15:41 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 15:41 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 15:41 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 catalog fixtures 15:41 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 schema fixtures 15:41 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sca8u', metastore_id=None, name='ucx_sca8u', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw6] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```

Running from acceptance #4128