whitelist bioinfokit - Githubissues

❌ 87/90 passed, 3 failed, 22 skipped, 4h57m15s total

❌ test_create_catalog_schema_with_principal_acl_CLOUD_ENV: AssertionError: assert PrivilegeAssignment(principal='sdk-g0i4wcku@example.com', privileges=[]) in [PrivilegeAssignment(principal='serge.smertin@databricks.com', privileges=[]), Pri...geAssignment(principal='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', privileges=[]), ...] (9m35.34s)

``` AssertionError: assert PrivilegeAssignment(principal='sdk-g0i4wcku@example.com', privileges=[]) in [PrivilegeAssignment(principal='serge.smertin@databricks.com', privileges=[]), Pri...geAssignment(principal='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', privileges=[]), ...] + where [PrivilegeAssignment(principal='serge.smertin@databricks.com', privileges=[]), Pri...geAssignment(principal='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', privileges=[]), ...] = PermissionsList(privilege_assignments=[PrivilegeAssignment(principal='serge.smertin@databricks.com', privileges=[]), PrivilegeAssignment(principal='sdk-wqc9i8wx@example.com', privileges=[])]).privilege_assignments 10:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/L27Y 10:12 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sis64: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sis64 10:12 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sis64', metastore_id=None, name='ucx_sis64', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 10:12 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_sis64.ucx_tojxw: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sis64/ucx_tojxw 10:12 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sis64.ucx_tojxw', metastore_id=None, name='ucx_tojxw', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070311'}, row_filter=None, schema_name='ucx_sis64', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/L27Y', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 10:12 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720001573090, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cegp6', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cegp6', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720001573090, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 10:13 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cegp6.ucx_sis64: https://DATABRICKS_HOST/explore/data/ucx_cegp6/ucx_sis64 10:13 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cegp6', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cegp6.ucx_sis64', metastore_id=None, name='ucx_sis64', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw9] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 10:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/L27Y 10:12 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sis64: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sis64 10:12 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sis64', metastore_id=None, name='ucx_sis64', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 10:12 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_sis64.ucx_tojxw: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sis64/ucx_tojxw 10:12 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sis64.ucx_tojxw', metastore_id=None, name='ucx_tojxw', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070311'}, row_filter=None, schema_name='ucx_sis64', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/L27Y', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 10:12 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720001573090, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cegp6', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cegp6', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720001573090, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 10:13 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cegp6.ucx_sis64: https://DATABRICKS_HOST/explore/data/ucx_cegp6/ucx_sis64 10:13 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cegp6', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cegp6.ucx_sis64', metastore_id=None, name='ucx_sis64', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 10:13 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: 10:13 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-jcdsocp8@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-jcdsocp8@example.com')], entitlements=[], external_id=None, groups=[], id='2926916247100671', name=Name(family_name=None, given_name='sdk-jcdsocp8@example.com'), roles=[], schemas=[, ], user_name='sdk-jcdsocp8@example.com') 10:13 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0703-101303-d3a0ieb2 [group_name admins CAN_MANAGE] -> [user_name sdk-jcdsocp8@example.com CAN_ATTACH_TO] 10:13 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sgcdn: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sgcdn 10:13 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sgcdn', metastore_id=None, name='ucx_sgcdn', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 10:13 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 10:13 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 10:13 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 10:13 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 10:13 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 10:13 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 10:13 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 10:13 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 10:13 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 10:13 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 10:13 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 10:13 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Listing existing UC catalogs and schemas 10:13 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: 10:13 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-g0i4wcku@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-g0i4wcku@example.com')], entitlements=[], external_id=None, groups=[], id='4602871518726202', name=Name(family_name=None, given_name='sdk-g0i4wcku@example.com'), roles=[], schemas=[, ], user_name='sdk-g0i4wcku@example.com') 10:13 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0703-101334-uta868ox [group_name admins CAN_MANAGE] -> [user_name sdk-g0i4wcku@example.com CAN_ATTACH_TO] 10:13 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Listing existing UC catalogs and schemas 10:13 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Preparing a list of UC catalogs and schema to be created 10:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sgcdn.tables] fetching tables inventory 10:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sgcdn.tables] crawling new batch for tables 10:14 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sis64] listing tables 10:14 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sis64.ucx_tojxw] fetching table metadata 10:15 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sgcdn.tables] found 1 new records for tables 10:16 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cegp6.ucx_sis64') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cegp6.ucx_sis64 TO `serge.smertin@databricks.com` 10:16 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cegp6.ucx_sis64') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cegp6.ucx_sis64 TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d` 10:16 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cegp6.ucx_sis64') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cegp6.ucx_sis64 TO `sdk-aw9i6xjl@example.com` 10:16 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cegp6.ucx_sis64') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cegp6.ucx_sis64 TO `sdk-wqc9i8wx@example.com` 10:17 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cegp6.ucx_sis64') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cegp6.ucx_sis64 TO `5a11359f-ba1f-483f-8e00-0fe55ec003ed` 10:17 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cegp6.ucx_sis64') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cegp6.ucx_sis64 TO `sdk-jcdsocp8@example.com` 10:18 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cegp6.ucx_sis64') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cegp6.ucx_sis64 TO `sdk-vcmdqmhs@example.com` 10:18 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cegp6.ucx_sis64') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cegp6.ucx_sis64 TO `ucx_GsmsF` 10:18 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cegp6') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cegp6 TO `sdk-jcdsocp8@example.com` 10:18 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cegp6') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cegp6 TO `sdk-wqc9i8wx@example.com` 10:18 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cegp6') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cegp6 TO `serge.smertin@databricks.com` 10:18 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cegp6') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cegp6 TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d` 10:19 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cegp6') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cegp6 TO `5a11359f-ba1f-483f-8e00-0fe55ec003ed` 10:19 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cegp6') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cegp6 TO `ucx_GsmsF` 10:19 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cegp6') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cegp6 TO `sdk-vcmdqmhs@example.com` 10:20 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cegp6') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cegp6 TO `sdk-aw9i6xjl@example.com` 10:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/L27Y 10:12 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sis64: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sis64 10:12 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sis64', metastore_id=None, name='ucx_sis64', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 10:12 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_sis64.ucx_tojxw: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sis64/ucx_tojxw 10:12 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sis64.ucx_tojxw', metastore_id=None, name='ucx_tojxw', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070311'}, row_filter=None, schema_name='ucx_sis64', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/L27Y', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 10:12 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720001573090, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cegp6', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cegp6', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720001573090, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 10:13 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cegp6.ucx_sis64: https://DATABRICKS_HOST/explore/data/ucx_cegp6/ucx_sis64 10:13 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cegp6', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cegp6.ucx_sis64', metastore_id=None, name='ucx_sis64', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 10:13 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: 10:13 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-jcdsocp8@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-jcdsocp8@example.com')], entitlements=[], external_id=None, groups=[], id='2926916247100671', name=Name(family_name=None, given_name='sdk-jcdsocp8@example.com'), roles=[], schemas=[, ], user_name='sdk-jcdsocp8@example.com') 10:13 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0703-101303-d3a0ieb2 [group_name admins CAN_MANAGE] -> [user_name sdk-jcdsocp8@example.com CAN_ATTACH_TO] 10:13 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sgcdn: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sgcdn 10:13 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sgcdn', metastore_id=None, name='ucx_sgcdn', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 10:13 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 10:13 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 10:13 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 10:13 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 10:13 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 10:13 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 10:13 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 10:13 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 10:13 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 10:13 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 10:13 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 10:13 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Listing existing UC catalogs and schemas 10:13 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: 10:13 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-g0i4wcku@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-g0i4wcku@example.com')], entitlements=[], external_id=None, groups=[], id='4602871518726202', name=Name(family_name=None, given_name='sdk-g0i4wcku@example.com'), roles=[], schemas=[, ], user_name='sdk-g0i4wcku@example.com') 10:13 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0703-101334-uta868ox [group_name admins CAN_MANAGE] -> [user_name sdk-g0i4wcku@example.com CAN_ATTACH_TO] 10:13 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Listing existing UC catalogs and schemas 10:13 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Preparing a list of UC catalogs and schema to be created 10:13 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sgcdn.tables] fetching tables inventory 10:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sgcdn.tables] crawling new batch for tables 10:14 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sis64] listing tables 10:14 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sis64.ucx_tojxw] fetching table metadata 10:15 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sgcdn.tables] found 1 new records for tables 10:16 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cegp6.ucx_sis64') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cegp6.ucx_sis64 TO `serge.smertin@databricks.com` 10:16 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cegp6.ucx_sis64') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cegp6.ucx_sis64 TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d` 10:16 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cegp6.ucx_sis64') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cegp6.ucx_sis64 TO `sdk-aw9i6xjl@example.com` 10:16 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cegp6.ucx_sis64') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cegp6.ucx_sis64 TO `sdk-wqc9i8wx@example.com` 10:17 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cegp6.ucx_sis64') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cegp6.ucx_sis64 TO `5a11359f-ba1f-483f-8e00-0fe55ec003ed` 10:17 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cegp6.ucx_sis64') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cegp6.ucx_sis64 TO `sdk-jcdsocp8@example.com` 10:18 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cegp6.ucx_sis64') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cegp6.ucx_sis64 TO `sdk-vcmdqmhs@example.com` 10:18 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cegp6.ucx_sis64') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cegp6.ucx_sis64 TO `ucx_GsmsF` 10:18 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cegp6') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cegp6 TO `sdk-jcdsocp8@example.com` 10:18 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cegp6') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cegp6 TO `sdk-wqc9i8wx@example.com` 10:18 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cegp6') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cegp6 TO `serge.smertin@databricks.com` 10:18 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cegp6') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cegp6 TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d` 10:19 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cegp6') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cegp6 TO `5a11359f-ba1f-483f-8e00-0fe55ec003ed` 10:19 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cegp6') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cegp6 TO `ucx_GsmsF` 10:19 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cegp6') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cegp6 TO `sdk-vcmdqmhs@example.com` 10:20 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cegp6') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cegp6 TO `sdk-aw9i6xjl@example.com` 10:20 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 cluster permissions fixtures 10:20 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster permissions fixture: 0703-101303-d3a0ieb2 [group_name admins CAN_MANAGE] -> [user_name sdk-jcdsocp8@example.com CAN_ATTACH_TO] 10:20 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster permissions fixture: 0703-101334-uta868ox [group_name admins CAN_MANAGE] -> [user_name sdk-g0i4wcku@example.com CAN_ATTACH_TO] 10:20 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 catalog fixtures 10:20 DEBUG [databricks.labs.ucx.mixins.fixtures] removing catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720001573090, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cegp6', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cegp6', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720001573090, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 10:20 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_dbfs_data_copy fixtures 10:20 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/L27Y 10:20 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 cluster fixtures 10:20 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster fixture: 10:20 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster fixture: 10:20 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures 10:20 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 10:20 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 table fixtures 10:20 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sis64.ucx_tojxw', metastore_id=None, name='ucx_tojxw', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070311'}, row_filter=None, schema_name='ucx_sis64', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/L27Y', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 10:20 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 schema fixtures 10:20 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sis64', metastore_id=None, name='ucx_sis64', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 10:20 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cegp6', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cegp6.ucx_sis64', metastore_id=None, name='ucx_sis64', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 10:21 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sgcdn', metastore_id=None, name='ucx_sgcdn', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 10:21 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 workspace user fixtures 10:21 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='sdk-jcdsocp8@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-jcdsocp8@example.com')], entitlements=[], external_id=None, groups=[], id='2926916247100671', name=Name(family_name=None, given_name='sdk-jcdsocp8@example.com'), roles=[], schemas=[, ], user_name='sdk-jcdsocp8@example.com') 10:21 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='sdk-g0i4wcku@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-g0i4wcku@example.com')], entitlements=[], external_id=None, groups=[], id='4602871518726202', name=Name(family_name=None, given_name='sdk-g0i4wcku@example.com'), roles=[], schemas=[, ], user_name='sdk-g0i4wcku@example.com') [gw9] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```

❌ test_table_migration_job_refreshes_migration_status[regular-migrate-tables]: TimeoutError: Timed out after 0:05:00 (18m39.243s)

``` TimeoutError: Timed out after 0:05:00 10:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/W4GW 10:31 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.migrate_trfld: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_trfld 10:31 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_trfld', metastore_id=None, name='migrate_trfld', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 10:31 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_trfld.ucx_trpyc: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_trfld/ucx_trpyc 10:31 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_trfld.ucx_trpyc', metastore_id=None, name='ucx_trpyc', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070311'}, row_filter=None, schema_name='migrate_trfld', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_trfld/ucx_trpyc', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 10:31 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_trfld.ucx_t3ev4: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_trfld/ucx_t3ev4 10:31 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_trfld.ucx_t3ev4', metastore_id=None, name='ucx_t3ev4', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070311'}, row_filter=None, schema_name='migrate_trfld', sql_path=None, storage_credential_name=None, storage_location='dbfs:/tmp/ucx_test_agXs', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 10:32 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_trfld.ucx_tw1l2: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_trfld/ucx_tw1l2 10:32 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_trfld.ucx_tw1l2', metastore_id=None, name='ucx_tw1l2', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070311'}, row_filter=None, schema_name='migrate_trfld', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/W4GW', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 10:32 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_trfld.ucx_t7lg7: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_trfld/ucx_t7lg7 10:32 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_trfld.ucx_t7lg7', metastore_id=None, name='ucx_t7lg7', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070311'}, row_filter=None, schema_name='migrate_trfld', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_trfld.ucx_trpyc', view_dependencies=None) 10:33 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_trfld.ucx_txtg3: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_trfld/ucx_txtg3 10:33 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_trfld.ucx_txtg3', metastore_id=None, name='ucx_txtg3', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070311'}, row_filter=None, schema_name='migrate_trfld', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_trfld.ucx_t7lg7', view_dependencies=None) 10:33 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720002807306, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_csslr', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_csslr', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720002807306, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 10:33 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_csslr.migrate_trfld: https://DATABRICKS_HOST/explore/data/ucx_csslr/migrate_trfld 10:33 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_csslr', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_csslr.migrate_trfld', metastore_id=None, name='migrate_trfld', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 10:34 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_spdct: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_spdct 10:34 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_spdct', metastore_id=None, name='ucx_spdct', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw5] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 10:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/W4GW 10:31 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.migrate_trfld: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_trfld 10:31 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_trfld', metastore_id=None, name='migrate_trfld', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 10:31 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_trfld.ucx_trpyc: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_trfld/ucx_trpyc 10:31 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_trfld.ucx_trpyc', metastore_id=None, name='ucx_trpyc', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070311'}, row_filter=None, schema_name='migrate_trfld', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_trfld/ucx_trpyc', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 10:31 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_trfld.ucx_t3ev4: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_trfld/ucx_t3ev4 10:31 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_trfld.ucx_t3ev4', metastore_id=None, name='ucx_t3ev4', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070311'}, row_filter=None, schema_name='migrate_trfld', sql_path=None, storage_credential_name=None, storage_location='dbfs:/tmp/ucx_test_agXs', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 10:32 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_trfld.ucx_tw1l2: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_trfld/ucx_tw1l2 10:32 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_trfld.ucx_tw1l2', metastore_id=None, name='ucx_tw1l2', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070311'}, row_filter=None, schema_name='migrate_trfld', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/W4GW', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 10:32 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_trfld.ucx_t7lg7: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_trfld/ucx_t7lg7 10:32 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_trfld.ucx_t7lg7', metastore_id=None, name='ucx_t7lg7', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070311'}, row_filter=None, schema_name='migrate_trfld', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_trfld.ucx_trpyc', view_dependencies=None) 10:33 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_trfld.ucx_txtg3: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_trfld/ucx_txtg3 10:33 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_trfld.ucx_txtg3', metastore_id=None, name='ucx_txtg3', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070311'}, row_filter=None, schema_name='migrate_trfld', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_trfld.ucx_t7lg7', view_dependencies=None) 10:33 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720002807306, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_csslr', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_csslr', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720002807306, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 10:33 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_csslr.migrate_trfld: https://DATABRICKS_HOST/explore/data/ucx_csslr/migrate_trfld 10:33 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_csslr', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_csslr.migrate_trfld', metastore_id=None, name='migrate_trfld', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 10:34 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_spdct: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_spdct 10:34 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_spdct', metastore_id=None, name='ucx_spdct', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 10:36 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.QLie/config.yml) doesn't exist. 10:36 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 10:36 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 10:36 INFO [databricks.labs.ucx.install] Fetching installations... 10:36 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.QLie is corrupted. Skipping... 10:36 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 10:36 DEBUG [tests.integration.conftest] Waiting for clusters to start... 10:36 DEBUG [tests.integration.conftest] Waiting for clusters to start... 10:36 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+7020240703103653 10:36 INFO [databricks.labs.ucx.install] Creating ucx schemas... 10:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 10:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 10:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 10:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 10:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 10:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 10:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 10:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 10:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 10:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 10:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 10:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 10:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 10:40 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.QLie/README for the next steps. 10:40 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-tables job: https://DATABRICKS_HOST#job/134200808568029 10:30 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/W4GW 10:31 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.migrate_trfld: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_trfld 10:31 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_trfld', metastore_id=None, name='migrate_trfld', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 10:31 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_trfld.ucx_trpyc: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_trfld/ucx_trpyc 10:31 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_trfld.ucx_trpyc', metastore_id=None, name='ucx_trpyc', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070311'}, row_filter=None, schema_name='migrate_trfld', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_trfld/ucx_trpyc', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 10:31 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_trfld.ucx_t3ev4: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_trfld/ucx_t3ev4 10:31 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_trfld.ucx_t3ev4', metastore_id=None, name='ucx_t3ev4', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070311'}, row_filter=None, schema_name='migrate_trfld', sql_path=None, storage_credential_name=None, storage_location='dbfs:/tmp/ucx_test_agXs', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 10:32 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_trfld.ucx_tw1l2: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_trfld/ucx_tw1l2 10:32 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_trfld.ucx_tw1l2', metastore_id=None, name='ucx_tw1l2', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070311'}, row_filter=None, schema_name='migrate_trfld', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/W4GW', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 10:32 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_trfld.ucx_t7lg7: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_trfld/ucx_t7lg7 10:32 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_trfld.ucx_t7lg7', metastore_id=None, name='ucx_t7lg7', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070311'}, row_filter=None, schema_name='migrate_trfld', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_trfld.ucx_trpyc', view_dependencies=None) 10:33 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_trfld.ucx_txtg3: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_trfld/ucx_txtg3 10:33 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_trfld.ucx_txtg3', metastore_id=None, name='ucx_txtg3', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070311'}, row_filter=None, schema_name='migrate_trfld', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_trfld.ucx_t7lg7', view_dependencies=None) 10:33 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720002807306, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_csslr', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_csslr', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720002807306, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 10:33 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_csslr.migrate_trfld: https://DATABRICKS_HOST/explore/data/ucx_csslr/migrate_trfld 10:33 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_csslr', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_csslr.migrate_trfld', metastore_id=None, name='migrate_trfld', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 10:34 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_spdct: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_spdct 10:34 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_spdct', metastore_id=None, name='ucx_spdct', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 10:36 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.QLie/config.yml) doesn't exist. 10:36 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 10:36 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 10:36 INFO [databricks.labs.ucx.install] Fetching installations... 10:36 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.QLie is corrupted. Skipping... 10:36 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 10:36 DEBUG [tests.integration.conftest] Waiting for clusters to start... 10:36 DEBUG [tests.integration.conftest] Waiting for clusters to start... 10:36 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+7020240703103653 10:36 INFO [databricks.labs.ucx.install] Creating ucx schemas... 10:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 10:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 10:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 10:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 10:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 10:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 10:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 10:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 10:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 10:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 10:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 10:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 10:40 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 10:40 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.QLie/README for the next steps. 10:40 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-tables job: https://DATABRICKS_HOST#job/134200808568029 10:44 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 make_storage_dir fixtures 10:44 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_dbfs_data_copy fixtures 10:44 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/W4GW 10:44 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 cluster fixtures 10:44 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 catalog fixtures 10:44 DEBUG [databricks.labs.ucx.mixins.fixtures] removing catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720002807306, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_csslr', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_csslr', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720002807306, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 10:44 INFO [databricks.labs.ucx.install] Deleting UCX v0.27.2+7020240703103653 from https://DATABRICKS_HOST 10:44 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_spdct 10:45 INFO [databricks.labs.ucx.install] Deleting jobs 10:45 INFO [databricks.labs.ucx.install] Deleting experimental-workflow-linter job_id=267469009158641. 10:45 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=361824616747860. 10:45 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=15316814800179. 10:45 INFO [databricks.labs.ucx.install] Deleting migrate-data-reconciliation job_id=553688829779211. 10:45 INFO [databricks.labs.ucx.install] Deleting migrate-external-hiveserde-tables-in-place-experimental job_id=903734849370872. 10:45 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=134200808568029. 10:45 INFO [databricks.labs.ucx.install] Deleting scan-tables-in-mounts-experimental job_id=940915131049341. 10:45 INFO [databricks.labs.ucx.install] Deleting assessment job_id=1090575023561146. 10:45 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=1024950220026506. 10:45 INFO [databricks.labs.ucx.install] Deleting migrate-external-tables-ctas job_id=177058191594236. 10:45 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=782037774578152. 10:45 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=493010266566084. 10:45 INFO [databricks.labs.ucx.install] Deleting failing job_id=956682798630577. 10:45 INFO [databricks.labs.ucx.install] Deleting cluster policy 10:45 INFO [databricks.labs.ucx.install] Deleting secret scope 10:45 INFO [databricks.labs.ucx.install] UnInstalling UCX complete 10:45 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace user fixtures 10:45 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 account group fixtures 10:45 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures 10:45 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 10:45 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 5 table fixtures 10:45 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_trfld.ucx_trpyc', metastore_id=None, name='ucx_trpyc', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070311'}, row_filter=None, schema_name='migrate_trfld', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_trfld/ucx_trpyc', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 10:45 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_trfld.ucx_t3ev4', metastore_id=None, name='ucx_t3ev4', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070311'}, row_filter=None, schema_name='migrate_trfld', sql_path=None, storage_credential_name=None, storage_location='dbfs:/tmp/ucx_test_agXs', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 10:46 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_trfld.ucx_tw1l2', metastore_id=None, name='ucx_tw1l2', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070311'}, row_filter=None, schema_name='migrate_trfld', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/W4GW', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 10:46 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_trfld.ucx_t7lg7', metastore_id=None, name='ucx_t7lg7', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070311'}, row_filter=None, schema_name='migrate_trfld', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_trfld.ucx_trpyc', view_dependencies=None) 10:47 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while table TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_trfld.ucx_t7lg7', metastore_id=None, name='ucx_t7lg7', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070311'}, row_filter=None, schema_name='migrate_trfld', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_trfld.ucx_trpyc', view_dependencies=None) teardown: [WRONG_COMMAND_FOR_OBJECT_TYPE] The operation DROP TABLE requires a EXTERNAL or MANAGED. But hive_metastore.migrate_trfld.ucx_t7lg7 is a VIEW. Use DROP VIEW instead. SQLSTATE: 42809 10:47 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_trfld.ucx_txtg3', metastore_id=None, name='ucx_txtg3', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070311'}, row_filter=None, schema_name='migrate_trfld', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_trfld.ucx_t7lg7', view_dependencies=None) 10:47 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while table TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_trfld.ucx_txtg3', metastore_id=None, name='ucx_txtg3', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070311'}, row_filter=None, schema_name='migrate_trfld', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_trfld.ucx_t7lg7', view_dependencies=None) teardown: [WRONG_COMMAND_FOR_OBJECT_TYPE] The operation DROP TABLE requires a EXTERNAL or MANAGED. But hive_metastore.migrate_trfld.ucx_txtg3 is a VIEW. Use DROP VIEW instead. SQLSTATE: 42809 10:47 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 schema fixtures 10:47 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_trfld', metastore_id=None, name='migrate_trfld', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 10:48 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_csslr', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_csslr.migrate_trfld', metastore_id=None, name='migrate_trfld', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 10:48 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_spdct', metastore_id=None, name='ucx_spdct', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw5] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```

❌ test_migrate_table_in_mount: databricks.sdk.errors.platform.BadRequest: [SCHEMA_ALREADY_EXISTS] Cannot create schema `mounted_TEST_MOUNT_NAME` because it already exists. (1m19.039s)

``` databricks.sdk.errors.platform.BadRequest: [SCHEMA_ALREADY_EXISTS] Cannot create schema `mounted_TEST_MOUNT_NAME` because it already exists. Choose a different name, drop the existing schema, or add the IF NOT EXISTS clause to tolerate pre-existing schema. SQLSTATE: 42P06 10:50 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s7rhc: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s7rhc 10:50 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s7rhc', metastore_id=None, name='ucx_s7rhc', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw3] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 10:50 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s7rhc: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s7rhc 10:50 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s7rhc', metastore_id=None, name='ucx_s7rhc', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 10:50 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s7rhc: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s7rhc 10:50 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s7rhc', metastore_id=None, name='ucx_s7rhc', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 10:50 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 account group fixtures 10:50 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures 10:50 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 10:50 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 10:50 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 catalog fixtures 10:50 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 schema fixtures 10:50 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s7rhc', metastore_id=None, name='ucx_s7rhc', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw3] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```

_{Running from acceptance #4252}

databrickslabs / ucx

whitelist bioinfokit #2031

Changes

Linked issues

Functionality

Tests