whitelist spark-nlp - Githubissues

❌ 88/91 passed, 3 failed, 20 skipped, 5h28m3s total

❌ test_create_catalog_schema_with_principal_acl_CLOUD_ENV: AssertionError: assert PrivilegeAssignment(principal='sdk-qj04ui4g@example.com', privileges=[]) in [PrivilegeAssignment(principal='serge.smertin@databricks.com', privileges=[]), Pri...>]), PrivilegeAssignment(principal='sdk-ptuff04w@example.com', privileges=[]), ...] (10m53.528s)

``` AssertionError: assert PrivilegeAssignment(principal='sdk-qj04ui4g@example.com', privileges=[]) in [PrivilegeAssignment(principal='serge.smertin@databricks.com', privileges=[]), Pri...>]), PrivilegeAssignment(principal='sdk-ptuff04w@example.com', privileges=[]), ...] + where [PrivilegeAssignment(principal='serge.smertin@databricks.com', privileges=[]), Pri...>]), PrivilegeAssignment(principal='sdk-ptuff04w@example.com', privileges=[]), ...] = PermissionsList(privilege_assignments=[PrivilegeAssignment(principal='serge.smertin@databricks.com', privileges=[]), PrivilegeAssignment(principal='sdk-bcviwhay@example.com', privileges=[])]).privilege_assignments 15:14 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/cQnn 15:14 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_smzxk: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_smzxk 15:14 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_smzxk', metastore_id=None, name='ucx_smzxk', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:15 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_smzxk.ucx_tanhe: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_smzxk/ucx_tanhe 15:15 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_smzxk.ucx_tanhe', metastore_id=None, name='ucx_tanhe', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='ucx_smzxk', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/cQnn', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:15 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1719933328655, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cys5z', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cys5z', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719933328655, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 15:15 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cys5z.ucx_smzxk: https://DATABRICKS_HOST/explore/data/ucx_cys5z/ucx_smzxk 15:15 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cys5z', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cys5z.ucx_smzxk', metastore_id=None, name='ucx_smzxk', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw8] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 15:14 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/cQnn 15:14 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_smzxk: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_smzxk 15:14 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_smzxk', metastore_id=None, name='ucx_smzxk', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:15 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_smzxk.ucx_tanhe: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_smzxk/ucx_tanhe 15:15 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_smzxk.ucx_tanhe', metastore_id=None, name='ucx_tanhe', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='ucx_smzxk', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/cQnn', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:15 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1719933328655, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cys5z', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cys5z', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719933328655, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 15:15 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cys5z.ucx_smzxk: https://DATABRICKS_HOST/explore/data/ucx_cys5z/ucx_smzxk 15:15 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cys5z', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cys5z.ucx_smzxk', metastore_id=None, name='ucx_smzxk', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:15 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: 15:15 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-bcviwhay@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-bcviwhay@example.com')], entitlements=[], external_id=None, groups=[], id='1111845515386225', name=Name(family_name=None, given_name='sdk-bcviwhay@example.com'), roles=[], schemas=[, ], user_name='sdk-bcviwhay@example.com') 15:16 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0702-151552-6noyfkcv [group_name admins CAN_MANAGE] -> [user_name sdk-bcviwhay@example.com CAN_ATTACH_TO] 15:16 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sjd8t: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sjd8t 15:16 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sjd8t', metastore_id=None, name='ucx_sjd8t', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:16 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:16 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:16 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:16 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:16 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:16 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:16 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:16 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Listing existing UC catalogs and schemas 15:16 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: 15:16 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-qj04ui4g@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-qj04ui4g@example.com')], entitlements=[], external_id=None, groups=[], id='806972500944192', name=Name(family_name=None, given_name='sdk-qj04ui4g@example.com'), roles=[], schemas=[, ], user_name='sdk-qj04ui4g@example.com') 15:16 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0702-151628-6676k0o2 [group_name admins CAN_MANAGE] -> [user_name sdk-qj04ui4g@example.com CAN_ATTACH_TO] 15:16 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Listing existing UC catalogs and schemas 15:16 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Preparing a list of UC catalogs and schema to be created 15:16 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sjd8t.tables] fetching tables inventory 15:17 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sjd8t.tables] crawling new batch for tables 15:17 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_smzxk] listing tables 15:17 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_smzxk.ucx_tanhe] fetching table metadata 15:17 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sjd8t.tables] found 1 new records for tables 15:18 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cys5z.ucx_smzxk') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cys5z.ucx_smzxk TO `sdk-ptuff04w@example.com` 15:19 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cys5z.ucx_smzxk') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cys5z.ucx_smzxk TO `sdk-nzf2nwou@example.com` 15:19 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cys5z.ucx_smzxk') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cys5z.ucx_smzxk TO `serge.smertin@databricks.com` 15:19 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cys5z.ucx_smzxk') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cys5z.ucx_smzxk TO `sdk-bcviwhay@example.com` 15:20 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cys5z.ucx_smzxk') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cys5z.ucx_smzxk TO `5a11359f-ba1f-483f-8e00-0fe55ec003ed` 15:20 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cys5z.ucx_smzxk') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cys5z.ucx_smzxk TO `ucx_G9uTu` 15:20 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cys5z.ucx_smzxk') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cys5z.ucx_smzxk TO `sdk-d2god8vc@example.com` 15:20 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cys5z.ucx_smzxk') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cys5z.ucx_smzxk TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d` 15:21 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cys5z') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cys5z TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d` 15:21 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cys5z') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cys5z TO `ucx_G9uTu` 15:21 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cys5z') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cys5z TO `sdk-bcviwhay@example.com` 15:21 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cys5z') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cys5z TO `sdk-d2god8vc@example.com` 15:22 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cys5z') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cys5z TO `5a11359f-ba1f-483f-8e00-0fe55ec003ed` 15:22 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cys5z') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cys5z TO `serge.smertin@databricks.com` 15:22 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cys5z') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cys5z TO `sdk-ptuff04w@example.com` 15:22 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cys5z') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cys5z TO `sdk-nzf2nwou@example.com` 15:14 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/cQnn 15:14 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_smzxk: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_smzxk 15:14 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_smzxk', metastore_id=None, name='ucx_smzxk', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:15 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_smzxk.ucx_tanhe: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_smzxk/ucx_tanhe 15:15 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_smzxk.ucx_tanhe', metastore_id=None, name='ucx_tanhe', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='ucx_smzxk', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/cQnn', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:15 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1719933328655, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cys5z', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cys5z', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719933328655, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 15:15 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cys5z.ucx_smzxk: https://DATABRICKS_HOST/explore/data/ucx_cys5z/ucx_smzxk 15:15 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cys5z', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cys5z.ucx_smzxk', metastore_id=None, name='ucx_smzxk', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:15 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: 15:15 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-bcviwhay@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-bcviwhay@example.com')], entitlements=[], external_id=None, groups=[], id='1111845515386225', name=Name(family_name=None, given_name='sdk-bcviwhay@example.com'), roles=[], schemas=[, ], user_name='sdk-bcviwhay@example.com') 15:16 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0702-151552-6noyfkcv [group_name admins CAN_MANAGE] -> [user_name sdk-bcviwhay@example.com CAN_ATTACH_TO] 15:16 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sjd8t: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sjd8t 15:16 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sjd8t', metastore_id=None, name='ucx_sjd8t', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:16 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:16 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:16 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:16 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:16 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:16 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:16 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:16 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Listing existing UC catalogs and schemas 15:16 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: 15:16 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-qj04ui4g@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-qj04ui4g@example.com')], entitlements=[], external_id=None, groups=[], id='806972500944192', name=Name(family_name=None, given_name='sdk-qj04ui4g@example.com'), roles=[], schemas=[, ], user_name='sdk-qj04ui4g@example.com') 15:16 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0702-151628-6676k0o2 [group_name admins CAN_MANAGE] -> [user_name sdk-qj04ui4g@example.com CAN_ATTACH_TO] 15:16 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Listing existing UC catalogs and schemas 15:16 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Preparing a list of UC catalogs and schema to be created 15:16 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sjd8t.tables] fetching tables inventory 15:17 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sjd8t.tables] crawling new batch for tables 15:17 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_smzxk] listing tables 15:17 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_smzxk.ucx_tanhe] fetching table metadata 15:17 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sjd8t.tables] found 1 new records for tables 15:18 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cys5z.ucx_smzxk') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cys5z.ucx_smzxk TO `sdk-ptuff04w@example.com` 15:19 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cys5z.ucx_smzxk') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cys5z.ucx_smzxk TO `sdk-nzf2nwou@example.com` 15:19 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cys5z.ucx_smzxk') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cys5z.ucx_smzxk TO `serge.smertin@databricks.com` 15:19 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cys5z.ucx_smzxk') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cys5z.ucx_smzxk TO `sdk-bcviwhay@example.com` 15:20 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cys5z.ucx_smzxk') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cys5z.ucx_smzxk TO `5a11359f-ba1f-483f-8e00-0fe55ec003ed` 15:20 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cys5z.ucx_smzxk') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cys5z.ucx_smzxk TO `ucx_G9uTu` 15:20 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cys5z.ucx_smzxk') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cys5z.ucx_smzxk TO `sdk-d2god8vc@example.com` 15:20 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cys5z.ucx_smzxk') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cys5z.ucx_smzxk TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d` 15:21 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cys5z') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cys5z TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d` 15:21 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cys5z') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cys5z TO `ucx_G9uTu` 15:21 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cys5z') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cys5z TO `sdk-bcviwhay@example.com` 15:21 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cys5z') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cys5z TO `sdk-d2god8vc@example.com` 15:22 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cys5z') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cys5z TO `5a11359f-ba1f-483f-8e00-0fe55ec003ed` 15:22 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cys5z') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cys5z TO `serge.smertin@databricks.com` 15:22 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cys5z') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cys5z TO `sdk-ptuff04w@example.com` 15:22 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cys5z') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cys5z TO `sdk-nzf2nwou@example.com` 15:23 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 cluster permissions fixtures 15:23 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster permissions fixture: 0702-151552-6noyfkcv [group_name admins CAN_MANAGE] -> [user_name sdk-bcviwhay@example.com CAN_ATTACH_TO] 15:23 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster permissions fixture: 0702-151628-6676k0o2 [group_name admins CAN_MANAGE] -> [user_name sdk-qj04ui4g@example.com CAN_ATTACH_TO] 15:23 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 catalog fixtures 15:23 DEBUG [databricks.labs.ucx.mixins.fixtures] removing catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1719933328655, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cys5z', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cys5z', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719933328655, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 15:23 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_dbfs_data_copy fixtures 15:23 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/cQnn 15:23 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 cluster fixtures 15:23 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster fixture: 15:23 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster fixture: 15:23 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures 15:23 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 15:23 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 table fixtures 15:23 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_smzxk.ucx_tanhe', metastore_id=None, name='ucx_tanhe', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='ucx_smzxk', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/cQnn', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:23 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 schema fixtures 15:23 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_smzxk', metastore_id=None, name='ucx_smzxk', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:24 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cys5z', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cys5z.ucx_smzxk', metastore_id=None, name='ucx_smzxk', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:24 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sjd8t', metastore_id=None, name='ucx_sjd8t', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:25 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 workspace user fixtures 15:25 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='sdk-bcviwhay@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-bcviwhay@example.com')], entitlements=[], external_id=None, groups=[], id='1111845515386225', name=Name(family_name=None, given_name='sdk-bcviwhay@example.com'), roles=[], schemas=[, ], user_name='sdk-bcviwhay@example.com') 15:25 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='sdk-qj04ui4g@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-qj04ui4g@example.com')], entitlements=[], external_id=None, groups=[], id='806972500944192', name=Name(family_name=None, given_name='sdk-qj04ui4g@example.com'), roles=[], schemas=[, ], user_name='sdk-qj04ui4g@example.com') [gw8] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```

❌ test_table_migration_job_refreshes_migration_status[hiveserde-migrate-external-tables-ctas]: TimeoutError: Timed out after 0:05:00 (19m35.738s)

``` TimeoutError: Timed out after 0:05:00 15:20 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/PQXp 15:20 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.hiveserde_in_place_ntiuo: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_ntiuo 15:20 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.hiveserde_in_place_ntiuo', metastore_id=None, name='hiveserde_in_place_ntiuo', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:20 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_storage_dir fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_ntiuo 15:20 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_ntiuo.parquet_serde_ntiuo: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_ntiuo/parquet_serde_ntiuo 15:20 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_ntiuo.parquet_serde_ntiuo', metastore_id=None, name='parquet_serde_ntiuo', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='hiveserde_in_place_ntiuo', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_ntiuo/parquet_serde_ntiuo', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:21 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_ntiuo.orc_serde_ntiuo: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_ntiuo/orc_serde_ntiuo 15:21 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_ntiuo.orc_serde_ntiuo', metastore_id=None, name='orc_serde_ntiuo', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='hiveserde_in_place_ntiuo', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_ntiuo/orc_serde_ntiuo', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:21 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_ntiuo.avro_serde_ntiuo: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_ntiuo/avro_serde_ntiuo 15:21 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_ntiuo.avro_serde_ntiuo', metastore_id=None, name='avro_serde_ntiuo', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='hiveserde_in_place_ntiuo', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_ntiuo/avro_serde_ntiuo', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:21 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1719933690007, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c96sa', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_c96sa', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719933690007, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 15:21 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_c96sa.hiveserde_in_place_ntiuo: https://DATABRICKS_HOST/explore/data/ucx_c96sa/hiveserde_in_place_ntiuo 15:21 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_c96sa', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c96sa.hiveserde_in_place_ntiuo', metastore_id=None, name='hiveserde_in_place_ntiuo', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:23 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_svamn: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_svamn 15:23 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_svamn', metastore_id=None, name='ucx_svamn', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw2] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 15:20 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/PQXp 15:20 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.hiveserde_in_place_ntiuo: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_ntiuo 15:20 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.hiveserde_in_place_ntiuo', metastore_id=None, name='hiveserde_in_place_ntiuo', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:20 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_storage_dir fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_ntiuo 15:20 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_ntiuo.parquet_serde_ntiuo: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_ntiuo/parquet_serde_ntiuo 15:20 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_ntiuo.parquet_serde_ntiuo', metastore_id=None, name='parquet_serde_ntiuo', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='hiveserde_in_place_ntiuo', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_ntiuo/parquet_serde_ntiuo', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:21 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_ntiuo.orc_serde_ntiuo: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_ntiuo/orc_serde_ntiuo 15:21 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_ntiuo.orc_serde_ntiuo', metastore_id=None, name='orc_serde_ntiuo', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='hiveserde_in_place_ntiuo', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_ntiuo/orc_serde_ntiuo', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:21 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_ntiuo.avro_serde_ntiuo: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_ntiuo/avro_serde_ntiuo 15:21 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_ntiuo.avro_serde_ntiuo', metastore_id=None, name='avro_serde_ntiuo', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='hiveserde_in_place_ntiuo', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_ntiuo/avro_serde_ntiuo', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:21 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1719933690007, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c96sa', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_c96sa', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719933690007, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 15:21 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_c96sa.hiveserde_in_place_ntiuo: https://DATABRICKS_HOST/explore/data/ucx_c96sa/hiveserde_in_place_ntiuo 15:21 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_c96sa', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c96sa.hiveserde_in_place_ntiuo', metastore_id=None, name='hiveserde_in_place_ntiuo', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:23 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_svamn: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_svamn 15:23 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_svamn', metastore_id=None, name='ucx_svamn', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:26 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.yrWg/config.yml) doesn't exist. 15:26 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 15:26 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 15:26 INFO [databricks.labs.ucx.install] Fetching installations... 15:26 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.yrWg is corrupted. Skipping... 15:26 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 15:26 DEBUG [tests.integration.conftest] Waiting for clusters to start... 15:26 DEBUG [tests.integration.conftest] Waiting for clusters to start... 15:26 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+2820240702152630 15:26 INFO [databricks.labs.ucx.install] Creating ucx schemas... 15:30 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 15:30 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 15:30 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 15:30 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 15:30 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 15:30 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 15:30 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 15:30 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 15:30 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 15:30 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 15:30 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 15:30 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 15:30 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 15:30 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.yrWg/README for the next steps. 15:30 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-external-tables-ctas job: https://DATABRICKS_HOST#job/62327874975949 15:20 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/PQXp 15:20 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.hiveserde_in_place_ntiuo: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_ntiuo 15:20 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.hiveserde_in_place_ntiuo', metastore_id=None, name='hiveserde_in_place_ntiuo', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:20 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_storage_dir fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_ntiuo 15:20 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_ntiuo.parquet_serde_ntiuo: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_ntiuo/parquet_serde_ntiuo 15:20 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_ntiuo.parquet_serde_ntiuo', metastore_id=None, name='parquet_serde_ntiuo', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='hiveserde_in_place_ntiuo', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_ntiuo/parquet_serde_ntiuo', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:21 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_ntiuo.orc_serde_ntiuo: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_ntiuo/orc_serde_ntiuo 15:21 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_ntiuo.orc_serde_ntiuo', metastore_id=None, name='orc_serde_ntiuo', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='hiveserde_in_place_ntiuo', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_ntiuo/orc_serde_ntiuo', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:21 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_ntiuo.avro_serde_ntiuo: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_ntiuo/avro_serde_ntiuo 15:21 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_ntiuo.avro_serde_ntiuo', metastore_id=None, name='avro_serde_ntiuo', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='hiveserde_in_place_ntiuo', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_ntiuo/avro_serde_ntiuo', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:21 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1719933690007, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c96sa', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_c96sa', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719933690007, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 15:21 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_c96sa.hiveserde_in_place_ntiuo: https://DATABRICKS_HOST/explore/data/ucx_c96sa/hiveserde_in_place_ntiuo 15:21 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_c96sa', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c96sa.hiveserde_in_place_ntiuo', metastore_id=None, name='hiveserde_in_place_ntiuo', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:23 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_svamn: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_svamn 15:23 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_svamn', metastore_id=None, name='ucx_svamn', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:26 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.yrWg/config.yml) doesn't exist. 15:26 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 15:26 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 15:26 INFO [databricks.labs.ucx.install] Fetching installations... 15:26 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.yrWg is corrupted. Skipping... 15:26 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 15:26 DEBUG [tests.integration.conftest] Waiting for clusters to start... 15:26 DEBUG [tests.integration.conftest] Waiting for clusters to start... 15:26 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+2820240702152630 15:26 INFO [databricks.labs.ucx.install] Creating ucx schemas... 15:30 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 15:30 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 15:30 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 15:30 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 15:30 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 15:30 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 15:30 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 15:30 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 15:30 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 15:30 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 15:30 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 15:30 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 15:30 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 15:30 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.yrWg/README for the next steps. 15:30 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-external-tables-ctas job: https://DATABRICKS_HOST#job/62327874975949 15:35 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_storage_dir fixtures 15:35 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_storage_dir fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_ntiuo 15:35 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_dbfs_data_copy fixtures 15:35 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/PQXp 15:35 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 cluster fixtures 15:35 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 catalog fixtures 15:35 DEBUG [databricks.labs.ucx.mixins.fixtures] removing catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1719933690007, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c96sa', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_c96sa', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719933690007, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 15:35 INFO [databricks.labs.ucx.install] Deleting UCX v0.27.2+2820240702152630 from https://DATABRICKS_HOST 15:35 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_svamn 15:36 INFO [databricks.labs.ucx.install] Deleting jobs 15:36 INFO [databricks.labs.ucx.install] Deleting migrate-external-hiveserde-tables-in-place-experimental job_id=820537348015734. 15:36 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=971480147128355. 15:36 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=264824673963462. 15:36 INFO [databricks.labs.ucx.install] Deleting failing job_id=765315693344134. 15:36 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=146018275497458. 15:36 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=101114501705115. 15:36 INFO [databricks.labs.ucx.install] Deleting assessment job_id=534121374038825. 15:36 INFO [databricks.labs.ucx.install] Deleting migrate-external-tables-ctas job_id=62327874975949. 15:36 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=933574359905305. 15:36 INFO [databricks.labs.ucx.install] Deleting scan-tables-in-mounts-experimental job_id=415185289496015. 15:36 INFO [databricks.labs.ucx.install] Deleting migrate-data-reconciliation job_id=959590031339843. 15:36 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=47061356082581. 15:36 INFO [databricks.labs.ucx.install] Deleting experimental-workflow-linter job_id=594075878940622. 15:36 INFO [databricks.labs.ucx.install] Deleting cluster policy 15:36 INFO [databricks.labs.ucx.install] Deleting secret scope 15:36 INFO [databricks.labs.ucx.install] UnInstalling UCX complete 15:36 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace user fixtures 15:36 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 account group fixtures 15:36 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures 15:36 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 15:36 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 table fixtures 15:36 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_ntiuo.parquet_serde_ntiuo', metastore_id=None, name='parquet_serde_ntiuo', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='hiveserde_in_place_ntiuo', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_ntiuo/parquet_serde_ntiuo', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:37 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_ntiuo.orc_serde_ntiuo', metastore_id=None, name='orc_serde_ntiuo', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='hiveserde_in_place_ntiuo', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_ntiuo/orc_serde_ntiuo', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:37 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_ntiuo.avro_serde_ntiuo', metastore_id=None, name='avro_serde_ntiuo', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='hiveserde_in_place_ntiuo', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_ntiuo/avro_serde_ntiuo', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:38 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 schema fixtures 15:38 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.hiveserde_in_place_ntiuo', metastore_id=None, name='hiveserde_in_place_ntiuo', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:38 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_c96sa', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c96sa.hiveserde_in_place_ntiuo', metastore_id=None, name='hiveserde_in_place_ntiuo', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:39 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_svamn', metastore_id=None, name='ucx_svamn', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw2] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```

❌ test_running_real_workflow_linter_job: TimeoutError: Timed out after 0:02:00 (12m9.644s)

``` TimeoutError: Timed out after 0:02:00 [gw4] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 15:42 DEBUG [databricks.labs.ucx.mixins.fixtures] added directory fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-oJm2 15:42 DEBUG [databricks.labs.ucx.mixins.fixtures] added notebook fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-oJm2/notebook.ipynb 15:42 INFO [databricks.labs.ucx.mixins.fixtures] Job: https://DATABRICKS_HOST#job/929304416029333 15:42 DEBUG [databricks.labs.ucx.mixins.fixtures] added job fixture: CreateResponse(job_id=929304416029333) 15:43 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_spnyw: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_spnyw 15:43 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_spnyw', metastore_id=None, name='ucx_spnyw', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:43 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.9ZnT/config.yml) doesn't exist. 15:43 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 15:43 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 15:43 INFO [databricks.labs.ucx.install] Fetching installations... 15:43 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 15:43 DEBUG [tests.integration.conftest] Waiting for clusters to start... 15:43 DEBUG [tests.integration.conftest] Waiting for clusters to start... 15:43 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+2820240702154332 15:43 INFO [databricks.labs.ucx.install] Creating ucx schemas... 15:47 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 15:47 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 15:47 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 15:47 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 15:47 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 15:47 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 15:47 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 15:47 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 15:47 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 15:47 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 15:47 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 15:47 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 15:47 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 15:47 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.9ZnT/README for the next steps. 15:47 DEBUG [databricks.labs.ucx.installer.workflows] starting experimental-workflow-linter job: https://DATABRICKS_HOST#job/570404924546193 15:51 DEBUG [databricks.labs.ucx.installer.workflows] Validating experimental-workflow-linter workflow: https://DATABRICKS_HOST#job/570404924546193 15:42 DEBUG [databricks.labs.ucx.mixins.fixtures] added directory fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-oJm2 15:42 DEBUG [databricks.labs.ucx.mixins.fixtures] added notebook fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-oJm2/notebook.ipynb 15:42 INFO [databricks.labs.ucx.mixins.fixtures] Job: https://DATABRICKS_HOST#job/929304416029333 15:42 DEBUG [databricks.labs.ucx.mixins.fixtures] added job fixture: CreateResponse(job_id=929304416029333) 15:43 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_spnyw: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_spnyw 15:43 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_spnyw', metastore_id=None, name='ucx_spnyw', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:43 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.9ZnT/config.yml) doesn't exist. 15:43 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 15:43 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 15:43 INFO [databricks.labs.ucx.install] Fetching installations... 15:43 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 15:43 DEBUG [tests.integration.conftest] Waiting for clusters to start... 15:43 DEBUG [tests.integration.conftest] Waiting for clusters to start... 15:43 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+2820240702154332 15:43 INFO [databricks.labs.ucx.install] Creating ucx schemas... 15:47 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 15:47 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 15:47 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 15:47 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 15:47 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 15:47 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 15:47 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 15:47 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 15:47 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 15:47 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 15:47 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 15:47 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 15:47 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 15:47 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.9ZnT/README for the next steps. 15:47 DEBUG [databricks.labs.ucx.installer.workflows] starting experimental-workflow-linter job: https://DATABRICKS_HOST#job/570404924546193 15:51 DEBUG [databricks.labs.ucx.installer.workflows] Validating experimental-workflow-linter workflow: https://DATABRICKS_HOST#job/570404924546193 15:52 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 job fixtures 15:52 DEBUG [databricks.labs.ucx.mixins.fixtures] removing job fixture: CreateResponse(job_id=929304416029333) 15:52 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 directory fixtures 15:52 DEBUG [databricks.labs.ucx.mixins.fixtures] removing directory fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-oJm2 15:52 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 notebook fixtures 15:52 DEBUG [databricks.labs.ucx.mixins.fixtures] removing notebook fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-oJm2/notebook.ipynb 15:52 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while notebook /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-oJm2/notebook.ipynb teardown: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-oJm2/notebook.ipynb) doesn't exist. 15:52 INFO [databricks.labs.ucx.install] Deleting UCX v0.27.2+2820240702154332 from https://DATABRICKS_HOST 15:52 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_spnyw 15:52 INFO [databricks.labs.ucx.install] Deleting jobs 15:52 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=1031894047562913. 15:52 INFO [databricks.labs.ucx.install] Deleting experimental-workflow-linter job_id=570404924546193. 15:52 INFO [databricks.labs.ucx.install] Deleting migrate-data-reconciliation job_id=902869771815168. 15:52 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=977027457952222. 15:52 INFO [databricks.labs.ucx.install] Deleting migrate-external-hiveserde-tables-in-place-experimental job_id=442333703390181. 15:52 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=804487226104702. 15:52 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=172494008533619. 15:52 INFO [databricks.labs.ucx.install] Deleting scan-tables-in-mounts-experimental job_id=111758831112514. 15:52 INFO [databricks.labs.ucx.install] Deleting migrate-external-tables-ctas job_id=609934639945240. 15:52 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=385285906565085. 15:52 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=463264608172761. 15:52 INFO [databricks.labs.ucx.install] Deleting failing job_id=300462327643717. 15:52 INFO [databricks.labs.ucx.install] Deleting assessment job_id=988896749544393. 15:52 INFO [databricks.labs.ucx.install] Deleting cluster policy 15:52 INFO [databricks.labs.ucx.install] Deleting secret scope 15:52 INFO [databricks.labs.ucx.install] UnInstalling UCX complete 15:52 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace user fixtures 15:52 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 account group fixtures 15:52 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures 15:52 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 15:52 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 15:52 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 schema fixtures 15:52 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_spnyw', metastore_id=None, name='ucx_spnyw', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw4] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```

_{Running from acceptance #4136}

databrickslabs / ucx

whitelist spark-nlp #1981

Changes

Linked issues

Functionality

Tests