databrickslabs / ucx

Your best companion for upgrading to Unity Catalog. UCX will guide you, the Databricks customer, through the process of upgrading your account, groups, workspaces, jobs etc. to Unity Catalog.
Other
194 stars 69 forks source link

whitelist folium #2029

Closed ericvergnaud closed 2 days ago

ericvergnaud commented 4 days ago

Changes

whitelist folium

Linked issues

Progresses #1901

Functionality

None

Tests

github-actions[bot] commented 4 days ago

❌ 98/101 passed, 3 failed, 22 skipped, 4h57m14s total

❌ test_create_catalog_schema_with_principal_acl_CLOUD_ENV: AssertionError: assert PrivilegeAssignment(principal='sdk-aw9i6xjl@example.com', privileges=[]) in [PrivilegeAssignment(principal='ucx_GskkG', privileges=[]), PrivilegeAssignment(pr...>]), PrivilegeAssignment(principal='sdk-qz0oixl1@example.com', privileges=[]), ...] (11m58.167s) ``` AssertionError: assert PrivilegeAssignment(principal='sdk-aw9i6xjl@example.com', privileges=[]) in [PrivilegeAssignment(principal='ucx_GskkG', privileges=[]), PrivilegeAssignment(pr...>]), PrivilegeAssignment(principal='sdk-qz0oixl1@example.com', privileges=[]), ...] + where [PrivilegeAssignment(principal='ucx_GskkG', privileges=[]), PrivilegeAssignment(pr...>]), PrivilegeAssignment(principal='sdk-qz0oixl1@example.com', privileges=[]), ...] = PermissionsList(privilege_assignments=[PrivilegeAssignment(principal='ucx_GskkG', privileges=[])]).privilege_assignments 10:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/7YcE 10:05 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sx4cd: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sx4cd 10:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sx4cd', metastore_id=None, name='ucx_sx4cd', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 10:05 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_sx4cd.ucx_tvg1s: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sx4cd/ucx_tvg1s 10:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sx4cd.ucx_tvg1s', metastore_id=None, name='ucx_tvg1s', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070311'}, row_filter=None, schema_name='ucx_sx4cd', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/7YcE', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 10:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720001141799, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c8f0k', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_c8f0k', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720001141799, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 10:05 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_c8f0k.ucx_sx4cd: https://DATABRICKS_HOST/explore/data/ucx_c8f0k/ucx_sx4cd 10:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_c8f0k', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c8f0k.ucx_sx4cd', metastore_id=None, name='ucx_sx4cd', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw8] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 10:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/7YcE 10:05 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sx4cd: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sx4cd 10:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sx4cd', metastore_id=None, name='ucx_sx4cd', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 10:05 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_sx4cd.ucx_tvg1s: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sx4cd/ucx_tvg1s 10:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sx4cd.ucx_tvg1s', metastore_id=None, name='ucx_tvg1s', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070311'}, row_filter=None, schema_name='ucx_sx4cd', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/7YcE', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 10:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720001141799, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c8f0k', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_c8f0k', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720001141799, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 10:05 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_c8f0k.ucx_sx4cd: https://DATABRICKS_HOST/explore/data/ucx_c8f0k/ucx_sx4cd 10:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_c8f0k', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c8f0k.ucx_sx4cd', metastore_id=None, name='ucx_sx4cd', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 10:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: 10:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-qebwplao@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-qebwplao@example.com')], entitlements=[], external_id=None, groups=[], id='8764115506897619', name=Name(family_name=None, given_name='sdk-qebwplao@example.com'), roles=[], schemas=[, ], user_name='sdk-qebwplao@example.com') 10:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0703-100555-6e8fof4r [group_name admins CAN_MANAGE] -> [user_name sdk-qebwplao@example.com CAN_ATTACH_TO] 10:06 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sift8: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sift8 10:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sift8', metastore_id=None, name='ucx_sift8', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 10:06 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 10:06 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 10:06 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 10:06 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 10:06 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 10:06 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 10:06 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 10:06 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 10:06 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Listing existing UC catalogs and schemas 10:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: 10:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-aw9i6xjl@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-aw9i6xjl@example.com')], entitlements=[], external_id=None, groups=[], id='5344903311865448', name=Name(family_name=None, given_name='sdk-aw9i6xjl@example.com'), roles=[], schemas=[, ], user_name='sdk-aw9i6xjl@example.com') 10:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0703-100624-qji2nzu2 [group_name admins CAN_MANAGE] -> [user_name sdk-aw9i6xjl@example.com CAN_ATTACH_TO] 10:06 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Listing existing UC catalogs and schemas 10:06 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Preparing a list of UC catalogs and schema to be created 10:06 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sift8.tables] fetching tables inventory 10:07 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sift8.tables] crawling new batch for tables 10:07 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sx4cd] listing tables 10:07 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sx4cd.ucx_tvg1s] fetching table metadata 10:07 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sift8.tables] found 1 new records for tables 10:08 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_c8f0k.ucx_sx4cd') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_c8f0k.ucx_sx4cd TO `sdk-0phptdjx@example.com` 10:09 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_c8f0k.ucx_sx4cd') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_c8f0k.ucx_sx4cd TO `5a11359f-ba1f-483f-8e00-0fe55ec003ed` 10:09 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_c8f0k.ucx_sx4cd') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_c8f0k.ucx_sx4cd TO `sdk-qz0oixl1@example.com` 10:10 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_c8f0k.ucx_sx4cd') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_c8f0k.ucx_sx4cd TO `sdk-vcmdqmhs@example.com` 10:10 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_c8f0k.ucx_sx4cd') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_c8f0k.ucx_sx4cd TO `ucx_GskkG` 10:11 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_c8f0k.ucx_sx4cd') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_c8f0k.ucx_sx4cd TO `ucx_GsmsF` 10:11 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_c8f0k.ucx_sx4cd') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_c8f0k.ucx_sx4cd TO `serge.smertin@databricks.com` 10:11 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_c8f0k.ucx_sx4cd') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_c8f0k.ucx_sx4cd TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d` 10:12 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_c8f0k.ucx_sx4cd') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_c8f0k.ucx_sx4cd TO `sdk-qebwplao@example.com` 10:12 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_c8f0k.ucx_sx4cd') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_c8f0k.ucx_sx4cd TO `ucx_Gcn4b` 10:12 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_c8f0k') using SQL query: GRANT USE CATALOG ON CATALOG ucx_c8f0k TO `ucx_GsmsF` 10:13 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_c8f0k') using SQL query: GRANT USE CATALOG ON CATALOG ucx_c8f0k TO `sdk-qebwplao@example.com` 10:13 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_c8f0k') using SQL query: GRANT USE CATALOG ON CATALOG ucx_c8f0k TO `5a11359f-ba1f-483f-8e00-0fe55ec003ed` 10:13 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_c8f0k') using SQL query: GRANT USE CATALOG ON CATALOG ucx_c8f0k TO `ucx_Gcn4b` 10:13 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_c8f0k') using SQL query: GRANT USE CATALOG ON CATALOG ucx_c8f0k TO `ucx_GskkG` 10:14 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_c8f0k') using SQL query: GRANT USE CATALOG ON CATALOG ucx_c8f0k TO `sdk-vcmdqmhs@example.com` 10:14 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_c8f0k') using SQL query: GRANT USE CATALOG ON CATALOG ucx_c8f0k TO `sdk-qz0oixl1@example.com` 10:15 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_c8f0k') using SQL query: GRANT USE CATALOG ON CATALOG ucx_c8f0k TO `serge.smertin@databricks.com` 10:15 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_c8f0k') using SQL query: GRANT USE CATALOG ON CATALOG ucx_c8f0k TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d` 10:15 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_c8f0k') using SQL query: GRANT USE CATALOG ON CATALOG ucx_c8f0k TO `sdk-0phptdjx@example.com` 10:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/7YcE 10:05 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sx4cd: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sx4cd 10:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sx4cd', metastore_id=None, name='ucx_sx4cd', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 10:05 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_sx4cd.ucx_tvg1s: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sx4cd/ucx_tvg1s 10:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sx4cd.ucx_tvg1s', metastore_id=None, name='ucx_tvg1s', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070311'}, row_filter=None, schema_name='ucx_sx4cd', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/7YcE', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 10:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720001141799, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c8f0k', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_c8f0k', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720001141799, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 10:05 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_c8f0k.ucx_sx4cd: https://DATABRICKS_HOST/explore/data/ucx_c8f0k/ucx_sx4cd 10:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_c8f0k', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c8f0k.ucx_sx4cd', metastore_id=None, name='ucx_sx4cd', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 10:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: 10:05 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-qebwplao@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-qebwplao@example.com')], entitlements=[], external_id=None, groups=[], id='8764115506897619', name=Name(family_name=None, given_name='sdk-qebwplao@example.com'), roles=[], schemas=[, ], user_name='sdk-qebwplao@example.com') 10:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0703-100555-6e8fof4r [group_name admins CAN_MANAGE] -> [user_name sdk-qebwplao@example.com CAN_ATTACH_TO] 10:06 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sift8: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sift8 10:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sift8', metastore_id=None, name='ucx_sift8', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 10:06 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 10:06 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 10:06 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 10:06 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 10:06 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 10:06 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 10:06 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 10:06 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 10:06 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Listing existing UC catalogs and schemas 10:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: 10:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-aw9i6xjl@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-aw9i6xjl@example.com')], entitlements=[], external_id=None, groups=[], id='5344903311865448', name=Name(family_name=None, given_name='sdk-aw9i6xjl@example.com'), roles=[], schemas=[, ], user_name='sdk-aw9i6xjl@example.com') 10:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0703-100624-qji2nzu2 [group_name admins CAN_MANAGE] -> [user_name sdk-aw9i6xjl@example.com CAN_ATTACH_TO] 10:06 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Listing existing UC catalogs and schemas 10:06 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Preparing a list of UC catalogs and schema to be created 10:06 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sift8.tables] fetching tables inventory 10:07 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sift8.tables] crawling new batch for tables 10:07 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sx4cd] listing tables 10:07 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sx4cd.ucx_tvg1s] fetching table metadata 10:07 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sift8.tables] found 1 new records for tables 10:08 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_c8f0k.ucx_sx4cd') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_c8f0k.ucx_sx4cd TO `sdk-0phptdjx@example.com` 10:09 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_c8f0k.ucx_sx4cd') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_c8f0k.ucx_sx4cd TO `5a11359f-ba1f-483f-8e00-0fe55ec003ed` 10:09 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_c8f0k.ucx_sx4cd') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_c8f0k.ucx_sx4cd TO `sdk-qz0oixl1@example.com` 10:10 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_c8f0k.ucx_sx4cd') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_c8f0k.ucx_sx4cd TO `sdk-vcmdqmhs@example.com` 10:10 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_c8f0k.ucx_sx4cd') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_c8f0k.ucx_sx4cd TO `ucx_GskkG` 10:11 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_c8f0k.ucx_sx4cd') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_c8f0k.ucx_sx4cd TO `ucx_GsmsF` 10:11 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_c8f0k.ucx_sx4cd') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_c8f0k.ucx_sx4cd TO `serge.smertin@databricks.com` 10:11 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_c8f0k.ucx_sx4cd') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_c8f0k.ucx_sx4cd TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d` 10:12 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_c8f0k.ucx_sx4cd') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_c8f0k.ucx_sx4cd TO `sdk-qebwplao@example.com` 10:12 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_c8f0k.ucx_sx4cd') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_c8f0k.ucx_sx4cd TO `ucx_Gcn4b` 10:12 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_c8f0k') using SQL query: GRANT USE CATALOG ON CATALOG ucx_c8f0k TO `ucx_GsmsF` 10:13 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_c8f0k') using SQL query: GRANT USE CATALOG ON CATALOG ucx_c8f0k TO `sdk-qebwplao@example.com` 10:13 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_c8f0k') using SQL query: GRANT USE CATALOG ON CATALOG ucx_c8f0k TO `5a11359f-ba1f-483f-8e00-0fe55ec003ed` 10:13 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_c8f0k') using SQL query: GRANT USE CATALOG ON CATALOG ucx_c8f0k TO `ucx_Gcn4b` 10:13 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_c8f0k') using SQL query: GRANT USE CATALOG ON CATALOG ucx_c8f0k TO `ucx_GskkG` 10:14 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_c8f0k') using SQL query: GRANT USE CATALOG ON CATALOG ucx_c8f0k TO `sdk-vcmdqmhs@example.com` 10:14 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_c8f0k') using SQL query: GRANT USE CATALOG ON CATALOG ucx_c8f0k TO `sdk-qz0oixl1@example.com` 10:15 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_c8f0k') using SQL query: GRANT USE CATALOG ON CATALOG ucx_c8f0k TO `serge.smertin@databricks.com` 10:15 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_c8f0k') using SQL query: GRANT USE CATALOG ON CATALOG ucx_c8f0k TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d` 10:15 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_c8f0k') using SQL query: GRANT USE CATALOG ON CATALOG ucx_c8f0k TO `sdk-0phptdjx@example.com` 10:15 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 cluster permissions fixtures 10:15 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster permissions fixture: 0703-100555-6e8fof4r [group_name admins CAN_MANAGE] -> [user_name sdk-qebwplao@example.com CAN_ATTACH_TO] 10:15 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster permissions fixture: 0703-100624-qji2nzu2 [group_name admins CAN_MANAGE] -> [user_name sdk-aw9i6xjl@example.com CAN_ATTACH_TO] 10:15 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 catalog fixtures 10:15 DEBUG [databricks.labs.ucx.mixins.fixtures] removing catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720001141799, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c8f0k', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_c8f0k', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720001141799, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 10:15 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_dbfs_data_copy fixtures 10:15 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/7YcE 10:15 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 cluster fixtures 10:15 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster fixture: 10:15 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster fixture: 10:15 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures 10:15 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 10:15 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 table fixtures 10:15 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sx4cd.ucx_tvg1s', metastore_id=None, name='ucx_tvg1s', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070311'}, row_filter=None, schema_name='ucx_sx4cd', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/7YcE', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 10:16 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 schema fixtures 10:16 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sx4cd', metastore_id=None, name='ucx_sx4cd', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 10:16 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_c8f0k', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c8f0k.ucx_sx4cd', metastore_id=None, name='ucx_sx4cd', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 10:16 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sift8', metastore_id=None, name='ucx_sift8', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 10:16 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 workspace user fixtures 10:16 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='sdk-qebwplao@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-qebwplao@example.com')], entitlements=[], external_id=None, groups=[], id='8764115506897619', name=Name(family_name=None, given_name='sdk-qebwplao@example.com'), roles=[], schemas=[, ], user_name='sdk-qebwplao@example.com') 10:16 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='sdk-aw9i6xjl@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-aw9i6xjl@example.com')], entitlements=[], external_id=None, groups=[], id='5344903311865448', name=Name(family_name=None, given_name='sdk-aw9i6xjl@example.com'), roles=[], schemas=[, ], user_name='sdk-aw9i6xjl@example.com') [gw8] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```
❌ test_running_real_workflow_linter_job: TimeoutError: Timed out after 0:02:00 (9m54.06s) ``` TimeoutError: Timed out after 0:02:00 [gw0] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 10:22 DEBUG [databricks.labs.ucx.mixins.fixtures] added directory fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-eLwH 10:22 DEBUG [databricks.labs.ucx.mixins.fixtures] added notebook fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-eLwH/notebook.ipynb 10:22 INFO [databricks.labs.ucx.mixins.fixtures] Job: https://DATABRICKS_HOST#job/1021280872960635 10:22 DEBUG [databricks.labs.ucx.mixins.fixtures] added job fixture: CreateResponse(job_id=1021280872960635) 10:22 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sbv5d: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sbv5d 10:22 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sbv5d', metastore_id=None, name='ucx_sbv5d', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 10:22 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.WVgy/config.yml) doesn't exist. 10:22 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 10:23 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 10:23 INFO [databricks.labs.ucx.install] Fetching installations... 10:23 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 10:23 DEBUG [tests.integration.conftest] Waiting for clusters to start... 10:23 DEBUG [tests.integration.conftest] Waiting for clusters to start... 10:23 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+7020240703102312 10:23 INFO [databricks.labs.ucx.install] Creating ucx schemas... 10:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 10:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 10:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 10:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 10:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 10:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 10:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 10:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 10:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 10:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 10:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 10:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 10:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 10:26 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.WVgy/README for the next steps. 10:26 DEBUG [databricks.labs.ucx.installer.workflows] starting experimental-workflow-linter job: https://DATABRICKS_HOST#job/1033354734048780 10:31 DEBUG [databricks.labs.ucx.installer.workflows] Validating experimental-workflow-linter workflow: https://DATABRICKS_HOST#job/1033354734048780 10:22 DEBUG [databricks.labs.ucx.mixins.fixtures] added directory fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-eLwH 10:22 DEBUG [databricks.labs.ucx.mixins.fixtures] added notebook fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-eLwH/notebook.ipynb 10:22 INFO [databricks.labs.ucx.mixins.fixtures] Job: https://DATABRICKS_HOST#job/1021280872960635 10:22 DEBUG [databricks.labs.ucx.mixins.fixtures] added job fixture: CreateResponse(job_id=1021280872960635) 10:22 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sbv5d: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sbv5d 10:22 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sbv5d', metastore_id=None, name='ucx_sbv5d', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 10:22 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.WVgy/config.yml) doesn't exist. 10:22 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 10:23 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 10:23 INFO [databricks.labs.ucx.install] Fetching installations... 10:23 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 10:23 DEBUG [tests.integration.conftest] Waiting for clusters to start... 10:23 DEBUG [tests.integration.conftest] Waiting for clusters to start... 10:23 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+7020240703102312 10:23 INFO [databricks.labs.ucx.install] Creating ucx schemas... 10:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 10:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 10:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 10:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 10:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 10:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 10:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 10:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 10:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 10:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 10:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 10:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 10:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 10:26 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.WVgy/README for the next steps. 10:26 DEBUG [databricks.labs.ucx.installer.workflows] starting experimental-workflow-linter job: https://DATABRICKS_HOST#job/1033354734048780 10:31 DEBUG [databricks.labs.ucx.installer.workflows] Validating experimental-workflow-linter workflow: https://DATABRICKS_HOST#job/1033354734048780 10:31 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 job fixtures 10:31 DEBUG [databricks.labs.ucx.mixins.fixtures] removing job fixture: CreateResponse(job_id=1021280872960635) 10:31 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 directory fixtures 10:31 DEBUG [databricks.labs.ucx.mixins.fixtures] removing directory fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-eLwH 10:31 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 notebook fixtures 10:31 DEBUG [databricks.labs.ucx.mixins.fixtures] removing notebook fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-eLwH/notebook.ipynb 10:31 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while notebook /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-eLwH/notebook.ipynb teardown: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-eLwH/notebook.ipynb) doesn't exist. 10:31 INFO [databricks.labs.ucx.install] Deleting UCX v0.27.2+7020240703102312 from https://DATABRICKS_HOST 10:31 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_sbv5d 10:32 INFO [databricks.labs.ucx.install] Deleting jobs 10:32 INFO [databricks.labs.ucx.install] Deleting migrate-external-hiveserde-tables-in-place-experimental job_id=132688963393896. 10:32 INFO [databricks.labs.ucx.install] Deleting assessment job_id=350528828847655. 10:32 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=113685710845517. 10:32 INFO [databricks.labs.ucx.install] Deleting scan-tables-in-mounts-experimental job_id=1056800496800546. 10:32 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=322803664696705. 10:32 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=852415688638533. 10:32 INFO [databricks.labs.ucx.install] Deleting experimental-workflow-linter job_id=1033354734048780. 10:32 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=334134571926103. 10:32 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=473836522541263. 10:32 INFO [databricks.labs.ucx.install] Deleting migrate-external-tables-ctas job_id=419897029541672. 10:32 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=1068386555202827. 10:32 INFO [databricks.labs.ucx.install] Deleting migrate-data-reconciliation job_id=792908719503487. 10:32 INFO [databricks.labs.ucx.install] Deleting failing job_id=503655053097837. 10:32 INFO [databricks.labs.ucx.install] Deleting cluster policy 10:32 INFO [databricks.labs.ucx.install] Deleting secret scope 10:32 INFO [databricks.labs.ucx.install] UnInstalling UCX complete 10:32 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace user fixtures 10:32 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 account group fixtures 10:32 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures 10:32 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 10:32 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 10:32 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 schema fixtures 10:32 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sbv5d', metastore_id=None, name='ucx_sbv5d', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw0] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```
❌ test_migrate_table_in_mount: databricks.sdk.errors.platform.BadRequest: [SCHEMA_ALREADY_EXISTS] Cannot create schema `mounted_TEST_MOUNT_NAME` because it already exists. (1m16.813s) ``` databricks.sdk.errors.platform.BadRequest: [SCHEMA_ALREADY_EXISTS] Cannot create schema `mounted_TEST_MOUNT_NAME` because it already exists. Choose a different name, drop the existing schema, or add the IF NOT EXISTS clause to tolerate pre-existing schema. SQLSTATE: 42P06 10:43 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s27ke: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s27ke 10:43 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s27ke', metastore_id=None, name='ucx_s27ke', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw1] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 10:43 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s27ke: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s27ke 10:43 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s27ke', metastore_id=None, name='ucx_s27ke', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 10:43 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s27ke: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s27ke 10:43 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s27ke', metastore_id=None, name='ucx_s27ke', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 10:44 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 account group fixtures 10:44 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures 10:44 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 10:44 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 10:44 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 catalog fixtures 10:44 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 schema fixtures 10:44 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s27ke', metastore_id=None, name='ucx_s27ke', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw1] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```

Running from acceptance #4250