search

databrickslabs / ucx

Your best companion for upgrading to Unity Catalog. UCX will guide you, the Databricks customer, through the process of upgrading your account, groups, workspaces, jobs etc. to Unity Catalog.
Other
193 stars 69 forks source link

whitelist seaborn #1977

Closed ericvergnaud closed 2 days ago

ericvergnaud commented 2 days ago

Changes

whitelist seaborn

Linked issues

Progresses #1901

Functionality

None

Tests

github-actions[bot] commented 2 days ago

❌ 84/86 passed, 2 failed, 21 skipped, 4h45m29s total

❌ test_spn_migration_access_connector_created: databricks.sdk.errors.platform.NotFound: Storage Credential 'test-pwthec9maitivad6' does not exist. (57.334s) ``` databricks.sdk.errors.platform.NotFound: Storage Credential 'test-pwthec9maitivad6' does not exist. 15:07 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sij8s: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sij8s 15:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sij8s', metastore_id=None, name='ucx_sij8s', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw3] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 15:07 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sij8s: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sij8s 15:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sij8s', metastore_id=None, name='ucx_sij8s', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:08 WARNING [databricks.labs.ucx.CLOUD_ENV.credentials] There is an existing external location overlaps with the prefix that is mapped to the service principal and used for validating the migrated storage credential. Skip the validation 15:08 INFO [databricks.labs.ucx.CLOUD_ENV.credentials] Found 1 distinct service principals already used in UC storage credentials 15:08 INFO [databricks.labs.ucx.CLOUD_ENV.credentials] Completed migration from Azure Service Principal to UC Storage credentials and creation of UC Storage credentials for storage access with Databricks Access Connectors. Please check ~/mock/CLOUD_ENV_service_principal_migration_result.csv for validation results 15:07 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sij8s: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sij8s 15:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sij8s', metastore_id=None, name='ucx_sij8s', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:08 WARNING [databricks.labs.ucx.CLOUD_ENV.credentials] There is an existing external location overlaps with the prefix that is mapped to the service principal and used for validating the migrated storage credential. Skip the validation 15:08 INFO [databricks.labs.ucx.CLOUD_ENV.credentials] Found 1 distinct service principals already used in UC storage credentials 15:08 INFO [databricks.labs.ucx.CLOUD_ENV.credentials] Completed migration from Azure Service Principal to UC Storage credentials and creation of UC Storage credentials for storage access with Databricks Access Connectors. Please check ~/mock/CLOUD_ENV_service_principal_migration_result.csv for validation results 15:08 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 schema fixtures 15:08 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sij8s', metastore_id=None, name='ucx_sij8s', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw3] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```
❌ test_create_catalog_schema_with_principal_acl_CLOUD_ENV: AssertionError: assert PrivilegeAssignment(principal='sdk-jtut8jbl@example.com', privileges=[]) in [PrivilegeAssignment(principal='sdk-t0ajttfp@example.com', privileges=[]), Privile...>]), PrivilegeAssignment(principal='sdk-jamsj8gg@example.com', privileges=[]), ...] (10m4.471s) ``` AssertionError: assert PrivilegeAssignment(principal='sdk-jtut8jbl@example.com', privileges=[]) in [PrivilegeAssignment(principal='sdk-t0ajttfp@example.com', privileges=[]), Privile...>]), PrivilegeAssignment(principal='sdk-jamsj8gg@example.com', privileges=[]), ...] + where [PrivilegeAssignment(principal='sdk-t0ajttfp@example.com', privileges=[]), Privile...>]), PrivilegeAssignment(principal='sdk-jamsj8gg@example.com', privileges=[]), ...] = PermissionsList(privilege_assignments=[PrivilegeAssignment(principal='sdk-t0ajttfp@example.com', privileges=[]), PrivilegeAssignment(principal='ucx_GgpIk', privileges=[])]).privilege_assignments 15:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/BDIP 15:08 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s76ch: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s76ch 15:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s76ch', metastore_id=None, name='ucx_s76ch', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:08 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_s76ch.ucx_tb4nl: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s76ch/ucx_tb4nl 15:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_s76ch.ucx_tb4nl', metastore_id=None, name='ucx_tb4nl', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='ucx_s76ch', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/BDIP', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1719932924240, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ccyuu', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_ccyuu', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719932924240, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 15:09 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_ccyuu.ucx_s76ch: https://DATABRICKS_HOST/explore/data/ucx_ccyuu/ucx_s76ch 15:09 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_ccyuu', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ccyuu.ucx_s76ch', metastore_id=None, name='ucx_s76ch', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw9] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 15:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/BDIP 15:08 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s76ch: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s76ch 15:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s76ch', metastore_id=None, name='ucx_s76ch', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:08 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_s76ch.ucx_tb4nl: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s76ch/ucx_tb4nl 15:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_s76ch.ucx_tb4nl', metastore_id=None, name='ucx_tb4nl', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='ucx_s76ch', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/BDIP', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1719932924240, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ccyuu', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_ccyuu', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719932924240, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 15:09 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_ccyuu.ucx_s76ch: https://DATABRICKS_HOST/explore/data/ucx_ccyuu/ucx_s76ch 15:09 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_ccyuu', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ccyuu.ucx_s76ch', metastore_id=None, name='ucx_s76ch', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:09 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: 15:09 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-t0ajttfp@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-t0ajttfp@example.com')], entitlements=[], external_id=None, groups=[], id='6734792388722895', name=Name(family_name=None, given_name='sdk-t0ajttfp@example.com'), roles=[], schemas=[, ], user_name='sdk-t0ajttfp@example.com') 15:09 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0702-150900-k5oae428 [group_name admins CAN_MANAGE] -> [user_name sdk-t0ajttfp@example.com CAN_ATTACH_TO] 15:09 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_smi6w: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_smi6w 15:09 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_smi6w', metastore_id=None, name='ucx_smi6w', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:09 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:09 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:09 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:09 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:09 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:09 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:09 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Listing existing UC catalogs and schemas 15:09 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: 15:09 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-jtut8jbl@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-jtut8jbl@example.com')], entitlements=[], external_id=None, groups=[], id='8288570282097366', name=Name(family_name=None, given_name='sdk-jtut8jbl@example.com'), roles=[], schemas=[, ], user_name='sdk-jtut8jbl@example.com') 15:09 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0702-150932-ny8nr4ss [group_name admins CAN_MANAGE] -> [user_name sdk-jtut8jbl@example.com CAN_ATTACH_TO] 15:09 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Listing existing UC catalogs and schemas 15:09 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Preparing a list of UC catalogs and schema to be created 15:09 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_smi6w.tables] fetching tables inventory 15:10 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_smi6w.tables] crawling new batch for tables 15:10 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s76ch] listing tables 15:10 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s76ch.ucx_tb4nl] fetching table metadata 15:10 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_smi6w.tables] found 1 new records for tables 15:11 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_ccyuu.ucx_s76ch') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_ccyuu.ucx_s76ch TO `ucx_GgpIk` 15:12 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_ccyuu.ucx_s76ch') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_ccyuu.ucx_s76ch TO `sdk-jamsj8gg@example.com` 15:12 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_ccyuu.ucx_s76ch') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_ccyuu.ucx_s76ch TO `sdk-hgqiqb1j@example.com` 15:12 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_ccyuu.ucx_s76ch') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_ccyuu.ucx_s76ch TO `sdk-t0ajttfp@example.com` 15:13 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_ccyuu.ucx_s76ch') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_ccyuu.ucx_s76ch TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d` 15:13 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_ccyuu.ucx_s76ch') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_ccyuu.ucx_s76ch TO `serge.smertin@databricks.com` 15:13 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_ccyuu.ucx_s76ch') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_ccyuu.ucx_s76ch TO `5a11359f-ba1f-483f-8e00-0fe55ec003ed` 15:14 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_ccyuu') using SQL query: GRANT USE CATALOG ON CATALOG ucx_ccyuu TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d` 15:14 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_ccyuu') using SQL query: GRANT USE CATALOG ON CATALOG ucx_ccyuu TO `5a11359f-ba1f-483f-8e00-0fe55ec003ed` 15:15 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_ccyuu') using SQL query: GRANT USE CATALOG ON CATALOG ucx_ccyuu TO `sdk-jamsj8gg@example.com` 15:15 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_ccyuu') using SQL query: GRANT USE CATALOG ON CATALOG ucx_ccyuu TO `sdk-t0ajttfp@example.com` 15:15 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_ccyuu') using SQL query: GRANT USE CATALOG ON CATALOG ucx_ccyuu TO `serge.smertin@databricks.com` 15:16 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_ccyuu') using SQL query: GRANT USE CATALOG ON CATALOG ucx_ccyuu TO `ucx_GgpIk` 15:16 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_ccyuu') using SQL query: GRANT USE CATALOG ON CATALOG ucx_ccyuu TO `sdk-hgqiqb1j@example.com` 15:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/BDIP 15:08 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s76ch: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s76ch 15:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s76ch', metastore_id=None, name='ucx_s76ch', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:08 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_s76ch.ucx_tb4nl: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s76ch/ucx_tb4nl 15:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_s76ch.ucx_tb4nl', metastore_id=None, name='ucx_tb4nl', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='ucx_s76ch', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/BDIP', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1719932924240, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ccyuu', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_ccyuu', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719932924240, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 15:09 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_ccyuu.ucx_s76ch: https://DATABRICKS_HOST/explore/data/ucx_ccyuu/ucx_s76ch 15:09 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_ccyuu', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ccyuu.ucx_s76ch', metastore_id=None, name='ucx_s76ch', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:09 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: 15:09 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-t0ajttfp@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-t0ajttfp@example.com')], entitlements=[], external_id=None, groups=[], id='6734792388722895', name=Name(family_name=None, given_name='sdk-t0ajttfp@example.com'), roles=[], schemas=[, ], user_name='sdk-t0ajttfp@example.com') 15:09 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0702-150900-k5oae428 [group_name admins CAN_MANAGE] -> [user_name sdk-t0ajttfp@example.com CAN_ATTACH_TO] 15:09 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_smi6w: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_smi6w 15:09 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_smi6w', metastore_id=None, name='ucx_smi6w', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:09 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:09 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:09 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:09 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:09 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:09 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:09 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Listing existing UC catalogs and schemas 15:09 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: 15:09 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-jtut8jbl@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-jtut8jbl@example.com')], entitlements=[], external_id=None, groups=[], id='8288570282097366', name=Name(family_name=None, given_name='sdk-jtut8jbl@example.com'), roles=[], schemas=[, ], user_name='sdk-jtut8jbl@example.com') 15:09 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0702-150932-ny8nr4ss [group_name admins CAN_MANAGE] -> [user_name sdk-jtut8jbl@example.com CAN_ATTACH_TO] 15:09 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Listing existing UC catalogs and schemas 15:09 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Preparing a list of UC catalogs and schema to be created 15:09 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_smi6w.tables] fetching tables inventory 15:10 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_smi6w.tables] crawling new batch for tables 15:10 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s76ch] listing tables 15:10 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_s76ch.ucx_tb4nl] fetching table metadata 15:10 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_smi6w.tables] found 1 new records for tables 15:11 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_ccyuu.ucx_s76ch') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_ccyuu.ucx_s76ch TO `ucx_GgpIk` 15:12 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_ccyuu.ucx_s76ch') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_ccyuu.ucx_s76ch TO `sdk-jamsj8gg@example.com` 15:12 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_ccyuu.ucx_s76ch') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_ccyuu.ucx_s76ch TO `sdk-hgqiqb1j@example.com` 15:12 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_ccyuu.ucx_s76ch') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_ccyuu.ucx_s76ch TO `sdk-t0ajttfp@example.com` 15:13 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_ccyuu.ucx_s76ch') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_ccyuu.ucx_s76ch TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d` 15:13 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_ccyuu.ucx_s76ch') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_ccyuu.ucx_s76ch TO `serge.smertin@databricks.com` 15:13 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_ccyuu.ucx_s76ch') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_ccyuu.ucx_s76ch TO `5a11359f-ba1f-483f-8e00-0fe55ec003ed` 15:14 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_ccyuu') using SQL query: GRANT USE CATALOG ON CATALOG ucx_ccyuu TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d` 15:14 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_ccyuu') using SQL query: GRANT USE CATALOG ON CATALOG ucx_ccyuu TO `5a11359f-ba1f-483f-8e00-0fe55ec003ed` 15:15 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_ccyuu') using SQL query: GRANT USE CATALOG ON CATALOG ucx_ccyuu TO `sdk-jamsj8gg@example.com` 15:15 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_ccyuu') using SQL query: GRANT USE CATALOG ON CATALOG ucx_ccyuu TO `sdk-t0ajttfp@example.com` 15:15 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_ccyuu') using SQL query: GRANT USE CATALOG ON CATALOG ucx_ccyuu TO `serge.smertin@databricks.com` 15:16 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_ccyuu') using SQL query: GRANT USE CATALOG ON CATALOG ucx_ccyuu TO `ucx_GgpIk` 15:16 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_ccyuu') using SQL query: GRANT USE CATALOG ON CATALOG ucx_ccyuu TO `sdk-hgqiqb1j@example.com` 15:16 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 cluster permissions fixtures 15:16 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster permissions fixture: 0702-150900-k5oae428 [group_name admins CAN_MANAGE] -> [user_name sdk-t0ajttfp@example.com CAN_ATTACH_TO] 15:16 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster permissions fixture: 0702-150932-ny8nr4ss [group_name admins CAN_MANAGE] -> [user_name sdk-jtut8jbl@example.com CAN_ATTACH_TO] 15:17 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 catalog fixtures 15:17 DEBUG [databricks.labs.ucx.mixins.fixtures] removing catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1719932924240, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ccyuu', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_ccyuu', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719932924240, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 15:17 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_dbfs_data_copy fixtures 15:17 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/BDIP 15:17 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 cluster fixtures 15:17 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster fixture: 15:17 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster fixture: 15:17 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures 15:17 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 15:17 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 table fixtures 15:17 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_s76ch.ucx_tb4nl', metastore_id=None, name='ucx_tb4nl', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070216'}, row_filter=None, schema_name='ucx_s76ch', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/BDIP', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:17 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 schema fixtures 15:17 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s76ch', metastore_id=None, name='ucx_s76ch', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:17 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_ccyuu', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ccyuu.ucx_s76ch', metastore_id=None, name='ucx_s76ch', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:17 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_smi6w', metastore_id=None, name='ucx_smi6w', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:18 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 workspace user fixtures 15:18 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='sdk-t0ajttfp@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-t0ajttfp@example.com')], entitlements=[], external_id=None, groups=[], id='6734792388722895', name=Name(family_name=None, given_name='sdk-t0ajttfp@example.com'), roles=[], schemas=[, ], user_name='sdk-t0ajttfp@example.com') 15:18 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='sdk-jtut8jbl@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-jtut8jbl@example.com')], entitlements=[], external_id=None, groups=[], id='8288570282097366', name=Name(family_name=None, given_name='sdk-jtut8jbl@example.com'), roles=[], schemas=[, ], user_name='sdk-jtut8jbl@example.com') [gw9] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```

Running from acceptance #4132