search

databrickslabs / ucx

Your best companion for upgrading to Unity Catalog. UCX will guide you, the Databricks customer, through the process of upgrading your account, groups, workspaces, jobs etc. to Unity Catalog.
Other
193 stars 69 forks source link

more core whitelisting #1991

Closed ericvergnaud closed 2 days ago

ericvergnaud commented 2 days ago

Changes

more core whitelisting

Linked issues

Progresses #1901

Functionality

None

Tests

nfx commented 2 days ago

this is a dummy library, it's a noise

github-actions[bot] commented 2 days ago

❌ 74/77 passed, 3 failed, 18 skipped, 5h25m57s total

❌ test_run_external_locations_using_access_connector: databricks.sdk.errors.platform.ResourceDoesNotExist: The specified pipeline e8e05e1c-14b3-40f4-b911-3687c3e1fb1d was not found. (2m48.359s) ``` databricks.sdk.errors.platform.ResourceDoesNotExist: The specified pipeline e8e05e1c-14b3-40f4-b911-3687c3e1fb1d was not found. [gw7] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 15:45 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/GGf0 15:45 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sj7kh: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sj7kh 15:45 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sj7kh', metastore_id=None, name='ucx_sj7kh', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:46 WARNING [databricks.labs.ucx.CLOUD_ENV.credentials] There is an existing external location overlaps with the prefix that is mapped to the service principal and used for validating the migrated storage credential. Skip the validation 15:46 INFO [databricks.labs.ucx.CLOUD_ENV.credentials] Found 1 distinct service principals already used in UC storage credentials 15:46 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sj7kh.CLOUD_ENV_service_principals] fetching CLOUD_ENV_service_principals inventory 15:47 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sj7kh.CLOUD_ENV_service_principals] crawling new batch for CLOUD_ENV_service_principals 15:47 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:47 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:47 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:47 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:47 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:47 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:47 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:47 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:47 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:47 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:47 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:47 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:47 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:47 WARNING [databricks.labs.ucx.assessment.crawlers] The cluster policy was deleted: 00038FA93D12A68F 15:47 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:47 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:47 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:47 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:47 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:47 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:47 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:47 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:47 WARNING [databricks.labs.ucx.assessment.secrets] removed on the backend: reallyasecret123/sp_app_client_id 15:47 WARNING [databricks.labs.ucx.assessment.secrets] removed on the backend: reallyasecret123/sp_app_client_id 15:47 WARNING [databricks.labs.ucx.assessment.secrets] removed on the backend: reallyasecret123/sp_app_client_id 15:47 WARNING [databricks.labs.ucx.assessment.secrets] removed on the backend: reallyasecret123/sp_app_client_id 15:47 WARNING [databricks.labs.ucx.assessment.secrets] removed on the backend: reallyasecret123/sp_app_client_id 15:47 WARNING [databricks.labs.ucx.assessment.secrets] removed on the backend: reallyasecret123/sp_app_client_id 15:47 WARNING [databricks.labs.ucx.assessment.secrets] removed on the backend: reallyasecret123/sp_app_client_id 15:47 WARNING [databricks.labs.ucx.assessment.secrets] removed on the backend: reallyasecret123/sp_app_client_id 15:47 WARNING [databricks.labs.ucx.assessment.secrets] removed on the backend: reallyasecret123/sp_app_client_id 15:47 WARNING [databricks.labs.ucx.assessment.secrets] removed on the backend: reallyasecret123/sp_app_client_id 15:47 WARNING [databricks.labs.ucx.assessment.secrets] removed on the backend: reallyasecret123/sp_app_client_id 15:47 WARNING [databricks.labs.ucx.assessment.secrets] removed on the backend: reallyasecret123/sp_app_client_id 15:45 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/GGf0 15:45 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sj7kh: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sj7kh 15:45 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sj7kh', metastore_id=None, name='ucx_sj7kh', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:46 WARNING [databricks.labs.ucx.CLOUD_ENV.credentials] There is an existing external location overlaps with the prefix that is mapped to the service principal and used for validating the migrated storage credential. Skip the validation 15:46 INFO [databricks.labs.ucx.CLOUD_ENV.credentials] Found 1 distinct service principals already used in UC storage credentials 15:46 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sj7kh.CLOUD_ENV_service_principals] fetching CLOUD_ENV_service_principals inventory 15:47 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sj7kh.CLOUD_ENV_service_principals] crawling new batch for CLOUD_ENV_service_principals 15:47 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:47 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:47 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:47 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:47 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:47 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:47 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:47 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:47 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:47 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:47 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:47 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:47 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:47 WARNING [databricks.labs.ucx.assessment.crawlers] The cluster policy was deleted: 00038FA93D12A68F 15:47 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:47 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:47 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:47 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:47 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:47 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:47 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:47 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:47 WARNING [databricks.labs.ucx.assessment.secrets] removed on the backend: reallyasecret123/sp_app_client_id 15:47 WARNING [databricks.labs.ucx.assessment.secrets] removed on the backend: reallyasecret123/sp_app_client_id 15:47 WARNING [databricks.labs.ucx.assessment.secrets] removed on the backend: reallyasecret123/sp_app_client_id 15:47 WARNING [databricks.labs.ucx.assessment.secrets] removed on the backend: reallyasecret123/sp_app_client_id 15:47 WARNING [databricks.labs.ucx.assessment.secrets] removed on the backend: reallyasecret123/sp_app_client_id 15:47 WARNING [databricks.labs.ucx.assessment.secrets] removed on the backend: reallyasecret123/sp_app_client_id 15:47 WARNING [databricks.labs.ucx.assessment.secrets] removed on the backend: reallyasecret123/sp_app_client_id 15:47 WARNING [databricks.labs.ucx.assessment.secrets] removed on the backend: reallyasecret123/sp_app_client_id 15:47 WARNING [databricks.labs.ucx.assessment.secrets] removed on the backend: reallyasecret123/sp_app_client_id 15:47 WARNING [databricks.labs.ucx.assessment.secrets] removed on the backend: reallyasecret123/sp_app_client_id 15:47 WARNING [databricks.labs.ucx.assessment.secrets] removed on the backend: reallyasecret123/sp_app_client_id 15:47 WARNING [databricks.labs.ucx.assessment.secrets] removed on the backend: reallyasecret123/sp_app_client_id 15:47 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_dbfs_data_copy fixtures 15:47 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/GGf0 15:47 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 cluster fixtures 15:47 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 schema fixtures 15:47 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sj7kh', metastore_id=None, name='ucx_sj7kh', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw7] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```
❌ test_table_migration_job_refreshes_migration_status[hiveserde-migrate-external-tables-ctas]: TimeoutError: Timed out after 0:05:00 (22m40.522s) ``` TimeoutError: Timed out after 0:05:00 15:55 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/TmL9 15:55 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.hiveserde_in_place_jklxz: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_jklxz 15:55 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.hiveserde_in_place_jklxz', metastore_id=None, name='hiveserde_in_place_jklxz', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:55 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_storage_dir fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_jklxz 15:56 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_jklxz.parquet_serde_jklxz: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_jklxz/parquet_serde_jklxz 15:56 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_jklxz.parquet_serde_jklxz', metastore_id=None, name='parquet_serde_jklxz', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070217'}, row_filter=None, schema_name='hiveserde_in_place_jklxz', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_jklxz/parquet_serde_jklxz', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:56 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_jklxz.orc_serde_jklxz: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_jklxz/orc_serde_jklxz 15:56 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_jklxz.orc_serde_jklxz', metastore_id=None, name='orc_serde_jklxz', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070217'}, row_filter=None, schema_name='hiveserde_in_place_jklxz', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_jklxz/orc_serde_jklxz', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:57 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_jklxz.avro_serde_jklxz: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_jklxz/avro_serde_jklxz 15:57 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_jklxz.avro_serde_jklxz', metastore_id=None, name='avro_serde_jklxz', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070217'}, row_filter=None, schema_name='hiveserde_in_place_jklxz', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_jklxz/avro_serde_jklxz', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:57 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1719935865105, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c57l6', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_c57l6', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719935865105, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 15:58 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_c57l6.hiveserde_in_place_jklxz: https://DATABRICKS_HOST/explore/data/ucx_c57l6/hiveserde_in_place_jklxz 15:58 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_c57l6', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c57l6.hiveserde_in_place_jklxz', metastore_id=None, name='hiveserde_in_place_jklxz', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:58 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_soh9w: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_soh9w 15:58 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_soh9w', metastore_id=None, name='ucx_soh9w', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw1] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 15:55 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/TmL9 15:55 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.hiveserde_in_place_jklxz: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_jklxz 15:55 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.hiveserde_in_place_jklxz', metastore_id=None, name='hiveserde_in_place_jklxz', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:55 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_storage_dir fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_jklxz 15:56 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_jklxz.parquet_serde_jklxz: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_jklxz/parquet_serde_jklxz 15:56 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_jklxz.parquet_serde_jklxz', metastore_id=None, name='parquet_serde_jklxz', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070217'}, row_filter=None, schema_name='hiveserde_in_place_jklxz', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_jklxz/parquet_serde_jklxz', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:56 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_jklxz.orc_serde_jklxz: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_jklxz/orc_serde_jklxz 15:56 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_jklxz.orc_serde_jklxz', metastore_id=None, name='orc_serde_jklxz', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070217'}, row_filter=None, schema_name='hiveserde_in_place_jklxz', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_jklxz/orc_serde_jklxz', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:57 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_jklxz.avro_serde_jklxz: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_jklxz/avro_serde_jklxz 15:57 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_jklxz.avro_serde_jklxz', metastore_id=None, name='avro_serde_jklxz', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070217'}, row_filter=None, schema_name='hiveserde_in_place_jklxz', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_jklxz/avro_serde_jklxz', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:57 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1719935865105, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c57l6', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_c57l6', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719935865105, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 15:58 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_c57l6.hiveserde_in_place_jklxz: https://DATABRICKS_HOST/explore/data/ucx_c57l6/hiveserde_in_place_jklxz 15:58 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_c57l6', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c57l6.hiveserde_in_place_jklxz', metastore_id=None, name='hiveserde_in_place_jklxz', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:58 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_soh9w: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_soh9w 15:58 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_soh9w', metastore_id=None, name='ucx_soh9w', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 16:02 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Haoy/config.yml) doesn't exist. 16:02 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 16:02 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 16:02 INFO [databricks.labs.ucx.install] Fetching installations... 16:02 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Haoy is corrupted. Skipping... 16:02 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 16:02 DEBUG [tests.integration.conftest] Waiting for clusters to start... 16:02 DEBUG [tests.integration.conftest] Waiting for clusters to start... 16:02 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+2820240702160240 16:02 INFO [databricks.labs.ucx.install] Creating ucx schemas... 16:06 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 16:06 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 16:06 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 16:06 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 16:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 16:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 16:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 16:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 16:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 16:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 16:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 16:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 16:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 16:07 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Haoy/README for the next steps. 16:07 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-external-tables-ctas job: https://DATABRICKS_HOST#job/1090971399585914 15:55 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/TmL9 15:55 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.hiveserde_in_place_jklxz: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_jklxz 15:55 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.hiveserde_in_place_jklxz', metastore_id=None, name='hiveserde_in_place_jklxz', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:55 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_storage_dir fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_jklxz 15:56 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_jklxz.parquet_serde_jklxz: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_jklxz/parquet_serde_jklxz 15:56 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_jklxz.parquet_serde_jklxz', metastore_id=None, name='parquet_serde_jklxz', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070217'}, row_filter=None, schema_name='hiveserde_in_place_jklxz', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_jklxz/parquet_serde_jklxz', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:56 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_jklxz.orc_serde_jklxz: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_jklxz/orc_serde_jklxz 15:56 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_jklxz.orc_serde_jklxz', metastore_id=None, name='orc_serde_jklxz', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070217'}, row_filter=None, schema_name='hiveserde_in_place_jklxz', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_jklxz/orc_serde_jklxz', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:57 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_jklxz.avro_serde_jklxz: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_jklxz/avro_serde_jklxz 15:57 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_jklxz.avro_serde_jklxz', metastore_id=None, name='avro_serde_jklxz', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070217'}, row_filter=None, schema_name='hiveserde_in_place_jklxz', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_jklxz/avro_serde_jklxz', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:57 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1719935865105, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c57l6', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_c57l6', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719935865105, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 15:58 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_c57l6.hiveserde_in_place_jklxz: https://DATABRICKS_HOST/explore/data/ucx_c57l6/hiveserde_in_place_jklxz 15:58 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_c57l6', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c57l6.hiveserde_in_place_jklxz', metastore_id=None, name='hiveserde_in_place_jklxz', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:58 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_soh9w: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_soh9w 15:58 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_soh9w', metastore_id=None, name='ucx_soh9w', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 16:02 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Haoy/config.yml) doesn't exist. 16:02 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 16:02 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 16:02 INFO [databricks.labs.ucx.install] Fetching installations... 16:02 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Haoy is corrupted. Skipping... 16:02 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 16:02 DEBUG [tests.integration.conftest] Waiting for clusters to start... 16:02 DEBUG [tests.integration.conftest] Waiting for clusters to start... 16:02 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+2820240702160240 16:02 INFO [databricks.labs.ucx.install] Creating ucx schemas... 16:06 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 16:06 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 16:06 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 16:06 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 16:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 16:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 16:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 16:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 16:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 16:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 16:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 16:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 16:07 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 16:07 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Haoy/README for the next steps. 16:07 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-external-tables-ctas job: https://DATABRICKS_HOST#job/1090971399585914 16:13 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_storage_dir fixtures 16:13 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_storage_dir fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_jklxz 16:13 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_dbfs_data_copy fixtures 16:13 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/TmL9 16:13 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 cluster fixtures 16:13 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 catalog fixtures 16:13 DEBUG [databricks.labs.ucx.mixins.fixtures] removing catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1719935865105, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c57l6', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_c57l6', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719935865105, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 16:13 INFO [databricks.labs.ucx.install] Deleting UCX v0.27.2+2820240702160240 from https://DATABRICKS_HOST 16:13 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_soh9w 16:14 INFO [databricks.labs.ucx.install] Deleting jobs 16:14 INFO [databricks.labs.ucx.install] Deleting experimental-workflow-linter job_id=717317951471871. 16:14 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=661947619644245. 16:14 INFO [databricks.labs.ucx.install] Deleting assessment job_id=445255168359983. 16:14 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=669692454152765. 16:14 INFO [databricks.labs.ucx.install] Deleting scan-tables-in-mounts-experimental job_id=1042052669858099. 16:14 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=532966172837823. 16:14 INFO [databricks.labs.ucx.install] Deleting migrate-data-reconciliation job_id=893959264429252. 16:14 INFO [databricks.labs.ucx.install] Deleting migrate-external-hiveserde-tables-in-place-experimental job_id=254897788178730. 16:14 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=928373153195369. 16:14 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=6034264176. 16:14 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=442986665495640. 16:14 INFO [databricks.labs.ucx.install] Deleting migrate-external-tables-ctas job_id=1090971399585914. 16:14 INFO [databricks.labs.ucx.install] Deleting failing job_id=963102292604999. 16:14 INFO [databricks.labs.ucx.install] Deleting cluster policy 16:14 INFO [databricks.labs.ucx.install] Deleting secret scope 16:14 INFO [databricks.labs.ucx.install] UnInstalling UCX complete 16:14 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace user fixtures 16:14 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 account group fixtures 16:14 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures 16:14 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 16:14 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 table fixtures 16:14 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_jklxz.parquet_serde_jklxz', metastore_id=None, name='parquet_serde_jklxz', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070217'}, row_filter=None, schema_name='hiveserde_in_place_jklxz', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_jklxz/parquet_serde_jklxz', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 16:15 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_jklxz.orc_serde_jklxz', metastore_id=None, name='orc_serde_jklxz', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070217'}, row_filter=None, schema_name='hiveserde_in_place_jklxz', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_jklxz/orc_serde_jklxz', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 16:16 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_jklxz.avro_serde_jklxz', metastore_id=None, name='avro_serde_jklxz', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070217'}, row_filter=None, schema_name='hiveserde_in_place_jklxz', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_jklxz/avro_serde_jklxz', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 16:16 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 schema fixtures 16:16 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.hiveserde_in_place_jklxz', metastore_id=None, name='hiveserde_in_place_jklxz', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 16:17 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_c57l6', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c57l6.hiveserde_in_place_jklxz', metastore_id=None, name='hiveserde_in_place_jklxz', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 16:17 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_soh9w', metastore_id=None, name='ucx_soh9w', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw1] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```
❌ test_create_catalog_schema_with_principal_acl_CLOUD_ENV: AssertionError: assert PrivilegeAssignment(principal='sdk-y7doagpd@example.com', privileges=[]) in [PrivilegeAssignment(principal='sdk-ftdkz7ws@example.com', privileges=[]), Privile...A: 'USE_SCHEMA'>]), PrivilegeAssignment(principal='ucx_G2RJ6', privileges=[]), ...] (31m20.765s) ``` AssertionError: assert PrivilegeAssignment(principal='sdk-y7doagpd@example.com', privileges=[]) in [PrivilegeAssignment(principal='sdk-ftdkz7ws@example.com', privileges=[]), Privile...A: 'USE_SCHEMA'>]), PrivilegeAssignment(principal='ucx_G2RJ6', privileges=[]), ...] + where [PrivilegeAssignment(principal='sdk-ftdkz7ws@example.com', privileges=[]), Privile...A: 'USE_SCHEMA'>]), PrivilegeAssignment(principal='ucx_G2RJ6', privileges=[]), ...] = PermissionsList(privilege_assignments=[PrivilegeAssignment(principal='sdk-ftdkz7ws@example.com', privileges=[]), PrivilegeAssignment(principal='sdk-ggxe0ze0@example.com', privileges=[])]).privilege_assignments 15:47 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/FzvZ 15:47 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sw4h6: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sw4h6 15:47 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sw4h6', metastore_id=None, name='ucx_sw4h6', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:48 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_sw4h6.ucx_tht6b: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sw4h6/ucx_tht6b 15:48 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sw4h6.ucx_tht6b', metastore_id=None, name='ucx_tht6b', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070217'}, row_filter=None, schema_name='ucx_sw4h6', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/FzvZ', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:48 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1719935303826, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cqldw', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cqldw', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719935303826, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 15:48 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cqldw.ucx_sw4h6: https://DATABRICKS_HOST/explore/data/ucx_cqldw/ucx_sw4h6 15:48 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cqldw', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cqldw.ucx_sw4h6', metastore_id=None, name='ucx_sw4h6', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw9] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 15:47 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/FzvZ 15:47 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sw4h6: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sw4h6 15:47 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sw4h6', metastore_id=None, name='ucx_sw4h6', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:48 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_sw4h6.ucx_tht6b: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sw4h6/ucx_tht6b 15:48 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sw4h6.ucx_tht6b', metastore_id=None, name='ucx_tht6b', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070217'}, row_filter=None, schema_name='ucx_sw4h6', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/FzvZ', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:48 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1719935303826, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cqldw', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cqldw', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719935303826, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 15:48 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cqldw.ucx_sw4h6: https://DATABRICKS_HOST/explore/data/ucx_cqldw/ucx_sw4h6 15:48 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cqldw', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cqldw.ucx_sw4h6', metastore_id=None, name='ucx_sw4h6', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:48 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: 15:48 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-np9aglie@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-np9aglie@example.com')], entitlements=[], external_id=None, groups=[], id='3140385250719453', name=Name(family_name=None, given_name='sdk-np9aglie@example.com'), roles=[], schemas=[, ], user_name='sdk-np9aglie@example.com') 15:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0702-154844-k3xfywz5 [group_name admins CAN_MANAGE] -> [user_name sdk-np9aglie@example.com CAN_ATTACH_TO] 15:49 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sx2re: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sx2re 15:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sx2re', metastore_id=None, name='ucx_sx2re', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:49 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:49 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:49 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:49 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:49 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:49 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:49 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:49 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:49 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:49 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:49 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:49 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:49 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:49 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:49 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:49 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:49 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:49 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:49 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Listing existing UC catalogs and schemas 15:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: 15:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-y7doagpd@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-y7doagpd@example.com')], entitlements=[], external_id=None, groups=[], id='5103693418023882', name=Name(family_name=None, given_name='sdk-y7doagpd@example.com'), roles=[], schemas=[, ], user_name='sdk-y7doagpd@example.com') 15:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0702-154933-35y4m8a [group_name admins CAN_MANAGE] -> [user_name sdk-y7doagpd@example.com CAN_ATTACH_TO] 15:49 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Listing existing UC catalogs and schemas 15:49 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Preparing a list of UC catalogs and schema to be created 15:49 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sx2re.tables] fetching tables inventory 15:50 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sx2re.tables] crawling new batch for tables 15:50 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sw4h6] listing tables 15:50 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sw4h6.ucx_tht6b] fetching table metadata 15:51 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sx2re.tables] found 1 new records for tables 15:53 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cqldw.ucx_sw4h6') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cqldw.ucx_sw4h6 TO `ucx_Gs40O` 15:54 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cqldw.ucx_sw4h6') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cqldw.ucx_sw4h6 TO `sdk-dvy9avrz@example.com` 15:54 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cqldw.ucx_sw4h6') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cqldw.ucx_sw4h6 TO `sdk-ggxe0ze0@example.com` 15:55 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cqldw.ucx_sw4h6') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cqldw.ucx_sw4h6 TO `ucx_GcM0H` 15:55 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cqldw.ucx_sw4h6') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cqldw.ucx_sw4h6 TO `sdk-oxez5uvp@example.com` 15:56 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cqldw.ucx_sw4h6') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cqldw.ucx_sw4h6 TO `sdk-rpw9iaki@example.com` 15:56 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cqldw.ucx_sw4h6') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cqldw.ucx_sw4h6 TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d` 15:57 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cqldw.ucx_sw4h6') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cqldw.ucx_sw4h6 TO `sdk-0qfe2vwm@example.com` 15:57 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cqldw.ucx_sw4h6') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cqldw.ucx_sw4h6 TO `sdk-nwga4jit@example.com` 15:58 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cqldw.ucx_sw4h6') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cqldw.ucx_sw4h6 TO `ucx_G2RJ6` 15:58 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cqldw.ucx_sw4h6') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cqldw.ucx_sw4h6 TO `sdk-np9aglie@example.com` 15:59 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cqldw.ucx_sw4h6') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cqldw.ucx_sw4h6 TO `sdk-tvfoth6f@example.com` 15:59 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cqldw.ucx_sw4h6') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cqldw.ucx_sw4h6 TO `serge.smertin@databricks.com` 15:59 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cqldw.ucx_sw4h6') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cqldw.ucx_sw4h6 TO `sdk-ftdkz7ws@example.com` 16:00 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cqldw.ucx_sw4h6') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cqldw.ucx_sw4h6 TO `ucx_GxpPh` 16:00 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cqldw.ucx_sw4h6') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cqldw.ucx_sw4h6 TO `ucx_GQNOD` 16:01 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cqldw.ucx_sw4h6') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cqldw.ucx_sw4h6 TO `sdk-l49kq5g0@example.com` 16:01 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cqldw.ucx_sw4h6') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cqldw.ucx_sw4h6 TO `sdk-4uodjt3x@example.com` 16:02 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cqldw.ucx_sw4h6') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cqldw.ucx_sw4h6 TO `ucx_GWFIM` 16:02 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cqldw.ucx_sw4h6') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cqldw.ucx_sw4h6 TO `sdk-quisfsgh@example.com` 16:03 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cqldw.ucx_sw4h6') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cqldw.ucx_sw4h6 TO `sdk-bxp72rsc@example.com` 16:03 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cqldw.ucx_sw4h6') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cqldw.ucx_sw4h6 TO `sdk-ocst3ap0@example.com` 16:04 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cqldw.ucx_sw4h6') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cqldw.ucx_sw4h6 TO `5a11359f-ba1f-483f-8e00-0fe55ec003ed` 16:04 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cqldw') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cqldw TO `sdk-ggxe0ze0@example.com` 16:05 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cqldw') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cqldw TO `ucx_GxpPh` 16:05 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cqldw') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cqldw TO `sdk-l49kq5g0@example.com` 16:05 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cqldw') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cqldw TO `sdk-ocst3ap0@example.com` 16:06 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cqldw') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cqldw TO `ucx_Gs40O` 16:06 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cqldw') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cqldw TO `5a11359f-ba1f-483f-8e00-0fe55ec003ed` 16:07 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cqldw') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cqldw TO `sdk-rpw9iaki@example.com` 16:07 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cqldw') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cqldw TO `ucx_GcM0H` 16:08 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cqldw') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cqldw TO `sdk-nwga4jit@example.com` 16:08 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cqldw') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cqldw TO `serge.smertin@databricks.com` 16:09 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cqldw') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cqldw TO `sdk-np9aglie@example.com` 16:09 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cqldw') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cqldw TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d` 16:10 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cqldw') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cqldw TO `sdk-dvy9avrz@example.com` 16:10 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cqldw') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cqldw TO `ucx_GWFIM` 16:11 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cqldw') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cqldw TO `ucx_GQNOD` 16:11 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cqldw') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cqldw TO `sdk-tvfoth6f@example.com` 16:12 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cqldw') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cqldw TO `sdk-4uodjt3x@example.com` 16:12 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cqldw') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cqldw TO `sdk-quisfsgh@example.com` 16:13 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cqldw') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cqldw TO `sdk-bxp72rsc@example.com` 16:13 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cqldw') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cqldw TO `sdk-0qfe2vwm@example.com` 16:14 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cqldw') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cqldw TO `ucx_G2RJ6` 16:14 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cqldw') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cqldw TO `sdk-ftdkz7ws@example.com` 16:15 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cqldw') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cqldw TO `sdk-oxez5uvp@example.com` 15:47 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/FzvZ 15:47 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sw4h6: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sw4h6 15:47 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sw4h6', metastore_id=None, name='ucx_sw4h6', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:48 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_sw4h6.ucx_tht6b: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sw4h6/ucx_tht6b 15:48 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sw4h6.ucx_tht6b', metastore_id=None, name='ucx_tht6b', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070217'}, row_filter=None, schema_name='ucx_sw4h6', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/FzvZ', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:48 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1719935303826, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cqldw', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cqldw', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719935303826, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 15:48 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cqldw.ucx_sw4h6: https://DATABRICKS_HOST/explore/data/ucx_cqldw/ucx_sw4h6 15:48 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cqldw', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cqldw.ucx_sw4h6', metastore_id=None, name='ucx_sw4h6', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:48 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: 15:48 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-np9aglie@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-np9aglie@example.com')], entitlements=[], external_id=None, groups=[], id='3140385250719453', name=Name(family_name=None, given_name='sdk-np9aglie@example.com'), roles=[], schemas=[, ], user_name='sdk-np9aglie@example.com') 15:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0702-154844-k3xfywz5 [group_name admins CAN_MANAGE] -> [user_name sdk-np9aglie@example.com CAN_ATTACH_TO] 15:49 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sx2re: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sx2re 15:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sx2re', metastore_id=None, name='ucx_sx2re', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:49 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:49 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:49 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:49 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:49 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:49 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:49 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:49 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:49 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:49 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:49 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:49 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:49 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:49 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:49 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:49 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:49 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:49 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 15:49 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Listing existing UC catalogs and schemas 15:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: 15:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-y7doagpd@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-y7doagpd@example.com')], entitlements=[], external_id=None, groups=[], id='5103693418023882', name=Name(family_name=None, given_name='sdk-y7doagpd@example.com'), roles=[], schemas=[, ], user_name='sdk-y7doagpd@example.com') 15:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0702-154933-35y4m8a [group_name admins CAN_MANAGE] -> [user_name sdk-y7doagpd@example.com CAN_ATTACH_TO] 15:49 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Listing existing UC catalogs and schemas 15:49 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Preparing a list of UC catalogs and schema to be created 15:49 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sx2re.tables] fetching tables inventory 15:50 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sx2re.tables] crawling new batch for tables 15:50 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sw4h6] listing tables 15:50 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sw4h6.ucx_tht6b] fetching table metadata 15:51 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sx2re.tables] found 1 new records for tables 15:53 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cqldw.ucx_sw4h6') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cqldw.ucx_sw4h6 TO `ucx_Gs40O` 15:54 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cqldw.ucx_sw4h6') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cqldw.ucx_sw4h6 TO `sdk-dvy9avrz@example.com` 15:54 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cqldw.ucx_sw4h6') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cqldw.ucx_sw4h6 TO `sdk-ggxe0ze0@example.com` 15:55 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cqldw.ucx_sw4h6') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cqldw.ucx_sw4h6 TO `ucx_GcM0H` 15:55 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cqldw.ucx_sw4h6') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cqldw.ucx_sw4h6 TO `sdk-oxez5uvp@example.com` 15:56 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cqldw.ucx_sw4h6') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cqldw.ucx_sw4h6 TO `sdk-rpw9iaki@example.com` 15:56 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cqldw.ucx_sw4h6') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cqldw.ucx_sw4h6 TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d` 15:57 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cqldw.ucx_sw4h6') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cqldw.ucx_sw4h6 TO `sdk-0qfe2vwm@example.com` 15:57 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cqldw.ucx_sw4h6') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cqldw.ucx_sw4h6 TO `sdk-nwga4jit@example.com` 15:58 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cqldw.ucx_sw4h6') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cqldw.ucx_sw4h6 TO `ucx_G2RJ6` 15:58 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cqldw.ucx_sw4h6') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cqldw.ucx_sw4h6 TO `sdk-np9aglie@example.com` 15:59 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cqldw.ucx_sw4h6') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cqldw.ucx_sw4h6 TO `sdk-tvfoth6f@example.com` 15:59 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cqldw.ucx_sw4h6') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cqldw.ucx_sw4h6 TO `serge.smertin@databricks.com` 15:59 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cqldw.ucx_sw4h6') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cqldw.ucx_sw4h6 TO `sdk-ftdkz7ws@example.com` 16:00 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cqldw.ucx_sw4h6') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cqldw.ucx_sw4h6 TO `ucx_GxpPh` 16:00 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cqldw.ucx_sw4h6') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cqldw.ucx_sw4h6 TO `ucx_GQNOD` 16:01 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cqldw.ucx_sw4h6') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cqldw.ucx_sw4h6 TO `sdk-l49kq5g0@example.com` 16:01 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cqldw.ucx_sw4h6') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cqldw.ucx_sw4h6 TO `sdk-4uodjt3x@example.com` 16:02 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cqldw.ucx_sw4h6') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cqldw.ucx_sw4h6 TO `ucx_GWFIM` 16:02 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cqldw.ucx_sw4h6') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cqldw.ucx_sw4h6 TO `sdk-quisfsgh@example.com` 16:03 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cqldw.ucx_sw4h6') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cqldw.ucx_sw4h6 TO `sdk-bxp72rsc@example.com` 16:03 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cqldw.ucx_sw4h6') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cqldw.ucx_sw4h6 TO `sdk-ocst3ap0@example.com` 16:04 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cqldw.ucx_sw4h6') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cqldw.ucx_sw4h6 TO `5a11359f-ba1f-483f-8e00-0fe55ec003ed` 16:04 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cqldw') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cqldw TO `sdk-ggxe0ze0@example.com` 16:05 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cqldw') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cqldw TO `ucx_GxpPh` 16:05 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cqldw') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cqldw TO `sdk-l49kq5g0@example.com` 16:05 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cqldw') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cqldw TO `sdk-ocst3ap0@example.com` 16:06 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cqldw') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cqldw TO `ucx_Gs40O` 16:06 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cqldw') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cqldw TO `5a11359f-ba1f-483f-8e00-0fe55ec003ed` 16:07 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cqldw') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cqldw TO `sdk-rpw9iaki@example.com` 16:07 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cqldw') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cqldw TO `ucx_GcM0H` 16:08 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cqldw') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cqldw TO `sdk-nwga4jit@example.com` 16:08 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cqldw') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cqldw TO `serge.smertin@databricks.com` 16:09 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cqldw') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cqldw TO `sdk-np9aglie@example.com` 16:09 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cqldw') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cqldw TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d` 16:10 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cqldw') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cqldw TO `sdk-dvy9avrz@example.com` 16:10 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cqldw') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cqldw TO `ucx_GWFIM` 16:11 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cqldw') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cqldw TO `ucx_GQNOD` 16:11 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cqldw') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cqldw TO `sdk-tvfoth6f@example.com` 16:12 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cqldw') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cqldw TO `sdk-4uodjt3x@example.com` 16:12 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cqldw') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cqldw TO `sdk-quisfsgh@example.com` 16:13 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cqldw') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cqldw TO `sdk-bxp72rsc@example.com` 16:13 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cqldw') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cqldw TO `sdk-0qfe2vwm@example.com` 16:14 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cqldw') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cqldw TO `ucx_G2RJ6` 16:14 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cqldw') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cqldw TO `sdk-ftdkz7ws@example.com` 16:15 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cqldw') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cqldw TO `sdk-oxez5uvp@example.com` 16:16 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 cluster permissions fixtures 16:16 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster permissions fixture: 0702-154844-k3xfywz5 [group_name admins CAN_MANAGE] -> [user_name sdk-np9aglie@example.com CAN_ATTACH_TO] 16:16 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster permissions fixture: 0702-154933-35y4m8a [group_name admins CAN_MANAGE] -> [user_name sdk-y7doagpd@example.com CAN_ATTACH_TO] 16:16 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 catalog fixtures 16:16 DEBUG [databricks.labs.ucx.mixins.fixtures] removing catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1719935303826, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cqldw', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cqldw', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719935303826, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 16:16 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_dbfs_data_copy fixtures 16:16 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/FzvZ 16:16 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 cluster fixtures 16:16 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster fixture: 16:16 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster fixture: 16:16 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures 16:16 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 16:16 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 table fixtures 16:16 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sw4h6.ucx_tht6b', metastore_id=None, name='ucx_tht6b', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070217'}, row_filter=None, schema_name='ucx_sw4h6', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/FzvZ', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 16:17 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 schema fixtures 16:17 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sw4h6', metastore_id=None, name='ucx_sw4h6', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 16:17 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cqldw', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cqldw.ucx_sw4h6', metastore_id=None, name='ucx_sw4h6', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 16:18 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sx2re', metastore_id=None, name='ucx_sx2re', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 16:18 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 workspace user fixtures 16:18 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='sdk-np9aglie@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-np9aglie@example.com')], entitlements=[], external_id=None, groups=[], id='3140385250719453', name=Name(family_name=None, given_name='sdk-np9aglie@example.com'), roles=[], schemas=[, ], user_name='sdk-np9aglie@example.com') 16:18 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='sdk-y7doagpd@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-y7doagpd@example.com')], entitlements=[], external_id=None, groups=[], id='5103693418023882', name=Name(family_name=None, given_name='sdk-y7doagpd@example.com'), roles=[], schemas=[, ], user_name='sdk-y7doagpd@example.com') [gw9] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```

Running from acceptance #4146