databrickslabs / ucx

Automated migrations to Unity Catalog
Other
221 stars 77 forks source link

whitelist cleanlab-studio #2059

Closed ericvergnaud closed 2 months ago

ericvergnaud commented 3 months ago

Changes

whitelist cleanlab-studio

Linked issues

Progresses #1901

Functionality

None

Tests

github-actions[bot] commented 3 months ago

❌ 84/89 passed, 5 failed, 19 skipped, 5h54m8s total

❌ test_group: TimeoutError: Timed out after 0:00:30 (33.77s) ``` TimeoutError: Timed out after 0:00:30 [gw9] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 11:20 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-c80k9hhc@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-c80k9hhc@example.com')], entitlements=[], external_id=None, groups=[], id='4832077848403649', name=Name(family_name=None, given_name='sdk-c80k9hhc@example.com'), roles=[], schemas=[, ], user_name='sdk-c80k9hhc@example.com') 11:20 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-c80k9hhc@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-c80k9hhc@example.com')], entitlements=[], external_id=None, groups=[], id='4832077848403649', name=Name(family_name=None, given_name='sdk-c80k9hhc@example.com'), roles=[], schemas=[, ], user_name='sdk-c80k9hhc@example.com') 11:20 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace user fixtures 11:20 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='sdk-c80k9hhc@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-c80k9hhc@example.com')], entitlements=[], external_id=None, groups=[], id='4832077848403649', name=Name(family_name=None, given_name='sdk-c80k9hhc@example.com'), roles=[], schemas=[, ], user_name='sdk-c80k9hhc@example.com') 11:20 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures [gw9] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```
❌ test_table_migration_job_refreshes_migration_status[hiveserde-migrate-external-tables-ctas]: TimeoutError: Timed out after 0:05:00 (16m30.653s) ``` TimeoutError: Timed out after 0:05:00 11:32 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/7XWW 11:32 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.hiveserde_in_place_o9ogy: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_o9ogy 11:32 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.hiveserde_in_place_o9ogy', metastore_id=None, name='hiveserde_in_place_o9ogy', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:32 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_storage_dir fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_o9ogy 11:32 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_o9ogy.parquet_serde_o9ogy: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_o9ogy/parquet_serde_o9ogy 11:32 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_o9ogy.parquet_serde_o9ogy', metastore_id=None, name='parquet_serde_o9ogy', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070312'}, row_filter=None, schema_name='hiveserde_in_place_o9ogy', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_o9ogy/parquet_serde_o9ogy', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:33 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_o9ogy.orc_serde_o9ogy: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_o9ogy/orc_serde_o9ogy 11:33 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_o9ogy.orc_serde_o9ogy', metastore_id=None, name='orc_serde_o9ogy', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070312'}, row_filter=None, schema_name='hiveserde_in_place_o9ogy', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_o9ogy/orc_serde_o9ogy', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:33 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_o9ogy.avro_serde_o9ogy: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_o9ogy/avro_serde_o9ogy 11:33 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_o9ogy.avro_serde_o9ogy', metastore_id=None, name='avro_serde_o9ogy', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070312'}, row_filter=None, schema_name='hiveserde_in_place_o9ogy', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_o9ogy/avro_serde_o9ogy', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:34 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720006447606, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cn6ph', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cn6ph', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720006447606, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 11:34 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cn6ph.hiveserde_in_place_o9ogy: https://DATABRICKS_HOST/explore/data/ucx_cn6ph/hiveserde_in_place_o9ogy 11:34 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cn6ph', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cn6ph.hiveserde_in_place_o9ogy', metastore_id=None, name='hiveserde_in_place_o9ogy', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:34 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sthpo: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sthpo 11:34 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sthpo', metastore_id=None, name='ucx_sthpo', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw1] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 11:32 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/7XWW 11:32 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.hiveserde_in_place_o9ogy: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_o9ogy 11:32 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.hiveserde_in_place_o9ogy', metastore_id=None, name='hiveserde_in_place_o9ogy', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:32 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_storage_dir fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_o9ogy 11:32 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_o9ogy.parquet_serde_o9ogy: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_o9ogy/parquet_serde_o9ogy 11:32 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_o9ogy.parquet_serde_o9ogy', metastore_id=None, name='parquet_serde_o9ogy', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070312'}, row_filter=None, schema_name='hiveserde_in_place_o9ogy', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_o9ogy/parquet_serde_o9ogy', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:33 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_o9ogy.orc_serde_o9ogy: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_o9ogy/orc_serde_o9ogy 11:33 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_o9ogy.orc_serde_o9ogy', metastore_id=None, name='orc_serde_o9ogy', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070312'}, row_filter=None, schema_name='hiveserde_in_place_o9ogy', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_o9ogy/orc_serde_o9ogy', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:33 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_o9ogy.avro_serde_o9ogy: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_o9ogy/avro_serde_o9ogy 11:33 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_o9ogy.avro_serde_o9ogy', metastore_id=None, name='avro_serde_o9ogy', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070312'}, row_filter=None, schema_name='hiveserde_in_place_o9ogy', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_o9ogy/avro_serde_o9ogy', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:34 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720006447606, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cn6ph', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cn6ph', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720006447606, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 11:34 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cn6ph.hiveserde_in_place_o9ogy: https://DATABRICKS_HOST/explore/data/ucx_cn6ph/hiveserde_in_place_o9ogy 11:34 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cn6ph', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cn6ph.hiveserde_in_place_o9ogy', metastore_id=None, name='hiveserde_in_place_o9ogy', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:34 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sthpo: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sthpo 11:34 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sthpo', metastore_id=None, name='ucx_sthpo', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:37 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.ko28/config.yml) doesn't exist. 11:37 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 11:37 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 11:37 INFO [databricks.labs.ucx.install] Fetching installations... 11:39 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.ko28 is corrupted. Skipping... 11:39 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 11:39 DEBUG [tests.integration.conftest] Waiting for clusters to start... 11:39 DEBUG [tests.integration.conftest] Waiting for clusters to start... 11:39 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+7020240703113907 11:39 INFO [databricks.labs.ucx.install] Creating ucx schemas... 11:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 11:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 11:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 11:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 11:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 11:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 11:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 11:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 11:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 11:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 11:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 11:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 11:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 11:42 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.ko28/README for the next steps. 11:42 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-external-tables-ctas job: https://DATABRICKS_HOST#job/1112216292983661 11:32 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/7XWW 11:32 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.hiveserde_in_place_o9ogy: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_o9ogy 11:32 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.hiveserde_in_place_o9ogy', metastore_id=None, name='hiveserde_in_place_o9ogy', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:32 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_storage_dir fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_o9ogy 11:32 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_o9ogy.parquet_serde_o9ogy: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_o9ogy/parquet_serde_o9ogy 11:32 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_o9ogy.parquet_serde_o9ogy', metastore_id=None, name='parquet_serde_o9ogy', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070312'}, row_filter=None, schema_name='hiveserde_in_place_o9ogy', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_o9ogy/parquet_serde_o9ogy', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:33 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_o9ogy.orc_serde_o9ogy: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_o9ogy/orc_serde_o9ogy 11:33 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_o9ogy.orc_serde_o9ogy', metastore_id=None, name='orc_serde_o9ogy', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070312'}, row_filter=None, schema_name='hiveserde_in_place_o9ogy', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_o9ogy/orc_serde_o9ogy', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:33 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_o9ogy.avro_serde_o9ogy: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_o9ogy/avro_serde_o9ogy 11:33 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_o9ogy.avro_serde_o9ogy', metastore_id=None, name='avro_serde_o9ogy', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070312'}, row_filter=None, schema_name='hiveserde_in_place_o9ogy', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_o9ogy/avro_serde_o9ogy', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:34 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720006447606, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cn6ph', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cn6ph', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720006447606, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 11:34 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cn6ph.hiveserde_in_place_o9ogy: https://DATABRICKS_HOST/explore/data/ucx_cn6ph/hiveserde_in_place_o9ogy 11:34 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cn6ph', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cn6ph.hiveserde_in_place_o9ogy', metastore_id=None, name='hiveserde_in_place_o9ogy', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:34 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sthpo: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sthpo 11:34 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sthpo', metastore_id=None, name='ucx_sthpo', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:37 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.ko28/config.yml) doesn't exist. 11:37 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 11:37 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 11:37 INFO [databricks.labs.ucx.install] Fetching installations... 11:39 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.ko28 is corrupted. Skipping... 11:39 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 11:39 DEBUG [tests.integration.conftest] Waiting for clusters to start... 11:39 DEBUG [tests.integration.conftest] Waiting for clusters to start... 11:39 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+7020240703113907 11:39 INFO [databricks.labs.ucx.install] Creating ucx schemas... 11:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 11:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 11:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 11:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 11:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 11:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 11:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 11:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 11:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 11:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 11:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 11:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 11:42 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 11:42 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.ko28/README for the next steps. 11:42 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-external-tables-ctas job: https://DATABRICKS_HOST#job/1112216292983661 11:46 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_storage_dir fixtures 11:46 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_storage_dir fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_o9ogy 11:46 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_dbfs_data_copy fixtures 11:46 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/7XWW 11:46 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 cluster fixtures 11:46 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 catalog fixtures 11:46 DEBUG [databricks.labs.ucx.mixins.fixtures] removing catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720006447606, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cn6ph', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cn6ph', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720006447606, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 11:46 INFO [databricks.labs.ucx.install] Deleting UCX v0.27.2+7020240703113907 from https://DATABRICKS_HOST 11:46 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_sthpo 11:46 INFO [databricks.labs.ucx.install] Deleting jobs 11:46 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=472507543898691. 11:46 INFO [databricks.labs.ucx.install] Deleting failing job_id=496202119802365. 11:46 INFO [databricks.labs.ucx.install] Deleting migrate-data-reconciliation job_id=511932005203946. 11:46 INFO [databricks.labs.ucx.install] Deleting assessment job_id=798642378705260. 11:46 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=666198779644072. 11:46 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=516873936181115. 11:46 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=12071939951585. 11:46 INFO [databricks.labs.ucx.install] Deleting experimental-workflow-linter job_id=1037700392354494. 11:46 INFO [databricks.labs.ucx.install] Deleting scan-tables-in-mounts-experimental job_id=81060599205344. 11:46 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=493726077430843. 11:46 INFO [databricks.labs.ucx.install] Deleting migrate-external-tables-ctas job_id=1112216292983661. 11:46 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=651051295347977. 11:46 INFO [databricks.labs.ucx.install] Deleting migrate-external-hiveserde-tables-in-place-experimental job_id=148298376134662. 11:46 INFO [databricks.labs.ucx.install] Deleting cluster policy 11:46 INFO [databricks.labs.ucx.install] Deleting secret scope 11:46 INFO [databricks.labs.ucx.install] UnInstalling UCX complete 11:46 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace user fixtures 11:46 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 account group fixtures 11:46 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures 11:46 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 11:46 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 table fixtures 11:46 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_o9ogy.parquet_serde_o9ogy', metastore_id=None, name='parquet_serde_o9ogy', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070312'}, row_filter=None, schema_name='hiveserde_in_place_o9ogy', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_o9ogy/parquet_serde_o9ogy', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:47 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_o9ogy.orc_serde_o9ogy', metastore_id=None, name='orc_serde_o9ogy', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070312'}, row_filter=None, schema_name='hiveserde_in_place_o9ogy', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_o9ogy/orc_serde_o9ogy', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:47 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_o9ogy.avro_serde_o9ogy', metastore_id=None, name='avro_serde_o9ogy', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070312'}, row_filter=None, schema_name='hiveserde_in_place_o9ogy', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_o9ogy/avro_serde_o9ogy', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:47 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 schema fixtures 11:47 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.hiveserde_in_place_o9ogy', metastore_id=None, name='hiveserde_in_place_o9ogy', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:48 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cn6ph', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cn6ph.hiveserde_in_place_o9ogy', metastore_id=None, name='hiveserde_in_place_o9ogy', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:48 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sthpo', metastore_id=None, name='ucx_sthpo', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw1] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```
❌ test_running_real_workflow_linter_job: TimeoutError: Timed out after 0:02:00 (7m24.67s) ``` TimeoutError: Timed out after 0:02:00 [gw2] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 11:48 DEBUG [databricks.labs.ucx.mixins.fixtures] added directory fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-Mco5 11:48 DEBUG [databricks.labs.ucx.mixins.fixtures] added notebook fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-Mco5/notebook.ipynb 11:48 INFO [databricks.labs.ucx.mixins.fixtures] Job: https://DATABRICKS_HOST#job/663305467066810 11:48 DEBUG [databricks.labs.ucx.mixins.fixtures] added job fixture: CreateResponse(job_id=663305467066810) 11:49 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sw8h2: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sw8h2 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sw8h2', metastore_id=None, name='ucx_sw8h2', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:49 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.A9sU/config.yml) doesn't exist. 11:49 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 11:49 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 11:49 INFO [databricks.labs.ucx.install] Fetching installations... 11:49 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 11:49 DEBUG [tests.integration.conftest] Waiting for clusters to start... 11:49 DEBUG [tests.integration.conftest] Waiting for clusters to start... 11:49 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+7020240703114930 11:49 INFO [databricks.labs.ucx.install] Creating ucx schemas... 11:51 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 11:51 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 11:51 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 11:51 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 11:51 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 11:51 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 11:51 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 11:51 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 11:51 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 11:51 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 11:51 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 11:51 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 11:51 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 11:51 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.A9sU/README for the next steps. 11:51 DEBUG [databricks.labs.ucx.installer.workflows] starting experimental-workflow-linter job: https://DATABRICKS_HOST#job/780159370944200 11:55 DEBUG [databricks.labs.ucx.installer.workflows] Validating experimental-workflow-linter workflow: https://DATABRICKS_HOST#job/780159370944200 11:48 DEBUG [databricks.labs.ucx.mixins.fixtures] added directory fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-Mco5 11:48 DEBUG [databricks.labs.ucx.mixins.fixtures] added notebook fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-Mco5/notebook.ipynb 11:48 INFO [databricks.labs.ucx.mixins.fixtures] Job: https://DATABRICKS_HOST#job/663305467066810 11:48 DEBUG [databricks.labs.ucx.mixins.fixtures] added job fixture: CreateResponse(job_id=663305467066810) 11:49 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sw8h2: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sw8h2 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sw8h2', metastore_id=None, name='ucx_sw8h2', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:49 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.A9sU/config.yml) doesn't exist. 11:49 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 11:49 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 11:49 INFO [databricks.labs.ucx.install] Fetching installations... 11:49 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 11:49 DEBUG [tests.integration.conftest] Waiting for clusters to start... 11:49 DEBUG [tests.integration.conftest] Waiting for clusters to start... 11:49 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+7020240703114930 11:49 INFO [databricks.labs.ucx.install] Creating ucx schemas... 11:51 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 11:51 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 11:51 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 11:51 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 11:51 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 11:51 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 11:51 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 11:51 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 11:51 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 11:51 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 11:51 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 11:51 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 11:51 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 11:51 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.A9sU/README for the next steps. 11:51 DEBUG [databricks.labs.ucx.installer.workflows] starting experimental-workflow-linter job: https://DATABRICKS_HOST#job/780159370944200 11:55 DEBUG [databricks.labs.ucx.installer.workflows] Validating experimental-workflow-linter workflow: https://DATABRICKS_HOST#job/780159370944200 11:55 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 job fixtures 11:55 DEBUG [databricks.labs.ucx.mixins.fixtures] removing job fixture: CreateResponse(job_id=663305467066810) 11:55 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 directory fixtures 11:55 DEBUG [databricks.labs.ucx.mixins.fixtures] removing directory fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-Mco5 11:55 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 notebook fixtures 11:55 DEBUG [databricks.labs.ucx.mixins.fixtures] removing notebook fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-Mco5/notebook.ipynb 11:55 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while notebook /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-Mco5/notebook.ipynb teardown: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-Mco5/notebook.ipynb) doesn't exist. 11:55 INFO [databricks.labs.ucx.install] Deleting UCX v0.27.2+7020240703114930 from https://DATABRICKS_HOST 11:55 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_sw8h2 11:56 INFO [databricks.labs.ucx.install] Deleting jobs 11:56 INFO [databricks.labs.ucx.install] Deleting failing job_id=607104969359310. 11:56 INFO [databricks.labs.ucx.install] Deleting scan-tables-in-mounts-experimental job_id=952249722196940. 11:56 INFO [databricks.labs.ucx.install] Deleting experimental-workflow-linter job_id=780159370944200. 11:56 INFO [databricks.labs.ucx.install] Deleting assessment job_id=812090921015506. 11:56 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=1033121449268097. 11:56 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=35667716464264. 11:56 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=291096558827114. 11:56 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=178988095246938. 11:56 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=470419663555047. 11:56 INFO [databricks.labs.ucx.install] Deleting migrate-external-hiveserde-tables-in-place-experimental job_id=426044277529423. 11:56 INFO [databricks.labs.ucx.install] Deleting migrate-data-reconciliation job_id=904098114264916. 11:56 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=582511759397249. 11:56 INFO [databricks.labs.ucx.install] Deleting migrate-external-tables-ctas job_id=1092986712642946. 11:56 INFO [databricks.labs.ucx.install] Deleting cluster policy 11:56 INFO [databricks.labs.ucx.install] Deleting secret scope 11:56 INFO [databricks.labs.ucx.install] UnInstalling UCX complete 11:56 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace user fixtures 11:56 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 account group fixtures 11:56 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures 11:56 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 11:56 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 11:56 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 schema fixtures 11:56 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sw8h2', metastore_id=None, name='ucx_sw8h2', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw2] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```
❌ test_create_catalog_schema_with_principal_acl_CLOUD_ENV: AssertionError: assert PrivilegeAssignment(principal='sdk-9g3irrqn@example.com', privileges=[]) in [PrivilegeAssignment(principal='sdk-5haxv6rw@example.com', privileges=[]), Privile...A: 'USE_SCHEMA'>]), PrivilegeAssignment(principal='ucx_GjyMr', privileges=[]), ...] (38m11.904s) ``` AssertionError: assert PrivilegeAssignment(principal='sdk-9g3irrqn@example.com', privileges=[]) in [PrivilegeAssignment(principal='sdk-5haxv6rw@example.com', privileges=[]), Privile...A: 'USE_SCHEMA'>]), PrivilegeAssignment(principal='ucx_GjyMr', privileges=[]), ...] + where [PrivilegeAssignment(principal='sdk-5haxv6rw@example.com', privileges=[]), Privile...A: 'USE_SCHEMA'>]), PrivilegeAssignment(principal='ucx_GjyMr', privileges=[]), ...] = PermissionsList(privilege_assignments=[PrivilegeAssignment(principal='sdk-5haxv6rw@example.com', privileges=[]), PrivilegeAssignment(principal='sdk-xh1hj2kq@example.com', privileges=[])]).privilege_assignments 11:23 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/85qF 11:23 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_szh1z: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_szh1z 11:23 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_szh1z', metastore_id=None, name='ucx_szh1z', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:24 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_szh1z.ucx_toi2i: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_szh1z/ucx_toi2i 11:24 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_szh1z.ucx_toi2i', metastore_id=None, name='ucx_toi2i', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070312'}, row_filter=None, schema_name='ucx_szh1z', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/85qF', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:24 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720005888093, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cio5m', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cio5m', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720005888093, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 11:25 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cio5m.ucx_szh1z: https://DATABRICKS_HOST/explore/data/ucx_cio5m/ucx_szh1z 11:25 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cio5m', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cio5m.ucx_szh1z', metastore_id=None, name='ucx_szh1z', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw7] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 11:23 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/85qF 11:23 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_szh1z: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_szh1z 11:23 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_szh1z', metastore_id=None, name='ucx_szh1z', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:24 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_szh1z.ucx_toi2i: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_szh1z/ucx_toi2i 11:24 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_szh1z.ucx_toi2i', metastore_id=None, name='ucx_toi2i', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070312'}, row_filter=None, schema_name='ucx_szh1z', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/85qF', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:24 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720005888093, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cio5m', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cio5m', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720005888093, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 11:25 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cio5m.ucx_szh1z: https://DATABRICKS_HOST/explore/data/ucx_cio5m/ucx_szh1z 11:25 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cio5m', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cio5m.ucx_szh1z', metastore_id=None, name='ucx_szh1z', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:25 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: 11:25 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-5haxv6rw@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-5haxv6rw@example.com')], entitlements=[], external_id=None, groups=[], id='4750043658407121', name=Name(family_name=None, given_name='sdk-5haxv6rw@example.com'), roles=[], schemas=[, ], user_name='sdk-5haxv6rw@example.com') 11:25 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0703-112516-d4bl0duz [group_name admins CAN_MANAGE] -> [user_name sdk-5haxv6rw@example.com CAN_ATTACH_TO] 11:26 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_shn3u: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_shn3u 11:26 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_shn3u', metastore_id=None, name='ucx_shn3u', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Listing existing UC catalogs and schemas 11:26 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: 11:26 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-9g3irrqn@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-9g3irrqn@example.com')], entitlements=[], external_id=None, groups=[], id='7418330525155991', name=Name(family_name=None, given_name='sdk-9g3irrqn@example.com'), roles=[], schemas=[, ], user_name='sdk-9g3irrqn@example.com') 11:26 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0703-112623-69cmumfc [group_name admins CAN_MANAGE] -> [user_name sdk-9g3irrqn@example.com CAN_ATTACH_TO] 11:26 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Listing existing UC catalogs and schemas 11:26 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Preparing a list of UC catalogs and schema to be created 11:26 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_shn3u.tables] fetching tables inventory 11:27 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_shn3u.tables] crawling new batch for tables 11:27 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szh1z] listing tables 11:27 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szh1z.ucx_toi2i] fetching table metadata 11:28 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_shn3u.tables] found 1 new records for tables 11:32 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-j8rkrfjf@example.com` 11:32 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d` 11:33 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `5a11359f-ba1f-483f-8e00-0fe55ec003ed` 11:33 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-zlguejdf@example.com` 11:34 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-eaherlxd@example.com` 11:34 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `ucx_GCJEx` 11:34 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-j8jasxyb@example.com` 11:35 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-6jnfibxx@example.com` 11:35 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-gcgd4l7m@example.com` 11:35 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-xh1hj2kq@example.com` 11:36 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `ucx_GjyMr` 11:36 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-974tzeho@example.com` 11:36 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-nwemcpd2@example.com` 11:37 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `ucx_GcIOr` 11:37 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-tkaex8ww@example.com` 11:38 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-irv696wx@example.com` 11:38 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-wffkk63f@example.com` 11:38 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-o2h7fcta@example.com` 11:39 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `ucx_GLsT0` 11:39 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-5haxv6rw@example.com` 11:39 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `ucx_G7DgP` 11:40 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-s3lwvie4@example.com` 11:40 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `serge.smertin@databricks.com` 11:41 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-vfwdwjt5@example.com` 11:41 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `ucx_GR8ns` 11:41 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `ucx_GhRwx` 11:41 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `ucx_GGVRT` 11:42 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-yco6fdtj@example.com` 11:42 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-euc3nmr9@example.com` 11:42 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-zjnttwkm@example.com` 11:43 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `ucx_GzUzp` 11:43 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `ucx_GngvU` 11:44 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-bt6axp04@example.com` 11:44 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-uuabfxtt@example.com` 11:44 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `ucx_G121N` 11:45 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `ucx_GrvOM` 11:45 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `ucx_GWmAu` 11:45 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-wnz3c6fb@example.com` 11:46 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-gxvlqwa4@example.com` 11:46 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `ucx_G33Pi` 11:46 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-xegrhhsh@example.com` 11:47 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-f3plwvzn@example.com` 11:47 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `ucx_GJ1s7` 11:48 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-y3roxcub@example.com` 11:48 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-yyea42ko@example.com` 11:48 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-shsemfoe@example.com` 11:48 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-euc3nmr9@example.com` 11:49 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-vfwdwjt5@example.com` 11:49 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `ucx_GR8ns` 11:49 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-gcgd4l7m@example.com` 11:49 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `ucx_GGVRT` 11:50 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `ucx_GjyMr` 11:50 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-uuabfxtt@example.com` 11:50 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-f3plwvzn@example.com` 11:50 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `ucx_GngvU` 11:51 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `ucx_GJ1s7` 11:51 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-nwemcpd2@example.com` 11:51 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-xh1hj2kq@example.com` 11:51 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-5haxv6rw@example.com` 11:52 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-wnz3c6fb@example.com` 11:52 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-j8jasxyb@example.com` 11:52 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `ucx_G33Pi` 11:52 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-irv696wx@example.com` 11:53 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `ucx_GrvOM` 11:53 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-y3roxcub@example.com` 11:54 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-shsemfoe@example.com` 11:54 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `ucx_G7DgP` 11:54 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-bt6axp04@example.com` 11:54 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-xegrhhsh@example.com` 11:55 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `ucx_GhRwx` 11:55 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `5a11359f-ba1f-483f-8e00-0fe55ec003ed` 11:55 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-o2h7fcta@example.com` 11:55 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-zjnttwkm@example.com` 11:55 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-eaherlxd@example.com` 11:56 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d` 11:56 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-yco6fdtj@example.com` 11:56 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-gxvlqwa4@example.com` 11:56 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-yyea42ko@example.com` 11:56 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `ucx_GzUzp` 11:57 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `ucx_G121N` 11:57 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-s3lwvie4@example.com` 11:57 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `ucx_GCJEx` 11:58 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `ucx_GWmAu` 11:58 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-tkaex8ww@example.com` 11:58 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-974tzeho@example.com` 11:58 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-zlguejdf@example.com` 11:58 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-6jnfibxx@example.com` 11:59 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `ucx_GcIOr` 11:59 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-wffkk63f@example.com` 11:59 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `serge.smertin@databricks.com` 11:59 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-j8rkrfjf@example.com` 11:59 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `ucx_GLsT0` 11:23 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/85qF 11:23 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_szh1z: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_szh1z 11:23 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_szh1z', metastore_id=None, name='ucx_szh1z', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:24 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_szh1z.ucx_toi2i: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_szh1z/ucx_toi2i 11:24 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_szh1z.ucx_toi2i', metastore_id=None, name='ucx_toi2i', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070312'}, row_filter=None, schema_name='ucx_szh1z', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/85qF', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:24 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720005888093, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cio5m', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cio5m', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720005888093, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 11:25 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cio5m.ucx_szh1z: https://DATABRICKS_HOST/explore/data/ucx_cio5m/ucx_szh1z 11:25 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cio5m', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cio5m.ucx_szh1z', metastore_id=None, name='ucx_szh1z', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:25 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: 11:25 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-5haxv6rw@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-5haxv6rw@example.com')], entitlements=[], external_id=None, groups=[], id='4750043658407121', name=Name(family_name=None, given_name='sdk-5haxv6rw@example.com'), roles=[], schemas=[, ], user_name='sdk-5haxv6rw@example.com') 11:25 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0703-112516-d4bl0duz [group_name admins CAN_MANAGE] -> [user_name sdk-5haxv6rw@example.com CAN_ATTACH_TO] 11:26 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_shn3u: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_shn3u 11:26 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_shn3u', metastore_id=None, name='ucx_shn3u', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 11:26 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Listing existing UC catalogs and schemas 11:26 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: 11:26 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-9g3irrqn@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-9g3irrqn@example.com')], entitlements=[], external_id=None, groups=[], id='7418330525155991', name=Name(family_name=None, given_name='sdk-9g3irrqn@example.com'), roles=[], schemas=[, ], user_name='sdk-9g3irrqn@example.com') 11:26 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0703-112623-69cmumfc [group_name admins CAN_MANAGE] -> [user_name sdk-9g3irrqn@example.com CAN_ATTACH_TO] 11:26 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Listing existing UC catalogs and schemas 11:26 INFO [databricks.labs.ucx.hive_metastore.catalog_schema] Preparing a list of UC catalogs and schema to be created 11:26 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_shn3u.tables] fetching tables inventory 11:27 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_shn3u.tables] crawling new batch for tables 11:27 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szh1z] listing tables 11:27 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_szh1z.ucx_toi2i] fetching table metadata 11:28 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_shn3u.tables] found 1 new records for tables 11:32 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-j8rkrfjf@example.com` 11:32 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d` 11:33 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `5a11359f-ba1f-483f-8e00-0fe55ec003ed` 11:33 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-zlguejdf@example.com` 11:34 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-eaherlxd@example.com` 11:34 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `ucx_GCJEx` 11:34 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-j8jasxyb@example.com` 11:35 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-6jnfibxx@example.com` 11:35 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-gcgd4l7m@example.com` 11:35 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-xh1hj2kq@example.com` 11:36 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `ucx_GjyMr` 11:36 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-974tzeho@example.com` 11:36 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-nwemcpd2@example.com` 11:37 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `ucx_GcIOr` 11:37 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-tkaex8ww@example.com` 11:38 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-irv696wx@example.com` 11:38 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-wffkk63f@example.com` 11:38 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-o2h7fcta@example.com` 11:39 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `ucx_GLsT0` 11:39 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-5haxv6rw@example.com` 11:39 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `ucx_G7DgP` 11:40 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-s3lwvie4@example.com` 11:40 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `serge.smertin@databricks.com` 11:41 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-vfwdwjt5@example.com` 11:41 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `ucx_GR8ns` 11:41 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `ucx_GhRwx` 11:41 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `ucx_GGVRT` 11:42 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-yco6fdtj@example.com` 11:42 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-euc3nmr9@example.com` 11:42 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-zjnttwkm@example.com` 11:43 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `ucx_GzUzp` 11:43 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `ucx_GngvU` 11:44 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-bt6axp04@example.com` 11:44 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-uuabfxtt@example.com` 11:44 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `ucx_G121N` 11:45 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `ucx_GrvOM` 11:45 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `ucx_GWmAu` 11:45 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-wnz3c6fb@example.com` 11:46 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-gxvlqwa4@example.com` 11:46 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `ucx_G33Pi` 11:46 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-xegrhhsh@example.com` 11:47 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-f3plwvzn@example.com` 11:47 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `ucx_GJ1s7` 11:48 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-y3roxcub@example.com` 11:48 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-yyea42ko@example.com` 11:48 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('DATABASE', 'ucx_cio5m.ucx_szh1z') using SQL query: GRANT USE SCHEMA ON DATABASE ucx_cio5m.ucx_szh1z TO `sdk-shsemfoe@example.com` 11:48 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-euc3nmr9@example.com` 11:49 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-vfwdwjt5@example.com` 11:49 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `ucx_GR8ns` 11:49 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-gcgd4l7m@example.com` 11:49 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `ucx_GGVRT` 11:50 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `ucx_GjyMr` 11:50 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-uuabfxtt@example.com` 11:50 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-f3plwvzn@example.com` 11:50 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `ucx_GngvU` 11:51 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `ucx_GJ1s7` 11:51 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-nwemcpd2@example.com` 11:51 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-xh1hj2kq@example.com` 11:51 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-5haxv6rw@example.com` 11:52 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-wnz3c6fb@example.com` 11:52 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-j8jasxyb@example.com` 11:52 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `ucx_G33Pi` 11:52 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-irv696wx@example.com` 11:53 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `ucx_GrvOM` 11:53 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-y3roxcub@example.com` 11:54 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-shsemfoe@example.com` 11:54 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `ucx_G7DgP` 11:54 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-bt6axp04@example.com` 11:54 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-xegrhhsh@example.com` 11:55 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `ucx_GhRwx` 11:55 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `5a11359f-ba1f-483f-8e00-0fe55ec003ed` 11:55 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-o2h7fcta@example.com` 11:55 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-zjnttwkm@example.com` 11:55 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-eaherlxd@example.com` 11:56 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `0a330eb5-dd51-4d97-b6e4-c474356b1d5d` 11:56 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-yco6fdtj@example.com` 11:56 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-gxvlqwa4@example.com` 11:56 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-yyea42ko@example.com` 11:56 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `ucx_GzUzp` 11:57 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `ucx_G121N` 11:57 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-s3lwvie4@example.com` 11:57 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `ucx_GCJEx` 11:58 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `ucx_GWmAu` 11:58 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-tkaex8ww@example.com` 11:58 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-974tzeho@example.com` 11:58 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-zlguejdf@example.com` 11:58 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-6jnfibxx@example.com` 11:59 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `ucx_GcIOr` 11:59 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-wffkk63f@example.com` 11:59 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `serge.smertin@databricks.com` 11:59 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `sdk-j8rkrfjf@example.com` 11:59 DEBUG [databricks.labs.ucx.hive_metastore.catalog_schema] Migrating acls on ('CATALOG', 'ucx_cio5m') using SQL query: GRANT USE CATALOG ON CATALOG ucx_cio5m TO `ucx_GLsT0` 12:00 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 cluster permissions fixtures 12:00 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster permissions fixture: 0703-112516-d4bl0duz [group_name admins CAN_MANAGE] -> [user_name sdk-5haxv6rw@example.com CAN_ATTACH_TO] 12:00 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster permissions fixture: 0703-112623-69cmumfc [group_name admins CAN_MANAGE] -> [user_name sdk-9g3irrqn@example.com CAN_ATTACH_TO] 12:00 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 catalog fixtures 12:00 DEBUG [databricks.labs.ucx.mixins.fixtures] removing catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720005888093, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cio5m', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cio5m', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720005888093, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 12:00 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_dbfs_data_copy fixtures 12:00 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/85qF 12:00 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 cluster fixtures 12:00 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster fixture: 12:00 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster fixture: 12:00 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures 12:00 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 12:00 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 table fixtures 12:00 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_szh1z.ucx_toi2i', metastore_id=None, name='ucx_toi2i', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070312'}, row_filter=None, schema_name='ucx_szh1z', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/85qF', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 12:00 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 schema fixtures 12:00 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_szh1z', metastore_id=None, name='ucx_szh1z', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 12:01 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cio5m', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cio5m.ucx_szh1z', metastore_id=None, name='ucx_szh1z', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 12:01 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_shn3u', metastore_id=None, name='ucx_shn3u', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 12:01 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 workspace user fixtures 12:01 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='sdk-5haxv6rw@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-5haxv6rw@example.com')], entitlements=[], external_id=None, groups=[], id='4750043658407121', name=Name(family_name=None, given_name='sdk-5haxv6rw@example.com'), roles=[], schemas=[, ], user_name='sdk-5haxv6rw@example.com') 12:01 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='sdk-9g3irrqn@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-9g3irrqn@example.com')], entitlements=[], external_id=None, groups=[], id='7418330525155991', name=Name(family_name=None, given_name='sdk-9g3irrqn@example.com'), roles=[], schemas=[, ], user_name='sdk-9g3irrqn@example.com') [gw7] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```
❌ test_table_migration_job_refreshes_migration_status[regular-migrate-tables]: TimeoutError: Timed out after 0:05:00 (14m31.703s) ``` TimeoutError: Timed out after 0:05:00 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/OHCD 11:49 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.migrate_tws1e: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_tws1e 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_tws1e', metastore_id=None, name='migrate_tws1e', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:50 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_tws1e.ucx_tzbkf: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_tws1e/ucx_tzbkf 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_tws1e.ucx_tzbkf', metastore_id=None, name='ucx_tzbkf', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070313'}, row_filter=None, schema_name='migrate_tws1e', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_tws1e/ucx_tzbkf', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:50 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_tws1e.ucx_t9xjd: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_tws1e/ucx_t9xjd 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_tws1e.ucx_t9xjd', metastore_id=None, name='ucx_t9xjd', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070313'}, row_filter=None, schema_name='migrate_tws1e', sql_path=None, storage_credential_name=None, storage_location='dbfs:/tmp/ucx_test_UbMw', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:50 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_tws1e.ucx_tdmcn: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_tws1e/ucx_tdmcn 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_tws1e.ucx_tdmcn', metastore_id=None, name='ucx_tdmcn', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070313'}, row_filter=None, schema_name='migrate_tws1e', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/OHCD', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:51 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_tws1e.ucx_tuh0s: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_tws1e/ucx_tuh0s 11:51 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_tws1e.ucx_tuh0s', metastore_id=None, name='ucx_tuh0s', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070313'}, row_filter=None, schema_name='migrate_tws1e', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_tws1e.ucx_tzbkf', view_dependencies=None) 11:51 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_tws1e.ucx_tetxn: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_tws1e/ucx_tetxn 11:51 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_tws1e.ucx_tetxn', metastore_id=None, name='ucx_tetxn', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070313'}, row_filter=None, schema_name='migrate_tws1e', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_tws1e.ucx_tuh0s', view_dependencies=None) 11:52 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720007525693, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c93eh', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_c93eh', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720007525693, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 11:52 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_c93eh.migrate_tws1e: https://DATABRICKS_HOST/explore/data/ucx_c93eh/migrate_tws1e 11:52 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_c93eh', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c93eh.migrate_tws1e', metastore_id=None, name='migrate_tws1e', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:52 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_smbrz: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_smbrz 11:52 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_smbrz', metastore_id=None, name='ucx_smbrz', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw6] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/OHCD 11:49 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.migrate_tws1e: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_tws1e 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_tws1e', metastore_id=None, name='migrate_tws1e', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:50 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_tws1e.ucx_tzbkf: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_tws1e/ucx_tzbkf 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_tws1e.ucx_tzbkf', metastore_id=None, name='ucx_tzbkf', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070313'}, row_filter=None, schema_name='migrate_tws1e', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_tws1e/ucx_tzbkf', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:50 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_tws1e.ucx_t9xjd: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_tws1e/ucx_t9xjd 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_tws1e.ucx_t9xjd', metastore_id=None, name='ucx_t9xjd', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070313'}, row_filter=None, schema_name='migrate_tws1e', sql_path=None, storage_credential_name=None, storage_location='dbfs:/tmp/ucx_test_UbMw', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:50 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_tws1e.ucx_tdmcn: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_tws1e/ucx_tdmcn 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_tws1e.ucx_tdmcn', metastore_id=None, name='ucx_tdmcn', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070313'}, row_filter=None, schema_name='migrate_tws1e', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/OHCD', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:51 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_tws1e.ucx_tuh0s: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_tws1e/ucx_tuh0s 11:51 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_tws1e.ucx_tuh0s', metastore_id=None, name='ucx_tuh0s', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070313'}, row_filter=None, schema_name='migrate_tws1e', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_tws1e.ucx_tzbkf', view_dependencies=None) 11:51 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_tws1e.ucx_tetxn: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_tws1e/ucx_tetxn 11:51 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_tws1e.ucx_tetxn', metastore_id=None, name='ucx_tetxn', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070313'}, row_filter=None, schema_name='migrate_tws1e', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_tws1e.ucx_tuh0s', view_dependencies=None) 11:52 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720007525693, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c93eh', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_c93eh', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720007525693, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 11:52 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_c93eh.migrate_tws1e: https://DATABRICKS_HOST/explore/data/ucx_c93eh/migrate_tws1e 11:52 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_c93eh', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c93eh.migrate_tws1e', metastore_id=None, name='migrate_tws1e', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:52 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_smbrz: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_smbrz 11:52 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_smbrz', metastore_id=None, name='ucx_smbrz', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:55 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Yoqr/config.yml) doesn't exist. 11:55 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 11:55 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 11:55 INFO [databricks.labs.ucx.install] Fetching installations... 11:55 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Yoqr is corrupted. Skipping... 11:55 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 11:55 DEBUG [tests.integration.conftest] Waiting for clusters to start... 11:55 DEBUG [tests.integration.conftest] Waiting for clusters to start... 11:55 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+7020240703115522 11:55 INFO [databricks.labs.ucx.install] Creating ucx schemas... 11:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 11:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 11:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 11:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 11:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 11:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 11:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 11:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 11:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 11:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 11:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 11:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 11:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 11:57 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Yoqr/README for the next steps. 11:57 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-tables job: https://DATABRICKS_HOST#job/652120813946305 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/OHCD 11:49 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.migrate_tws1e: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_tws1e 11:49 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_tws1e', metastore_id=None, name='migrate_tws1e', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:50 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_tws1e.ucx_tzbkf: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_tws1e/ucx_tzbkf 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_tws1e.ucx_tzbkf', metastore_id=None, name='ucx_tzbkf', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070313'}, row_filter=None, schema_name='migrate_tws1e', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_tws1e/ucx_tzbkf', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:50 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_tws1e.ucx_t9xjd: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_tws1e/ucx_t9xjd 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_tws1e.ucx_t9xjd', metastore_id=None, name='ucx_t9xjd', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070313'}, row_filter=None, schema_name='migrate_tws1e', sql_path=None, storage_credential_name=None, storage_location='dbfs:/tmp/ucx_test_UbMw', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:50 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_tws1e.ucx_tdmcn: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_tws1e/ucx_tdmcn 11:50 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_tws1e.ucx_tdmcn', metastore_id=None, name='ucx_tdmcn', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070313'}, row_filter=None, schema_name='migrate_tws1e', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/OHCD', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:51 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_tws1e.ucx_tuh0s: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_tws1e/ucx_tuh0s 11:51 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_tws1e.ucx_tuh0s', metastore_id=None, name='ucx_tuh0s', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070313'}, row_filter=None, schema_name='migrate_tws1e', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_tws1e.ucx_tzbkf', view_dependencies=None) 11:51 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_tws1e.ucx_tetxn: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_tws1e/ucx_tetxn 11:51 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_tws1e.ucx_tetxn', metastore_id=None, name='ucx_tetxn', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070313'}, row_filter=None, schema_name='migrate_tws1e', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_tws1e.ucx_tuh0s', view_dependencies=None) 11:52 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720007525693, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c93eh', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_c93eh', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720007525693, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 11:52 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_c93eh.migrate_tws1e: https://DATABRICKS_HOST/explore/data/ucx_c93eh/migrate_tws1e 11:52 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_c93eh', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c93eh.migrate_tws1e', metastore_id=None, name='migrate_tws1e', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:52 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_smbrz: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_smbrz 11:52 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_smbrz', metastore_id=None, name='ucx_smbrz', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:55 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Yoqr/config.yml) doesn't exist. 11:55 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 11:55 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 11:55 INFO [databricks.labs.ucx.install] Fetching installations... 11:55 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Yoqr is corrupted. Skipping... 11:55 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 11:55 DEBUG [tests.integration.conftest] Waiting for clusters to start... 11:55 DEBUG [tests.integration.conftest] Waiting for clusters to start... 11:55 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+7020240703115522 11:55 INFO [databricks.labs.ucx.install] Creating ucx schemas... 11:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 11:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 11:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 11:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 11:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 11:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 11:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 11:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 11:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 11:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 11:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 11:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 11:57 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 11:57 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Yoqr/README for the next steps. 11:57 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-tables job: https://DATABRICKS_HOST#job/652120813946305 12:02 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 make_storage_dir fixtures 12:02 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_dbfs_data_copy fixtures 12:02 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/OHCD 12:02 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 cluster fixtures 12:02 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 catalog fixtures 12:02 DEBUG [databricks.labs.ucx.mixins.fixtures] removing catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720007525693, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c93eh', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_c93eh', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720007525693, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 12:02 INFO [databricks.labs.ucx.install] Deleting UCX v0.27.2+7020240703115522 from https://DATABRICKS_HOST 12:02 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_smbrz 12:02 INFO [databricks.labs.ucx.install] Deleting jobs 12:02 INFO [databricks.labs.ucx.install] Deleting migrate-external-tables-ctas job_id=727168855327065. 12:02 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=74439954023070. 12:02 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=910446808126324. 12:02 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=901010968846096. 12:02 INFO [databricks.labs.ucx.install] Deleting failing job_id=928713057216162. 12:02 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=652120813946305. 12:02 INFO [databricks.labs.ucx.install] Deleting assessment job_id=929073100512294. 12:02 INFO [databricks.labs.ucx.install] Deleting scan-tables-in-mounts-experimental job_id=518614704283626. 12:02 INFO [databricks.labs.ucx.install] Deleting migrate-external-hiveserde-tables-in-place-experimental job_id=356697298058169. 12:02 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=33132885495156. 12:02 INFO [databricks.labs.ucx.install] Deleting experimental-workflow-linter job_id=7231690894545. 12:02 INFO [databricks.labs.ucx.install] Deleting migrate-data-reconciliation job_id=79461088625298. 12:02 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=949306780472274. 12:02 INFO [databricks.labs.ucx.install] Deleting cluster policy 12:02 INFO [databricks.labs.ucx.install] Deleting secret scope 12:02 INFO [databricks.labs.ucx.install] UnInstalling UCX complete 12:02 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace user fixtures 12:02 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 account group fixtures 12:02 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures 12:02 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 12:02 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 5 table fixtures 12:02 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_tws1e.ucx_tzbkf', metastore_id=None, name='ucx_tzbkf', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070313'}, row_filter=None, schema_name='migrate_tws1e', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_tws1e/ucx_tzbkf', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 12:02 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_tws1e.ucx_t9xjd', metastore_id=None, name='ucx_t9xjd', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070313'}, row_filter=None, schema_name='migrate_tws1e', sql_path=None, storage_credential_name=None, storage_location='dbfs:/tmp/ucx_test_UbMw', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 12:02 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_tws1e.ucx_tdmcn', metastore_id=None, name='ucx_tdmcn', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070313'}, row_filter=None, schema_name='migrate_tws1e', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/OHCD', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 12:02 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_tws1e.ucx_tuh0s', metastore_id=None, name='ucx_tuh0s', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070313'}, row_filter=None, schema_name='migrate_tws1e', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_tws1e.ucx_tzbkf', view_dependencies=None) 12:03 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while table TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_tws1e.ucx_tuh0s', metastore_id=None, name='ucx_tuh0s', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070313'}, row_filter=None, schema_name='migrate_tws1e', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_tws1e.ucx_tzbkf', view_dependencies=None) teardown: [WRONG_COMMAND_FOR_OBJECT_TYPE] The operation DROP TABLE requires a EXTERNAL or MANAGED. But hive_metastore.migrate_tws1e.ucx_tuh0s is a VIEW. Use DROP VIEW instead. SQLSTATE: 42809 12:03 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_tws1e.ucx_tetxn', metastore_id=None, name='ucx_tetxn', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070313'}, row_filter=None, schema_name='migrate_tws1e', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_tws1e.ucx_tuh0s', view_dependencies=None) 12:03 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while table TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_tws1e.ucx_tetxn', metastore_id=None, name='ucx_tetxn', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070313'}, row_filter=None, schema_name='migrate_tws1e', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_tws1e.ucx_tuh0s', view_dependencies=None) teardown: [WRONG_COMMAND_FOR_OBJECT_TYPE] The operation DROP TABLE requires a EXTERNAL or MANAGED. But hive_metastore.migrate_tws1e.ucx_tetxn is a VIEW. Use DROP VIEW instead. SQLSTATE: 42809 12:03 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 schema fixtures 12:03 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_tws1e', metastore_id=None, name='migrate_tws1e', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 12:03 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_c93eh', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c93eh.migrate_tws1e', metastore_id=None, name='migrate_tws1e', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 12:03 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_smbrz', metastore_id=None, name='ucx_smbrz', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw6] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```

Running from acceptance #4283