search

databrickslabs / ucx

Your best companion for upgrading to Unity Catalog. UCX will guide you, the Databricks customer, through the process of upgrading your account, groups, workspaces, jobs etc. to Unity Catalog.
Other
193 stars 69 forks source link

use dedicated advice code for unsupported sql #2018

Closed ericvergnaud closed 2 days ago

ericvergnaud commented 2 days ago

Changes

use dedicated advice code for unsupported sql

Linked issues

None

Functionality

None

Tests

Not tested

github-actions[bot] commented 2 days ago

❌ 129/135 passed, 6 failed, 23 skipped, 5h1m31s total

❌ test_table_migration_job_refreshes_migration_status[hiveserde-migrate-external-tables-ctas]: TimeoutError: Timed out after 0:05:00 (7m51.359s) ``` TimeoutError: Timed out after 0:05:00 17:34 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/GHG0 17:34 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.hiveserde_in_place_fmnjj: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_fmnjj 17:34 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.hiveserde_in_place_fmnjj', metastore_id=None, name='hiveserde_in_place_fmnjj', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 17:34 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_storage_dir fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_fmnjj 17:34 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_fmnjj.parquet_serde_fmnjj: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_fmnjj/parquet_serde_fmnjj 17:34 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_fmnjj.parquet_serde_fmnjj', metastore_id=None, name='parquet_serde_fmnjj', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070218'}, row_filter=None, schema_name='hiveserde_in_place_fmnjj', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_fmnjj/parquet_serde_fmnjj', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 17:34 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_fmnjj.orc_serde_fmnjj: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_fmnjj/orc_serde_fmnjj 17:34 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_fmnjj.orc_serde_fmnjj', metastore_id=None, name='orc_serde_fmnjj', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070218'}, row_filter=None, schema_name='hiveserde_in_place_fmnjj', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_fmnjj/orc_serde_fmnjj', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 17:34 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_fmnjj.avro_serde_fmnjj: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_fmnjj/avro_serde_fmnjj 17:34 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_fmnjj.avro_serde_fmnjj', metastore_id=None, name='avro_serde_fmnjj', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070218'}, row_filter=None, schema_name='hiveserde_in_place_fmnjj', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_fmnjj/avro_serde_fmnjj', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 17:34 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1719941672334, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ci3vd', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_ci3vd', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719941672334, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 17:34 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_ci3vd.hiveserde_in_place_fmnjj: https://DATABRICKS_HOST/explore/data/ucx_ci3vd/hiveserde_in_place_fmnjj 17:34 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_ci3vd', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ci3vd.hiveserde_in_place_fmnjj', metastore_id=None, name='hiveserde_in_place_fmnjj', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 17:34 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_skolb: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_skolb 17:34 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_skolb', metastore_id=None, name='ucx_skolb', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw1] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 17:34 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/GHG0 17:34 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.hiveserde_in_place_fmnjj: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_fmnjj 17:34 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.hiveserde_in_place_fmnjj', metastore_id=None, name='hiveserde_in_place_fmnjj', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 17:34 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_storage_dir fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_fmnjj 17:34 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_fmnjj.parquet_serde_fmnjj: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_fmnjj/parquet_serde_fmnjj 17:34 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_fmnjj.parquet_serde_fmnjj', metastore_id=None, name='parquet_serde_fmnjj', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070218'}, row_filter=None, schema_name='hiveserde_in_place_fmnjj', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_fmnjj/parquet_serde_fmnjj', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 17:34 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_fmnjj.orc_serde_fmnjj: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_fmnjj/orc_serde_fmnjj 17:34 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_fmnjj.orc_serde_fmnjj', metastore_id=None, name='orc_serde_fmnjj', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070218'}, row_filter=None, schema_name='hiveserde_in_place_fmnjj', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_fmnjj/orc_serde_fmnjj', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 17:34 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_fmnjj.avro_serde_fmnjj: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_fmnjj/avro_serde_fmnjj 17:34 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_fmnjj.avro_serde_fmnjj', metastore_id=None, name='avro_serde_fmnjj', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070218'}, row_filter=None, schema_name='hiveserde_in_place_fmnjj', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_fmnjj/avro_serde_fmnjj', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 17:34 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1719941672334, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ci3vd', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_ci3vd', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719941672334, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 17:34 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_ci3vd.hiveserde_in_place_fmnjj: https://DATABRICKS_HOST/explore/data/ucx_ci3vd/hiveserde_in_place_fmnjj 17:34 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_ci3vd', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ci3vd.hiveserde_in_place_fmnjj', metastore_id=None, name='hiveserde_in_place_fmnjj', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 17:34 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_skolb: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_skolb 17:34 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_skolb', metastore_id=None, name='ucx_skolb', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 17:35 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.KHkc/config.yml) doesn't exist. 17:35 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 17:35 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 17:35 INFO [databricks.labs.ucx.install] Fetching installations... 17:35 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.KHkc is corrupted. Skipping... 17:35 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 17:35 DEBUG [tests.integration.conftest] Waiting for clusters to start... 17:35 DEBUG [tests.integration.conftest] Waiting for clusters to start... 17:35 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+6020240702173528 17:35 INFO [databricks.labs.ucx.install] Creating ucx schemas... 17:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 17:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 17:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 17:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 17:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 17:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 17:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 17:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 17:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 17:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 17:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 17:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 17:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 17:36 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.KHkc/README for the next steps. 17:36 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-external-tables-ctas job: https://DATABRICKS_HOST#job/520338570491763 17:34 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/GHG0 17:34 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.hiveserde_in_place_fmnjj: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_fmnjj 17:34 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.hiveserde_in_place_fmnjj', metastore_id=None, name='hiveserde_in_place_fmnjj', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 17:34 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_storage_dir fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_fmnjj 17:34 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_fmnjj.parquet_serde_fmnjj: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_fmnjj/parquet_serde_fmnjj 17:34 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_fmnjj.parquet_serde_fmnjj', metastore_id=None, name='parquet_serde_fmnjj', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070218'}, row_filter=None, schema_name='hiveserde_in_place_fmnjj', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_fmnjj/parquet_serde_fmnjj', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 17:34 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_fmnjj.orc_serde_fmnjj: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_fmnjj/orc_serde_fmnjj 17:34 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_fmnjj.orc_serde_fmnjj', metastore_id=None, name='orc_serde_fmnjj', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070218'}, row_filter=None, schema_name='hiveserde_in_place_fmnjj', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_fmnjj/orc_serde_fmnjj', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 17:34 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_fmnjj.avro_serde_fmnjj: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_fmnjj/avro_serde_fmnjj 17:34 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_fmnjj.avro_serde_fmnjj', metastore_id=None, name='avro_serde_fmnjj', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070218'}, row_filter=None, schema_name='hiveserde_in_place_fmnjj', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_fmnjj/avro_serde_fmnjj', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 17:34 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1719941672334, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ci3vd', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_ci3vd', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719941672334, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 17:34 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_ci3vd.hiveserde_in_place_fmnjj: https://DATABRICKS_HOST/explore/data/ucx_ci3vd/hiveserde_in_place_fmnjj 17:34 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_ci3vd', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ci3vd.hiveserde_in_place_fmnjj', metastore_id=None, name='hiveserde_in_place_fmnjj', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 17:34 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_skolb: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_skolb 17:34 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_skolb', metastore_id=None, name='ucx_skolb', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 17:35 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.KHkc/config.yml) doesn't exist. 17:35 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 17:35 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 17:35 INFO [databricks.labs.ucx.install] Fetching installations... 17:35 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.KHkc is corrupted. Skipping... 17:35 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 17:35 DEBUG [tests.integration.conftest] Waiting for clusters to start... 17:35 DEBUG [tests.integration.conftest] Waiting for clusters to start... 17:35 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+6020240702173528 17:35 INFO [databricks.labs.ucx.install] Creating ucx schemas... 17:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 17:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 17:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 17:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 17:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 17:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 17:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 17:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 17:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 17:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 17:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 17:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 17:36 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 17:36 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.KHkc/README for the next steps. 17:36 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-external-tables-ctas job: https://DATABRICKS_HOST#job/520338570491763 17:41 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_storage_dir fixtures 17:41 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_storage_dir fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_fmnjj 17:41 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_dbfs_data_copy fixtures 17:41 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/GHG0 17:41 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 cluster fixtures 17:41 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 catalog fixtures 17:41 DEBUG [databricks.labs.ucx.mixins.fixtures] removing catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1719941672334, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ci3vd', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_ci3vd', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719941672334, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 17:41 INFO [databricks.labs.ucx.install] Deleting UCX v0.27.2+6020240702173528 from https://DATABRICKS_HOST 17:41 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_skolb 17:41 INFO [databricks.labs.ucx.install] Deleting jobs 17:41 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=907757997348586. 17:41 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=345664152917197. 17:41 INFO [databricks.labs.ucx.install] Deleting experimental-workflow-linter job_id=843761740679697. 17:41 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=965958093710249. 17:41 INFO [databricks.labs.ucx.install] Deleting migrate-external-hiveserde-tables-in-place-experimental job_id=561582150051587. 17:41 INFO [databricks.labs.ucx.install] Deleting migrate-external-tables-ctas job_id=520338570491763. 17:41 INFO [databricks.labs.ucx.install] Deleting assessment job_id=274740076373203. 17:41 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=338316994678606. 17:41 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=289942790465739. 17:41 INFO [databricks.labs.ucx.install] Deleting scan-tables-in-mounts-experimental job_id=686477389248623. 17:41 INFO [databricks.labs.ucx.install] Deleting migrate-data-reconciliation job_id=25710500822486. 17:41 INFO [databricks.labs.ucx.install] Deleting failing job_id=1070096528561652. 17:41 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=132181937070139. 17:41 INFO [databricks.labs.ucx.install] Deleting cluster policy 17:41 INFO [databricks.labs.ucx.install] Deleting secret scope 17:41 INFO [databricks.labs.ucx.install] UnInstalling UCX complete 17:41 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace user fixtures 17:41 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 account group fixtures 17:41 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures 17:41 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 17:41 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 table fixtures 17:41 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_fmnjj.parquet_serde_fmnjj', metastore_id=None, name='parquet_serde_fmnjj', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070218'}, row_filter=None, schema_name='hiveserde_in_place_fmnjj', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_fmnjj/parquet_serde_fmnjj', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 17:41 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_fmnjj.orc_serde_fmnjj', metastore_id=None, name='orc_serde_fmnjj', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070218'}, row_filter=None, schema_name='hiveserde_in_place_fmnjj', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_fmnjj/orc_serde_fmnjj', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 17:41 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_fmnjj.avro_serde_fmnjj', metastore_id=None, name='avro_serde_fmnjj', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070218'}, row_filter=None, schema_name='hiveserde_in_place_fmnjj', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_fmnjj/avro_serde_fmnjj', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 17:41 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 schema fixtures 17:41 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.hiveserde_in_place_fmnjj', metastore_id=None, name='hiveserde_in_place_fmnjj', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 17:41 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_ci3vd', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ci3vd.hiveserde_in_place_fmnjj', metastore_id=None, name='hiveserde_in_place_fmnjj', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 17:41 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_skolb', metastore_id=None, name='ucx_skolb', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw1] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```
❌ test_running_real_workflow_linter_job: TimeoutError: Timed out after 0:02:00 (6m24.387s) ``` TimeoutError: Timed out after 0:02:00 [gw2] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 17:40 DEBUG [databricks.labs.ucx.mixins.fixtures] added directory fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-ppQT 17:40 DEBUG [databricks.labs.ucx.mixins.fixtures] added notebook fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-ppQT/notebook.ipynb 17:40 INFO [databricks.labs.ucx.mixins.fixtures] Job: https://DATABRICKS_HOST#job/267732840254198 17:40 DEBUG [databricks.labs.ucx.mixins.fixtures] added job fixture: CreateResponse(job_id=267732840254198) 17:40 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sjimj: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sjimj 17:40 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sjimj', metastore_id=None, name='ucx_sjimj', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 17:40 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Lozk/config.yml) doesn't exist. 17:40 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 17:40 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 17:40 INFO [databricks.labs.ucx.install] Fetching installations... 17:40 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 17:40 DEBUG [tests.integration.conftest] Waiting for clusters to start... 17:40 DEBUG [tests.integration.conftest] Waiting for clusters to start... 17:40 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+6020240702174050 17:40 INFO [databricks.labs.ucx.install] Creating ucx schemas... 17:41 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 17:41 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 17:41 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 17:41 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 17:41 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 17:41 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 17:41 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 17:41 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 17:41 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 17:41 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 17:41 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 17:41 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 17:41 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 17:41 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Lozk/README for the next steps. 17:41 DEBUG [databricks.labs.ucx.installer.workflows] starting experimental-workflow-linter job: https://DATABRICKS_HOST#job/321008440219828 17:46 DEBUG [databricks.labs.ucx.installer.workflows] Validating experimental-workflow-linter workflow: https://DATABRICKS_HOST#job/321008440219828 17:40 DEBUG [databricks.labs.ucx.mixins.fixtures] added directory fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-ppQT 17:40 DEBUG [databricks.labs.ucx.mixins.fixtures] added notebook fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-ppQT/notebook.ipynb 17:40 INFO [databricks.labs.ucx.mixins.fixtures] Job: https://DATABRICKS_HOST#job/267732840254198 17:40 DEBUG [databricks.labs.ucx.mixins.fixtures] added job fixture: CreateResponse(job_id=267732840254198) 17:40 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sjimj: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sjimj 17:40 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sjimj', metastore_id=None, name='ucx_sjimj', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 17:40 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Lozk/config.yml) doesn't exist. 17:40 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 17:40 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 17:40 INFO [databricks.labs.ucx.install] Fetching installations... 17:40 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 17:40 DEBUG [tests.integration.conftest] Waiting for clusters to start... 17:40 DEBUG [tests.integration.conftest] Waiting for clusters to start... 17:40 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+6020240702174050 17:40 INFO [databricks.labs.ucx.install] Creating ucx schemas... 17:41 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 17:41 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 17:41 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 17:41 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 17:41 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 17:41 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 17:41 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 17:41 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 17:41 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 17:41 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 17:41 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 17:41 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 17:41 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 17:41 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.Lozk/README for the next steps. 17:41 DEBUG [databricks.labs.ucx.installer.workflows] starting experimental-workflow-linter job: https://DATABRICKS_HOST#job/321008440219828 17:46 DEBUG [databricks.labs.ucx.installer.workflows] Validating experimental-workflow-linter workflow: https://DATABRICKS_HOST#job/321008440219828 17:46 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 job fixtures 17:46 DEBUG [databricks.labs.ucx.mixins.fixtures] removing job fixture: CreateResponse(job_id=267732840254198) 17:46 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 directory fixtures 17:46 DEBUG [databricks.labs.ucx.mixins.fixtures] removing directory fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-ppQT 17:46 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 notebook fixtures 17:46 DEBUG [databricks.labs.ucx.mixins.fixtures] removing notebook fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-ppQT/notebook.ipynb 17:46 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while notebook /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-ppQT/notebook.ipynb teardown: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-ppQT/notebook.ipynb) doesn't exist. 17:46 INFO [databricks.labs.ucx.install] Deleting UCX v0.27.2+6020240702174050 from https://DATABRICKS_HOST 17:46 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_sjimj 17:46 INFO [databricks.labs.ucx.install] Deleting jobs 17:46 INFO [databricks.labs.ucx.install] Deleting failing job_id=937200574177270. 17:46 INFO [databricks.labs.ucx.install] Deleting migrate-external-tables-ctas job_id=510093324696354. 17:46 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=632086906845586. 17:46 INFO [databricks.labs.ucx.install] Deleting assessment job_id=969668480204676. 17:46 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=62364362426164. 17:46 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=322773433573067. 17:46 INFO [databricks.labs.ucx.install] Deleting migrate-external-hiveserde-tables-in-place-experimental job_id=1078501522901424. 17:46 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=210380144073806. 17:46 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=809913261613492. 17:46 INFO [databricks.labs.ucx.install] Deleting experimental-workflow-linter job_id=321008440219828. 17:46 INFO [databricks.labs.ucx.install] Deleting scan-tables-in-mounts-experimental job_id=294680504212659. 17:46 INFO [databricks.labs.ucx.install] Deleting migrate-data-reconciliation job_id=88903143815524. 17:46 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=623904735684105. 17:46 INFO [databricks.labs.ucx.install] Deleting cluster policy 17:46 INFO [databricks.labs.ucx.install] Deleting secret scope 17:46 INFO [databricks.labs.ucx.install] UnInstalling UCX complete 17:46 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace user fixtures 17:46 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 account group fixtures 17:46 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures 17:46 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 17:46 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 17:46 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 schema fixtures 17:46 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sjimj', metastore_id=None, name='ucx_sjimj', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw2] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```
❌ test_table_migration_job_refreshes_migration_status[regular-migrate-tables]: TimeoutError: timed out after 0:20:00: (23m21.712s) ``` TimeoutError: timed out after 0:20:00: 17:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/Mf70 17:36 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.migrate_grujj: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_grujj 17:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_grujj', metastore_id=None, name='migrate_grujj', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 17:36 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_grujj.ucx_tnsst: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_grujj/ucx_tnsst 17:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_grujj.ucx_tnsst', metastore_id=None, name='ucx_tnsst', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070218'}, row_filter=None, schema_name='migrate_grujj', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_grujj/ucx_tnsst', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 17:36 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_grujj.ucx_tktz6: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_grujj/ucx_tktz6 17:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_grujj.ucx_tktz6', metastore_id=None, name='ucx_tktz6', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070218'}, row_filter=None, schema_name='migrate_grujj', sql_path=None, storage_credential_name=None, storage_location='dbfs:/tmp/ucx_test_P6Uu', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 17:36 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_grujj.ucx_tqw1c: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_grujj/ucx_tqw1c 17:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_grujj.ucx_tqw1c', metastore_id=None, name='ucx_tqw1c', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070218'}, row_filter=None, schema_name='migrate_grujj', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/Mf70', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 17:36 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_grujj.ucx_t4zex: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_grujj/ucx_t4zex 17:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_grujj.ucx_t4zex', metastore_id=None, name='ucx_t4zex', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070218'}, row_filter=None, schema_name='migrate_grujj', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_grujj.ucx_tnsst', view_dependencies=None) 17:37 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_grujj.ucx_tl7xd: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_grujj/ucx_tl7xd 17:37 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_grujj.ucx_tl7xd', metastore_id=None, name='ucx_tl7xd', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070218'}, row_filter=None, schema_name='migrate_grujj', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_grujj.ucx_t4zex', view_dependencies=None) 17:37 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1719941824837, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ca0ia', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_ca0ia', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719941824837, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 17:37 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_ca0ia.migrate_grujj: https://DATABRICKS_HOST/explore/data/ucx_ca0ia/migrate_grujj 17:37 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_ca0ia', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ca0ia.migrate_grujj', metastore_id=None, name='migrate_grujj', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 17:37 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_swjjy: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_swjjy 17:37 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_swjjy', metastore_id=None, name='ucx_swjjy', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw0] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 17:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/Mf70 17:36 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.migrate_grujj: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_grujj 17:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_grujj', metastore_id=None, name='migrate_grujj', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 17:36 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_grujj.ucx_tnsst: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_grujj/ucx_tnsst 17:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_grujj.ucx_tnsst', metastore_id=None, name='ucx_tnsst', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070218'}, row_filter=None, schema_name='migrate_grujj', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_grujj/ucx_tnsst', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 17:36 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_grujj.ucx_tktz6: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_grujj/ucx_tktz6 17:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_grujj.ucx_tktz6', metastore_id=None, name='ucx_tktz6', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070218'}, row_filter=None, schema_name='migrate_grujj', sql_path=None, storage_credential_name=None, storage_location='dbfs:/tmp/ucx_test_P6Uu', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 17:36 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_grujj.ucx_tqw1c: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_grujj/ucx_tqw1c 17:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_grujj.ucx_tqw1c', metastore_id=None, name='ucx_tqw1c', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070218'}, row_filter=None, schema_name='migrate_grujj', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/Mf70', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 17:36 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_grujj.ucx_t4zex: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_grujj/ucx_t4zex 17:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_grujj.ucx_t4zex', metastore_id=None, name='ucx_t4zex', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070218'}, row_filter=None, schema_name='migrate_grujj', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_grujj.ucx_tnsst', view_dependencies=None) 17:37 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_grujj.ucx_tl7xd: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_grujj/ucx_tl7xd 17:37 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_grujj.ucx_tl7xd', metastore_id=None, name='ucx_tl7xd', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070218'}, row_filter=None, schema_name='migrate_grujj', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_grujj.ucx_t4zex', view_dependencies=None) 17:37 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1719941824837, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ca0ia', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_ca0ia', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719941824837, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 17:37 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_ca0ia.migrate_grujj: https://DATABRICKS_HOST/explore/data/ucx_ca0ia/migrate_grujj 17:37 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_ca0ia', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ca0ia.migrate_grujj', metastore_id=None, name='migrate_grujj', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 17:37 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_swjjy: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_swjjy 17:37 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_swjjy', metastore_id=None, name='ucx_swjjy', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 17:37 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.eLNI/config.yml) doesn't exist. 17:37 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 17:37 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 17:37 INFO [databricks.labs.ucx.install] Fetching installations... 17:37 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.eLNI is corrupted. Skipping... 17:37 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 17:37 DEBUG [tests.integration.conftest] Waiting for clusters to start... 17:37 DEBUG [tests.integration.conftest] Waiting for clusters to start... 17:37 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+6020240702173741 17:37 INFO [databricks.labs.ucx.install] Creating ucx schemas... 17:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 17:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 17:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 17:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 17:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 17:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 17:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 17:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 17:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 17:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 17:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 17:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 17:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 17:38 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.eLNI/README for the next steps. 17:38 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-tables job: https://DATABRICKS_HOST#job/671212016235672 17:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/Mf70 17:36 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.migrate_grujj: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_grujj 17:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_grujj', metastore_id=None, name='migrate_grujj', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 17:36 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_grujj.ucx_tnsst: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_grujj/ucx_tnsst 17:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_grujj.ucx_tnsst', metastore_id=None, name='ucx_tnsst', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070218'}, row_filter=None, schema_name='migrate_grujj', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_grujj/ucx_tnsst', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 17:36 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_grujj.ucx_tktz6: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_grujj/ucx_tktz6 17:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_grujj.ucx_tktz6', metastore_id=None, name='ucx_tktz6', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070218'}, row_filter=None, schema_name='migrate_grujj', sql_path=None, storage_credential_name=None, storage_location='dbfs:/tmp/ucx_test_P6Uu', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 17:36 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_grujj.ucx_tqw1c: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_grujj/ucx_tqw1c 17:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_grujj.ucx_tqw1c', metastore_id=None, name='ucx_tqw1c', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070218'}, row_filter=None, schema_name='migrate_grujj', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/Mf70', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 17:36 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_grujj.ucx_t4zex: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_grujj/ucx_t4zex 17:36 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_grujj.ucx_t4zex', metastore_id=None, name='ucx_t4zex', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070218'}, row_filter=None, schema_name='migrate_grujj', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_grujj.ucx_tnsst', view_dependencies=None) 17:37 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_grujj.ucx_tl7xd: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_grujj/ucx_tl7xd 17:37 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_grujj.ucx_tl7xd', metastore_id=None, name='ucx_tl7xd', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070218'}, row_filter=None, schema_name='migrate_grujj', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_grujj.ucx_t4zex', view_dependencies=None) 17:37 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1719941824837, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ca0ia', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_ca0ia', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719941824837, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 17:37 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_ca0ia.migrate_grujj: https://DATABRICKS_HOST/explore/data/ucx_ca0ia/migrate_grujj 17:37 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_ca0ia', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ca0ia.migrate_grujj', metastore_id=None, name='migrate_grujj', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 17:37 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_swjjy: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_swjjy 17:37 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_swjjy', metastore_id=None, name='ucx_swjjy', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 17:37 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.eLNI/config.yml) doesn't exist. 17:37 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 17:37 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 17:37 INFO [databricks.labs.ucx.install] Fetching installations... 17:37 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.eLNI is corrupted. Skipping... 17:37 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 17:37 DEBUG [tests.integration.conftest] Waiting for clusters to start... 17:37 DEBUG [tests.integration.conftest] Waiting for clusters to start... 17:37 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+6020240702173741 17:37 INFO [databricks.labs.ucx.install] Creating ucx schemas... 17:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 17:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 17:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 17:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 17:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 17:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 17:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 17:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 17:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 17:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 17:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 17:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 17:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 17:38 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.eLNI/README for the next steps. 17:38 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-tables job: https://DATABRICKS_HOST#job/671212016235672 17:58 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 make_storage_dir fixtures 17:58 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_dbfs_data_copy fixtures 17:58 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/Mf70 17:58 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 cluster fixtures 17:58 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 catalog fixtures 17:58 DEBUG [databricks.labs.ucx.mixins.fixtures] removing catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1719941824837, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ca0ia', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_ca0ia', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719941824837, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 17:58 INFO [databricks.labs.ucx.install] Deleting UCX v0.27.2+6020240702173741 from https://DATABRICKS_HOST 17:58 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_swjjy 17:58 INFO [databricks.labs.ucx.install] Deleting jobs 17:58 INFO [databricks.labs.ucx.install] Deleting migrate-data-reconciliation job_id=930229721105903. 17:58 INFO [databricks.labs.ucx.install] Deleting migrate-external-tables-ctas job_id=450881093831712. 17:58 INFO [databricks.labs.ucx.install] Deleting assessment job_id=633911974294704. 17:58 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=12573728211160. 17:58 INFO [databricks.labs.ucx.install] Deleting migrate-external-hiveserde-tables-in-place-experimental job_id=103062578754924. 17:58 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=450892079706866. 17:58 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=914272846424913. 17:58 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=860232410397967. 17:58 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=671212016235672. 17:58 INFO [databricks.labs.ucx.install] Deleting scan-tables-in-mounts-experimental job_id=978352666778690. 17:58 INFO [databricks.labs.ucx.install] Deleting failing job_id=543655280872000. 17:58 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=1077385270161980. 17:58 INFO [databricks.labs.ucx.install] Deleting experimental-workflow-linter job_id=360280648393219. 17:58 INFO [databricks.labs.ucx.install] Deleting cluster policy 17:58 INFO [databricks.labs.ucx.install] Deleting secret scope 17:58 INFO [databricks.labs.ucx.install] UnInstalling UCX complete 17:58 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace user fixtures 17:58 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 account group fixtures 17:58 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures 17:58 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 17:58 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 5 table fixtures 17:58 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_grujj.ucx_tnsst', metastore_id=None, name='ucx_tnsst', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070218'}, row_filter=None, schema_name='migrate_grujj', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_grujj/ucx_tnsst', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 17:58 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_grujj.ucx_tktz6', metastore_id=None, name='ucx_tktz6', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070218'}, row_filter=None, schema_name='migrate_grujj', sql_path=None, storage_credential_name=None, storage_location='dbfs:/tmp/ucx_test_P6Uu', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 17:59 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_grujj.ucx_tqw1c', metastore_id=None, name='ucx_tqw1c', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070218'}, row_filter=None, schema_name='migrate_grujj', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/Mf70', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 17:59 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_grujj.ucx_t4zex', metastore_id=None, name='ucx_t4zex', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070218'}, row_filter=None, schema_name='migrate_grujj', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_grujj.ucx_tnsst', view_dependencies=None) 17:59 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while table TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_grujj.ucx_t4zex', metastore_id=None, name='ucx_t4zex', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070218'}, row_filter=None, schema_name='migrate_grujj', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_grujj.ucx_tnsst', view_dependencies=None) teardown: [WRONG_COMMAND_FOR_OBJECT_TYPE] The operation DROP TABLE requires a EXTERNAL or MANAGED. But hive_metastore.migrate_grujj.ucx_t4zex is a VIEW. Use DROP VIEW instead. SQLSTATE: 42809 17:59 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_grujj.ucx_tl7xd', metastore_id=None, name='ucx_tl7xd', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070218'}, row_filter=None, schema_name='migrate_grujj', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_grujj.ucx_t4zex', view_dependencies=None) 17:59 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while table TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_grujj.ucx_tl7xd', metastore_id=None, name='ucx_tl7xd', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070218'}, row_filter=None, schema_name='migrate_grujj', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_grujj.ucx_t4zex', view_dependencies=None) teardown: [WRONG_COMMAND_FOR_OBJECT_TYPE] The operation DROP TABLE requires a EXTERNAL or MANAGED. But hive_metastore.migrate_grujj.ucx_tl7xd is a VIEW. Use DROP VIEW instead. SQLSTATE: 42809 17:59 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 schema fixtures 17:59 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_grujj', metastore_id=None, name='migrate_grujj', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 17:59 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_ca0ia', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ca0ia.migrate_grujj', metastore_id=None, name='migrate_grujj', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 17:59 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_swjjy', metastore_id=None, name='ucx_swjjy', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw0] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```
❌ test_experimental_permissions_migration_for_group_with_same_name: TimeoutError: Timed out after 0:02:00 (7m10.572s) ``` TimeoutError: Timed out after 0:02:00 [gw6] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 17:53 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-vwdl2onf@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-vwdl2onf@example.com')], entitlements=[], external_id=None, groups=[], id='3056062844054706', name=Name(family_name=None, given_name='sdk-vwdl2onf@example.com'), roles=[], schemas=[, ], user_name='sdk-vwdl2onf@example.com') 17:53 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx_GjaQG: https://DATABRICKS_HOST#setting/accounts/groups/967773320193412 17:53 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx_GjaQG', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='967773320193412', members=[ComplexValue(display='sdk-vwdl2onf@example.com', primary=None, ref='Users/3056062844054706', type=None, value='3056062844054706')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 17:53 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx_GjaQG: https://accounts.CLOUD_ENVdatabricks.net/users/groups/1007286505828849/members 17:53 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx_GjaQG', entitlements=[], external_id=None, groups=[], id='1007286505828849', members=[ComplexValue(display='sdk-vwdl2onf@example.com', primary=None, ref='Users/3056062844054706', type=None, value='3056062844054706')], meta=None, roles=[], schemas=[]) 17:53 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/000A7E9287E28BE4 17:53 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='000A7E9287E28BE4') 17:53 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 000A7E9287E28BE4 [group_name admins CAN_USE] -> [group_name ucx_GjaQG CAN_USE] 17:53 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sowdo: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sowdo 17:53 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sowdo', metastore_id=None, name='ucx_sowdo', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 17:53 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_sowdo.ucx_trvfj: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sowdo/ucx_trvfj 17:53 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sowdo.ucx_trvfj', metastore_id=None, name='ucx_trvfj', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070219'}, row_filter=None, schema_name='ucx_sowdo', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_sowdo/ucx_trvfj', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 17:53 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_srkxm: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_srkxm 17:53 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_srkxm', metastore_id=None, name='ucx_srkxm', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 17:53 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.bV0i/config.yml) doesn't exist. 17:53 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 17:53 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 17:53 INFO [databricks.labs.ucx.install] Fetching installations... 17:54 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 17:54 DEBUG [tests.integration.conftest] Waiting for clusters to start... 17:54 DEBUG [tests.integration.conftest] Waiting for clusters to start... 17:54 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+6020240702175408 17:54 INFO [databricks.labs.ucx.install] Creating ucx schemas... 17:55 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 17:55 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 17:55 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 17:55 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 17:55 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 17:55 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 17:55 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 17:55 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 17:55 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 17:55 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 17:55 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 17:55 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 17:55 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 17:55 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.bV0i/README for the next steps. 17:55 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-groups-experimental job: https://DATABRICKS_HOST#job/245063677399146 17:59 ERROR [databricks.labs.ucx.hive_metastore.grants] Couldn't fetch grants for object DATABASE hive_metastore.ucx_sowdo: The request failed due to an unexpected condition. 17:53 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-vwdl2onf@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-vwdl2onf@example.com')], entitlements=[], external_id=None, groups=[], id='3056062844054706', name=Name(family_name=None, given_name='sdk-vwdl2onf@example.com'), roles=[], schemas=[, ], user_name='sdk-vwdl2onf@example.com') 17:53 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx_GjaQG: https://DATABRICKS_HOST#setting/accounts/groups/967773320193412 17:53 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx_GjaQG', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='967773320193412', members=[ComplexValue(display='sdk-vwdl2onf@example.com', primary=None, ref='Users/3056062844054706', type=None, value='3056062844054706')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 17:53 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx_GjaQG: https://accounts.CLOUD_ENVdatabricks.net/users/groups/1007286505828849/members 17:53 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx_GjaQG', entitlements=[], external_id=None, groups=[], id='1007286505828849', members=[ComplexValue(display='sdk-vwdl2onf@example.com', primary=None, ref='Users/3056062844054706', type=None, value='3056062844054706')], meta=None, roles=[], schemas=[]) 17:53 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/000A7E9287E28BE4 17:53 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='000A7E9287E28BE4') 17:53 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 000A7E9287E28BE4 [group_name admins CAN_USE] -> [group_name ucx_GjaQG CAN_USE] 17:53 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sowdo: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sowdo 17:53 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sowdo', metastore_id=None, name='ucx_sowdo', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 17:53 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_sowdo.ucx_trvfj: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sowdo/ucx_trvfj 17:53 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sowdo.ucx_trvfj', metastore_id=None, name='ucx_trvfj', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070219'}, row_filter=None, schema_name='ucx_sowdo', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_sowdo/ucx_trvfj', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 17:53 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_srkxm: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_srkxm 17:53 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_srkxm', metastore_id=None, name='ucx_srkxm', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 17:53 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.bV0i/config.yml) doesn't exist. 17:53 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 17:53 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 17:53 INFO [databricks.labs.ucx.install] Fetching installations... 17:54 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 17:54 DEBUG [tests.integration.conftest] Waiting for clusters to start... 17:54 DEBUG [tests.integration.conftest] Waiting for clusters to start... 17:54 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+6020240702175408 17:54 INFO [databricks.labs.ucx.install] Creating ucx schemas... 17:55 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 17:55 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 17:55 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 17:55 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 17:55 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 17:55 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 17:55 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 17:55 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 17:55 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 17:55 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 17:55 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 17:55 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 17:55 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 17:55 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.bV0i/README for the next steps. 17:55 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-groups-experimental job: https://DATABRICKS_HOST#job/245063677399146 17:59 ERROR [databricks.labs.ucx.hive_metastore.grants] Couldn't fetch grants for object DATABASE hive_metastore.ucx_sowdo: The request failed due to an unexpected condition. 17:59 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster_policy permissions fixtures 17:59 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster_policy permissions fixture: 000A7E9287E28BE4 [group_name admins CAN_USE] -> [group_name ucx_GjaQG CAN_USE] 17:59 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster policy fixtures 17:59 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster policy fixture: CreatePolicyResponse(policy_id='000A7E9287E28BE4') 17:59 INFO [databricks.labs.ucx.install] Deleting UCX v0.27.2+6020240702175408 from https://DATABRICKS_HOST 17:59 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_srkxm 17:59 INFO [databricks.labs.ucx.install] Deleting jobs 17:59 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=837299452953080. 17:59 INFO [databricks.labs.ucx.install] Deleting migrate-external-hiveserde-tables-in-place-experimental job_id=350424706388026. 17:59 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=124561677369281. 17:59 INFO [databricks.labs.ucx.install] Deleting migrate-external-tables-ctas job_id=359983169666468. 17:59 INFO [databricks.labs.ucx.install] Deleting failing job_id=604003613574450. 17:59 INFO [databricks.labs.ucx.install] Deleting migrate-data-reconciliation job_id=373392036886109. 17:59 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=245063677399146. 17:59 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=395915546738401. 17:59 INFO [databricks.labs.ucx.install] Deleting scan-tables-in-mounts-experimental job_id=71813323140178. 17:59 INFO [databricks.labs.ucx.install] Deleting experimental-workflow-linter job_id=590225983459063. 17:59 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=434978699322927. 17:59 INFO [databricks.labs.ucx.install] Deleting assessment job_id=794429210489599. 17:59 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=1079049488987171. 17:59 INFO [databricks.labs.ucx.install] Deleting cluster policy 17:59 INFO [databricks.labs.ucx.install] Deleting secret scope 17:59 INFO [databricks.labs.ucx.install] UnInstalling UCX complete 17:59 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace user fixtures 17:59 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='sdk-vwdl2onf@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-vwdl2onf@example.com')], entitlements=[], external_id=None, groups=[], id='3056062844054706', name=Name(family_name=None, given_name='sdk-vwdl2onf@example.com'), roles=[], schemas=[, ], user_name='sdk-vwdl2onf@example.com') 17:59 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 account group fixtures 17:59 DEBUG [databricks.labs.ucx.mixins.fixtures] removing account group fixture: Group(display_name='ucx_GjaQG', entitlements=[], external_id=None, groups=[], id='1007286505828849', members=[ComplexValue(display='sdk-vwdl2onf@example.com', primary=None, ref='Users/3056062844054706', type=None, value='3056062844054706')], meta=None, roles=[], schemas=[]) 17:59 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace group fixtures 17:59 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace group fixture: Group(display_name='ucx_GjaQG', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='967773320193412', members=[ComplexValue(display='sdk-vwdl2onf@example.com', primary=None, ref='Users/3056062844054706', type=None, value='3056062844054706')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 17:59 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 17:59 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 table fixtures 17:59 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sowdo.ucx_trvfj', metastore_id=None, name='ucx_trvfj', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070219'}, row_filter=None, schema_name='ucx_sowdo', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_sowdo/ucx_trvfj', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 18:00 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 schema fixtures 18:00 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sowdo', metastore_id=None, name='ucx_sowdo', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 18:00 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_srkxm', metastore_id=None, name='ucx_srkxm', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw6] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```
❌ test_running_real_migrate_groups_job: KeyError: 'rename-t7y8-ucx_G1tqc' (14m37.527s) ``` KeyError: 'rename-t7y8-ucx_G1tqc' 17:57 INFO [databricks.sdk] Using Databricks Metadata Service authentication 17:57 INFO [databricks.sdk] Using Databricks Metadata Service authentication [gw4] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 17:57 INFO [databricks.sdk] Using Databricks Metadata Service authentication 17:57 INFO [databricks.sdk] Using Databricks Metadata Service authentication 17:57 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-pqzhazx6@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-pqzhazx6@example.com')], entitlements=[], external_id=None, groups=[], id='8568575276783553', name=Name(family_name=None, given_name='sdk-pqzhazx6@example.com'), roles=[], schemas=[, ], user_name='sdk-pqzhazx6@example.com') 17:57 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx_G1tqc: https://DATABRICKS_HOST#setting/accounts/groups/182564020261304 17:57 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx_G1tqc', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='182564020261304', members=[ComplexValue(display='sdk-pqzhazx6@example.com', primary=None, ref='Users/8568575276783553', type=None, value='8568575276783553')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 17:57 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx_G1tqc: https://accounts.CLOUD_ENVdatabricks.net/users/groups/435762984421984/members 17:57 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx_G1tqc', entitlements=[], external_id=None, groups=[], id='435762984421984', members=[ComplexValue(display='sdk-pqzhazx6@example.com', primary=None, ref='Users/8568575276783553', type=None, value='8568575276783553')], meta=None, roles=[], schemas=[]) 17:57 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/001A82C69DE30A2F 17:57 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='001A82C69DE30A2F') 17:57 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 001A82C69DE30A2F [group_name admins CAN_USE] -> [group_name ucx_G1tqc CAN_USE] 17:57 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_ss99g: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_ss99g 17:57 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_ss99g', metastore_id=None, name='ucx_ss99g', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 17:57 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_ss99g.ucx_thptm: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_ss99g/ucx_thptm 17:57 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_ss99g.ucx_thptm', metastore_id=None, name='ucx_thptm', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070219'}, row_filter=None, schema_name='ucx_ss99g', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_ss99g/ucx_thptm', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 17:57 DEBUG [databricks.labs.ucx.mixins.fixtures] added secret scope fixture: sdk-zO8b 17:57 DEBUG [databricks.labs.ucx.mixins.fixtures] added secret scope acl fixture: ('sdk-zO8b', 'ucx_G1tqc') 17:57 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sm2zw: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sm2zw 17:57 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sm2zw', metastore_id=None, name='ucx_sm2zw', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 17:57 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.t7y8/config.yml) doesn't exist. 17:57 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 17:57 INFO [databricks.labs.blueprint.tui] Asking prompt: Inventory Database stored in hive_metastore 17:57 INFO [databricks.labs.blueprint.tui] Asking prompt: Log level 17:57 INFO [databricks.labs.blueprint.tui] Asking prompt: Number of threads 17:57 INFO [databricks.labs.blueprint.tui] Asking prompt: Backup prefix 17:57 INFO [databricks.labs.blueprint.tui] Asking prompt: Choose how to map the workspace groups: [0] Match by Name [1] Apply a Prefix [2] Apply a Suffix [3] Match by External ID [4] Regex Substitution [5] Regex Matching Enter a number between 0 and 5 17:57 INFO [databricks.labs.blueprint.tui] Asking prompt: Enter a prefix to add to the workspace group name 17:57 INFO [databricks.labs.blueprint.tui] Asking prompt: Comma-separated list of workspace group names to migrate. If not specified, we'll use all account-level groups with matching names to workspace-level groups 17:57 INFO [databricks.labs.blueprint.tui] Asking prompt: Comma-separated list of databases to migrate. If not specified, we'll use all databases in hive_metastore 17:58 INFO [databricks.labs.blueprint.tui] Asking prompt: Does given workspace 7342989205138882 block Internet access? 17:58 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to trigger assessment job after installation? 17:58 INFO [databricks.labs.blueprint.tui] Asking prompt: Reconciliation threshold, in percentage 17:58 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 17:58 INFO [databricks.labs.blueprint.tui] Asking prompt: No HMS lineage collection init script exists, do you want to create one? 17:58 INFO [databricks.labs.ucx.install] Fetching installations... 17:58 INFO [databricks.labs.blueprint.parallel] finding t7y8 installations 100/309, rps: 220.093/sec 17:58 INFO [databricks.labs.blueprint.parallel] finding t7y8 installations 200/309, rps: 212.214/sec 17:58 INFO [databricks.labs.blueprint.parallel] finding t7y8 installations 300/309, rps: 226.622/sec 17:58 INFO [databricks.labs.blueprint.parallel] finding t7y8 installations 309/309, rps: 227.786/sec 17:58 INFO [databricks.labs.blueprint.parallel] Finished 'finding t7y8 installations' tasks: 0% results available (0/309). Took 0:00:01.358069 17:58 INFO [databricks.labs.blueprint.tui] Asking prompt: Select PRO or SERVERLESS SQL warehouse to run assessment dashboards on [0] [Create new PRO SQL warehouse] [1] DEFAULT Test Warehouse (TEST_DEFAULT_WAREHOUSE_ID, SERVERLESS, RUNNING) Enter a number between 0 and 1 17:58 INFO [databricks.labs.blueprint.tui] Asking prompt: Instance pool id to be set in cluster policy for all workflow clusters 17:58 INFO [databricks.labs.blueprint.tui] Asking prompt: We have identified one or more cluster policies set up for an external metastore. Would you like to set UCX to connect to the external metastore? 17:58 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 17:58 INFO [databricks.labs.blueprint.tui] Asking prompt: Parallelism for migrating dbfs root delta tables with deep clone 17:58 INFO [databricks.labs.blueprint.tui] Asking prompt: Min workers for auto-scale job cluster for table migration 17:58 INFO [databricks.labs.blueprint.tui] Asking prompt: Max workers for auto-scale job cluster for table migration 17:58 INFO [databricks.labs.blueprint.tui] Asking prompt: Open config file in the browser and continue installing? https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.t7y8/config.yml 17:58 DEBUG [tests.integration.conftest] Waiting for clusters to start... 17:58 INFO [databricks.labs.blueprint.parallel] ensure clusters running 3/3, rps: 65.051/sec 17:58 INFO [databricks.labs.blueprint.parallel] Finished 'ensure clusters running' tasks: 0% results available (0/3). Took 0:00:00.046330 17:58 DEBUG [tests.integration.conftest] Waiting for clusters to start... 17:58 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+6020240702175816 17:58 INFO [databricks.labs.ucx.install] Creating ucx schemas... 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw database exists 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.CLOUD_ENV_service_principals table exists 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.clusters table exists 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.global_init_scripts table exists 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.jobs table exists 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.pipelines table exists 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.external_locations table exists 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.mounts table exists 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.grants table exists 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.groups table exists 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.tables table exists 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.table_size table exists 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.table_failures table exists 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.workspace_objects table exists 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.permissions table exists 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.submit_runs table exists 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.policies table exists 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.migration_status table exists 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.workflow_problems table exists 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.udfs table exists 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.logs table exists 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.recon_results table exists 17:58 INFO [databricks.labs.blueprint.parallel] deploy tables 10/21, rps: 1.115/sec 17:58 INFO [databricks.labs.blueprint.parallel] deploy tables 20/21, rps: 1.327/sec 17:58 INFO [databricks.labs.blueprint.parallel] deploy tables 21/21, rps: 1.384/sec 17:58 INFO [databricks.labs.blueprint.parallel] Finished 'deploy tables' tasks: 0% results available (0/21). Took 0:00:15.168902 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.grant_detail view matches queries/views/grant_detail.sql contents 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.objects view matches queries/views/objects.sql contents 17:59 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.table_estimates view matches queries/views/table_estimates.sql contents 17:59 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.misc_patterns view matches queries/views/misc_patterns.sql contents 17:59 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.code_patterns view matches queries/views/code_patterns.sql contents 17:59 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.reconciliation_results view matches queries/views/reconciliation_results.sql contents 17:59 INFO [databricks.labs.blueprint.parallel] installing components 1/1, rps: 0.015/sec 17:59 INFO [databricks.labs.blueprint.parallel] Finished 'installing components' tasks: 0% results available (0/1). Took 0:01:07.612898 17:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 17:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 17:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 17:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 17:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 17:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 17:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 17:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 17:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 17:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 17:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 17:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 17:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 17:59 INFO [databricks.labs.blueprint.tui] Asking prompt: Open job overview in your browser? https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.t7y8/README 17:59 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.t7y8/README for the next steps. 18:02 DEBUG [databricks.labs.ucx.workspace_access.manager] Crawling permissions 18:02 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sm2zw.grants] fetching grants inventory 18:02 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sm2zw.grants] crawling new batch for grants 18:02 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sm2zw.tables] fetching tables inventory 18:02 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sm2zw.tables] crawling new batch for tables 18:02 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_ss99g] listing tables 18:03 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_ss99g.ucx_thptm] fetching table metadata 18:03 INFO [databricks.labs.blueprint.parallel] listing tables in hive_metastore 1/1, rps: 0.169/sec 18:03 INFO [databricks.labs.blueprint.parallel] Finished 'listing tables in hive_metastore' tasks: 100% results available (1/1). Took 0:00:05.901859 18:03 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sm2zw.tables] found 1 new records for tables 18:03 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sm2zw.udfs] fetching udfs inventory 18:03 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sm2zw.udfs] crawling new batch for udfs 18:03 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_ss99g] listing udfs 18:03 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sm2zw.udfs] found 0 new records for udfs 18:04 INFO [databricks.labs.blueprint.parallel] listing grants for hive_metastore 5/5, rps: 0.076/sec 18:04 INFO [databricks.labs.blueprint.parallel] Finished 'listing grants for hive_metastore' tasks: 100% results available (5/5). Took 0:01:05.381158 18:04 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sm2zw.grants] found 283 new records for grants 18:04 INFO [databricks.labs.ucx.workspace_access.manager] Starting to crawl permissions. Total tasks: 4 18:04 INFO [databricks.labs.blueprint.parallel] crawl permissions 4/4, rps: 17.938/sec 18:04 INFO [databricks.labs.blueprint.parallel] Finished 'crawl permissions' tasks: 100% results available (4/4). Took 0:00:00.223280 18:04 INFO [databricks.labs.ucx.workspace_access.manager] Total crawled permissions: 4 18:04 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sm2zw.permissions] found 4 new records for permissions 18:05 INFO [databricks.labs.ucx.workspace_access.manager] Successfully saved the items to inventory table 18:05 INFO [databricks.labs.ucx.workspace_access.manager] Saved 4 to hive_metastore.ucx_sm2zw.permissions 18:05 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-groups job: https://DATABRICKS_HOST#job/482801074873670 17:57 INFO [databricks.sdk] Using Databricks Metadata Service authentication 17:57 INFO [databricks.sdk] Using Databricks Metadata Service authentication 17:57 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-pqzhazx6@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-pqzhazx6@example.com')], entitlements=[], external_id=None, groups=[], id='8568575276783553', name=Name(family_name=None, given_name='sdk-pqzhazx6@example.com'), roles=[], schemas=[, ], user_name='sdk-pqzhazx6@example.com') 17:57 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group ucx_G1tqc: https://DATABRICKS_HOST#setting/accounts/groups/182564020261304 17:57 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='ucx_G1tqc', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='182564020261304', members=[ComplexValue(display='sdk-pqzhazx6@example.com', primary=None, ref='Users/8568575276783553', type=None, value='8568575276783553')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 17:57 INFO [databricks.labs.ucx.mixins.fixtures] Account group ucx_G1tqc: https://accounts.CLOUD_ENVdatabricks.net/users/groups/435762984421984/members 17:57 DEBUG [databricks.labs.ucx.mixins.fixtures] added account group fixture: Group(display_name='ucx_G1tqc', entitlements=[], external_id=None, groups=[], id='435762984421984', members=[ComplexValue(display='sdk-pqzhazx6@example.com', primary=None, ref='Users/8568575276783553', type=None, value='8568575276783553')], meta=None, roles=[], schemas=[]) 17:57 INFO [databricks.labs.ucx.mixins.fixtures] Cluster policy: https://DATABRICKS_HOST#setting/clusters/cluster-policies/view/001A82C69DE30A2F 17:57 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster policy fixture: CreatePolicyResponse(policy_id='001A82C69DE30A2F') 17:57 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster_policy permissions fixture: 001A82C69DE30A2F [group_name admins CAN_USE] -> [group_name ucx_G1tqc CAN_USE] 17:57 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_ss99g: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_ss99g 17:57 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_ss99g', metastore_id=None, name='ucx_ss99g', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 17:57 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_ss99g.ucx_thptm: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_ss99g/ucx_thptm 17:57 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_ss99g.ucx_thptm', metastore_id=None, name='ucx_thptm', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070219'}, row_filter=None, schema_name='ucx_ss99g', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_ss99g/ucx_thptm', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 17:57 DEBUG [databricks.labs.ucx.mixins.fixtures] added secret scope fixture: sdk-zO8b 17:57 DEBUG [databricks.labs.ucx.mixins.fixtures] added secret scope acl fixture: ('sdk-zO8b', 'ucx_G1tqc') 17:57 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sm2zw: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sm2zw 17:57 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sm2zw', metastore_id=None, name='ucx_sm2zw', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 17:57 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.t7y8/config.yml) doesn't exist. 17:57 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 17:57 INFO [databricks.labs.blueprint.tui] Asking prompt: Inventory Database stored in hive_metastore 17:57 INFO [databricks.labs.blueprint.tui] Asking prompt: Log level 17:57 INFO [databricks.labs.blueprint.tui] Asking prompt: Number of threads 17:57 INFO [databricks.labs.blueprint.tui] Asking prompt: Backup prefix 17:57 INFO [databricks.labs.blueprint.tui] Asking prompt: Choose how to map the workspace groups: [0] Match by Name [1] Apply a Prefix [2] Apply a Suffix [3] Match by External ID [4] Regex Substitution [5] Regex Matching Enter a number between 0 and 5 17:57 INFO [databricks.labs.blueprint.tui] Asking prompt: Enter a prefix to add to the workspace group name 17:57 INFO [databricks.labs.blueprint.tui] Asking prompt: Comma-separated list of workspace group names to migrate. If not specified, we'll use all account-level groups with matching names to workspace-level groups 17:57 INFO [databricks.labs.blueprint.tui] Asking prompt: Comma-separated list of databases to migrate. If not specified, we'll use all databases in hive_metastore 17:58 INFO [databricks.labs.blueprint.tui] Asking prompt: Does given workspace 7342989205138882 block Internet access? 17:58 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to trigger assessment job after installation? 17:58 INFO [databricks.labs.blueprint.tui] Asking prompt: Reconciliation threshold, in percentage 17:58 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 17:58 INFO [databricks.labs.blueprint.tui] Asking prompt: No HMS lineage collection init script exists, do you want to create one? 17:58 INFO [databricks.labs.ucx.install] Fetching installations... 17:58 INFO [databricks.labs.blueprint.parallel] finding t7y8 installations 100/309, rps: 220.093/sec 17:58 INFO [databricks.labs.blueprint.parallel] finding t7y8 installations 200/309, rps: 212.214/sec 17:58 INFO [databricks.labs.blueprint.parallel] finding t7y8 installations 300/309, rps: 226.622/sec 17:58 INFO [databricks.labs.blueprint.parallel] finding t7y8 installations 309/309, rps: 227.786/sec 17:58 INFO [databricks.labs.blueprint.parallel] Finished 'finding t7y8 installations' tasks: 0% results available (0/309). Took 0:00:01.358069 17:58 INFO [databricks.labs.blueprint.tui] Asking prompt: Select PRO or SERVERLESS SQL warehouse to run assessment dashboards on [0] [Create new PRO SQL warehouse] [1] DEFAULT Test Warehouse (TEST_DEFAULT_WAREHOUSE_ID, SERVERLESS, RUNNING) Enter a number between 0 and 1 17:58 INFO [databricks.labs.blueprint.tui] Asking prompt: Instance pool id to be set in cluster policy for all workflow clusters 17:58 INFO [databricks.labs.blueprint.tui] Asking prompt: We have identified one or more cluster policies set up for an external metastore. Would you like to set UCX to connect to the external metastore? 17:58 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 17:58 INFO [databricks.labs.blueprint.tui] Asking prompt: Parallelism for migrating dbfs root delta tables with deep clone 17:58 INFO [databricks.labs.blueprint.tui] Asking prompt: Min workers for auto-scale job cluster for table migration 17:58 INFO [databricks.labs.blueprint.tui] Asking prompt: Max workers for auto-scale job cluster for table migration 17:58 INFO [databricks.labs.blueprint.tui] Asking prompt: Open config file in the browser and continue installing? https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.t7y8/config.yml 17:58 DEBUG [tests.integration.conftest] Waiting for clusters to start... 17:58 INFO [databricks.labs.blueprint.parallel] ensure clusters running 3/3, rps: 65.051/sec 17:58 INFO [databricks.labs.blueprint.parallel] Finished 'ensure clusters running' tasks: 0% results available (0/3). Took 0:00:00.046330 17:58 DEBUG [tests.integration.conftest] Waiting for clusters to start... 17:58 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+6020240702175816 17:58 INFO [databricks.labs.ucx.install] Creating ucx schemas... 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw database exists 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.CLOUD_ENV_service_principals table exists 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.clusters table exists 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.global_init_scripts table exists 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.jobs table exists 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.pipelines table exists 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.external_locations table exists 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.mounts table exists 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.grants table exists 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.groups table exists 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.tables table exists 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.table_size table exists 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.table_failures table exists 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.workspace_objects table exists 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.permissions table exists 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.submit_runs table exists 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.policies table exists 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.migration_status table exists 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.workflow_problems table exists 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.udfs table exists 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.logs table exists 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.recon_results table exists 17:58 INFO [databricks.labs.blueprint.parallel] deploy tables 10/21, rps: 1.115/sec 17:58 INFO [databricks.labs.blueprint.parallel] deploy tables 20/21, rps: 1.327/sec 17:58 INFO [databricks.labs.blueprint.parallel] deploy tables 21/21, rps: 1.384/sec 17:58 INFO [databricks.labs.blueprint.parallel] Finished 'deploy tables' tasks: 0% results available (0/21). Took 0:00:15.168902 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.grant_detail view matches queries/views/grant_detail.sql contents 17:58 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.objects view matches queries/views/objects.sql contents 17:59 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.table_estimates view matches queries/views/table_estimates.sql contents 17:59 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.misc_patterns view matches queries/views/misc_patterns.sql contents 17:59 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.code_patterns view matches queries/views/code_patterns.sql contents 17:59 INFO [databricks.labs.lsql.deployment] Ensuring ucx_sm2zw.reconciliation_results view matches queries/views/reconciliation_results.sql contents 17:59 INFO [databricks.labs.blueprint.parallel] installing components 1/1, rps: 0.015/sec 17:59 INFO [databricks.labs.blueprint.parallel] Finished 'installing components' tasks: 0% results available (0/1). Took 0:01:07.612898 17:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 17:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 17:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 17:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 17:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 17:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 17:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 17:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 17:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 17:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 17:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 17:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 17:59 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 17:59 INFO [databricks.labs.blueprint.tui] Asking prompt: Open job overview in your browser? https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.t7y8/README 17:59 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.t7y8/README for the next steps. 18:02 DEBUG [databricks.labs.ucx.workspace_access.manager] Crawling permissions 18:02 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sm2zw.grants] fetching grants inventory 18:02 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sm2zw.grants] crawling new batch for grants 18:02 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sm2zw.tables] fetching tables inventory 18:02 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sm2zw.tables] crawling new batch for tables 18:02 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_ss99g] listing tables 18:03 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_ss99g.ucx_thptm] fetching table metadata 18:03 INFO [databricks.labs.blueprint.parallel] listing tables in hive_metastore 1/1, rps: 0.169/sec 18:03 INFO [databricks.labs.blueprint.parallel] Finished 'listing tables in hive_metastore' tasks: 100% results available (1/1). Took 0:00:05.901859 18:03 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sm2zw.tables] found 1 new records for tables 18:03 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sm2zw.udfs] fetching udfs inventory 18:03 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sm2zw.udfs] crawling new batch for udfs 18:03 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_ss99g] listing udfs 18:03 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sm2zw.udfs] found 0 new records for udfs 18:04 INFO [databricks.labs.blueprint.parallel] listing grants for hive_metastore 5/5, rps: 0.076/sec 18:04 INFO [databricks.labs.blueprint.parallel] Finished 'listing grants for hive_metastore' tasks: 100% results available (5/5). Took 0:01:05.381158 18:04 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sm2zw.grants] found 283 new records for grants 18:04 INFO [databricks.labs.ucx.workspace_access.manager] Starting to crawl permissions. Total tasks: 4 18:04 INFO [databricks.labs.blueprint.parallel] crawl permissions 4/4, rps: 17.938/sec 18:04 INFO [databricks.labs.blueprint.parallel] Finished 'crawl permissions' tasks: 100% results available (4/4). Took 0:00:00.223280 18:04 INFO [databricks.labs.ucx.workspace_access.manager] Total crawled permissions: 4 18:04 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_sm2zw.permissions] found 4 new records for permissions 18:05 INFO [databricks.labs.ucx.workspace_access.manager] Successfully saved the items to inventory table 18:05 INFO [databricks.labs.ucx.workspace_access.manager] Saved 4 to hive_metastore.ucx_sm2zw.permissions 18:05 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-groups job: https://DATABRICKS_HOST#job/482801074873670 18:11 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 secret scope acl fixtures 18:11 DEBUG [databricks.labs.ucx.mixins.fixtures] removing secret scope acl fixture: ('sdk-zO8b', 'ucx_G1tqc') 18:11 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 secret scope fixtures 18:11 DEBUG [databricks.labs.ucx.mixins.fixtures] removing secret scope fixture: sdk-zO8b 18:11 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster_policy permissions fixtures 18:11 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster_policy permissions fixture: 001A82C69DE30A2F [group_name admins CAN_USE] -> [group_name ucx_G1tqc CAN_USE] 18:11 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster policy fixtures 18:11 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster policy fixture: CreatePolicyResponse(policy_id='001A82C69DE30A2F') 18:11 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to uninstall ucx from the workspace too, this would remove ucx project folder, dashboards, queries and jobs 18:11 INFO [databricks.labs.ucx.install] Deleting UCX v0.27.2+6020240702175816 from https://DATABRICKS_HOST 18:11 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to delete the inventory database ucx_sm2zw too? 18:11 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_sm2zw 18:11 INFO [databricks.labs.lsql.deployment] deleting ucx_sm2zw database 18:11 INFO [databricks.labs.ucx.install] Deleting jobs 18:11 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=965995250825950. 18:11 INFO [databricks.labs.ucx.install] Deleting scan-tables-in-mounts-experimental job_id=275146943862546. 18:11 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=482801074873670. 18:11 INFO [databricks.labs.ucx.install] Deleting experimental-workflow-linter job_id=265566040052000. 18:11 INFO [databricks.labs.ucx.install] Deleting migrate-data-reconciliation job_id=415237848020155. 18:11 INFO [databricks.labs.ucx.install] Deleting migrate-external-tables-ctas job_id=594134725776499. 18:11 INFO [databricks.labs.ucx.install] Deleting migrate-external-hiveserde-tables-in-place-experimental job_id=814941816696668. 18:11 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=1124394575078051. 18:11 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=650085612160076. 18:11 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=146926482006657. 18:11 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=236494267083539. 18:11 INFO [databricks.labs.ucx.install] Deleting failing job_id=97214041648712. 18:11 INFO [databricks.labs.ucx.install] Deleting assessment job_id=846836170048498. 18:11 INFO [databricks.labs.ucx.install] Deleting cluster policy 18:11 INFO [databricks.labs.ucx.install] Deleting secret scope 18:11 INFO [databricks.labs.ucx.install] UnInstalling UCX complete 18:11 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace user fixtures 18:11 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='sdk-pqzhazx6@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-pqzhazx6@example.com')], entitlements=[], external_id=None, groups=[], id='8568575276783553', name=Name(family_name=None, given_name='sdk-pqzhazx6@example.com'), roles=[], schemas=[, ], user_name='sdk-pqzhazx6@example.com') 18:11 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 account group fixtures 18:11 DEBUG [databricks.labs.ucx.mixins.fixtures] removing account group fixture: Group(display_name='ucx_G1tqc', entitlements=[], external_id=None, groups=[], id='435762984421984', members=[ComplexValue(display='sdk-pqzhazx6@example.com', primary=None, ref='Users/8568575276783553', type=None, value='8568575276783553')], meta=None, roles=[], schemas=[]) 18:11 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace group fixtures 18:11 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace group fixture: Group(display_name='ucx_G1tqc', entitlements=[ComplexValue(display=None, primary=None, ref=None, type=None, value='allow-cluster-create')], external_id=None, groups=[], id='182564020261304', members=[ComplexValue(display='sdk-pqzhazx6@example.com', primary=None, ref='Users/8568575276783553', type=None, value='8568575276783553')], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 18:11 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 18:11 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 table fixtures 18:11 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_ss99g.ucx_thptm', metastore_id=None, name='ucx_thptm', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070219'}, row_filter=None, schema_name='ucx_ss99g', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_ss99g/ucx_thptm', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 18:11 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 schema fixtures 18:11 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_ss99g', metastore_id=None, name='ucx_ss99g', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 18:12 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sm2zw', metastore_id=None, name='ucx_sm2zw', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw4] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```
❌ test_migrate_table_in_mount: databricks.sdk.errors.platform.BadRequest: [SCHEMA_ALREADY_EXISTS] Cannot create schema `mounted_TEST_MOUNT_NAME` because it already exists. (8.748s) ``` databricks.sdk.errors.platform.BadRequest: [SCHEMA_ALREADY_EXISTS] Cannot create schema `mounted_TEST_MOUNT_NAME` because it already exists. Choose a different name, drop the existing schema, or add the IF NOT EXISTS clause to tolerate pre-existing schema. SQLSTATE: 42P06 18:16 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s6jzw: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s6jzw 18:16 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s6jzw', metastore_id=None, name='ucx_s6jzw', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw7] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 18:16 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s6jzw: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s6jzw 18:16 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s6jzw', metastore_id=None, name='ucx_s6jzw', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 18:16 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s6jzw: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s6jzw 18:16 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s6jzw', metastore_id=None, name='ucx_s6jzw', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 18:16 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 account group fixtures 18:16 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures 18:16 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 18:16 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 18:16 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 catalog fixtures 18:16 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 schema fixtures 18:16 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s6jzw', metastore_id=None, name='ucx_s6jzw', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw7] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```

Running from acceptance #4207