Test failure: `test_hiveserde_table_in_place_migration_job[hiveserde]`

[github-actions[bot]]

❌ test_hiveserde_table_in_place_migration_job[hiveserde]: databricks.sdk.errors.platform.ResourceDoesNotExist: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.8Qx5/logs/migrate-external-hiveserde-tables-in-place-experimental) doesn't exist. (6m58.444s)

``` databricks.sdk.errors.platform.ResourceDoesNotExist: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.8Qx5/logs/migrate-external-hiveserde-tables-in-place-experimental) doesn't exist. 12:24 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/pttA 12:24 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.hiveserde_in_place_ziu2z: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_ziu2z 12:24 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.hiveserde_in_place_ziu2z', metastore_id=None, name='hiveserde_in_place_ziu2z', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 12:24 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_storage_dir fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_ziu2z 12:24 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_ziu2z.parquet_serde_ziu2z: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_ziu2z/parquet_serde_ziu2z 12:24 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_ziu2z.parquet_serde_ziu2z', metastore_id=None, name='parquet_serde_ziu2z', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024071513'}, row_filter=None, schema_name='hiveserde_in_place_ziu2z', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_ziu2z/parquet_serde_ziu2z', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 12:24 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_ziu2z.orc_serde_ziu2z: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_ziu2z/orc_serde_ziu2z 12:24 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_ziu2z.orc_serde_ziu2z', metastore_id=None, name='orc_serde_ziu2z', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024071513'}, row_filter=None, schema_name='hiveserde_in_place_ziu2z', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_ziu2z/orc_serde_ziu2z', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 12:24 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_ziu2z.avro_serde_ziu2z: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_ziu2z/avro_serde_ziu2z 12:24 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_ziu2z.avro_serde_ziu2z', metastore_id=None, name='avro_serde_ziu2z', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024071513'}, row_filter=None, schema_name='hiveserde_in_place_ziu2z', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_ziu2z/avro_serde_ziu2z', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 12:24 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1721046289523, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cysdk', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cysdk', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1721046289523, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 12:24 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cysdk.hiveserde_in_place_ziu2z: https://DATABRICKS_HOST/explore/data/ucx_cysdk/hiveserde_in_place_ziu2z 12:24 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cysdk', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cysdk.hiveserde_in_place_ziu2z', metastore_id=None, name='hiveserde_in_place_ziu2z', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 12:24 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sfhdg: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sfhdg 12:24 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sfhdg', metastore_id=None, name='ucx_sfhdg', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw0] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 12:24 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/pttA 12:24 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.hiveserde_in_place_ziu2z: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_ziu2z 12:24 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.hiveserde_in_place_ziu2z', metastore_id=None, name='hiveserde_in_place_ziu2z', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 12:24 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_storage_dir fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_ziu2z 12:24 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_ziu2z.parquet_serde_ziu2z: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_ziu2z/parquet_serde_ziu2z 12:24 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_ziu2z.parquet_serde_ziu2z', metastore_id=None, name='parquet_serde_ziu2z', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024071513'}, row_filter=None, schema_name='hiveserde_in_place_ziu2z', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_ziu2z/parquet_serde_ziu2z', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 12:24 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_ziu2z.orc_serde_ziu2z: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_ziu2z/orc_serde_ziu2z 12:24 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_ziu2z.orc_serde_ziu2z', metastore_id=None, name='orc_serde_ziu2z', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024071513'}, row_filter=None, schema_name='hiveserde_in_place_ziu2z', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_ziu2z/orc_serde_ziu2z', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 12:24 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_ziu2z.avro_serde_ziu2z: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_ziu2z/avro_serde_ziu2z 12:24 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_ziu2z.avro_serde_ziu2z', metastore_id=None, name='avro_serde_ziu2z', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024071513'}, row_filter=None, schema_name='hiveserde_in_place_ziu2z', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_ziu2z/avro_serde_ziu2z', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 12:24 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1721046289523, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cysdk', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cysdk', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1721046289523, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 12:24 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cysdk.hiveserde_in_place_ziu2z: https://DATABRICKS_HOST/explore/data/ucx_cysdk/hiveserde_in_place_ziu2z 12:24 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cysdk', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cysdk.hiveserde_in_place_ziu2z', metastore_id=None, name='hiveserde_in_place_ziu2z', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 12:24 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sfhdg: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sfhdg 12:24 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sfhdg', metastore_id=None, name='ucx_sfhdg', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 12:25 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.8Qx5/config.yml) doesn't exist. 12:25 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 12:25 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 12:25 INFO [databricks.labs.ucx.install] Fetching installations... 12:25 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.8Qx5 is corrupted. Skipping... 12:25 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 12:25 DEBUG [tests.integration.conftest] Waiting for clusters to start... 12:25 DEBUG [tests.integration.conftest] Waiting for clusters to start... 12:25 INFO [databricks.labs.ucx.install] Installing UCX v0.28.3+220240715122513 12:25 INFO [databricks.labs.ucx.install] Creating ucx schemas... 12:25 INFO [databricks.labs.ucx.install] Creating dashboards... 12:25 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 12:25 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 12:25 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 12:25 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 12:25 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 12:25 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 12:25 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 12:25 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 12:25 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 12:25 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 12:25 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 12:25 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 12:25 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 12:25 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 12:25 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 12:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 12:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 12:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 12:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 12:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 12:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 12:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 12:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 12:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 12:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 12:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 12:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 12:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 12:26 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.8Qx5/README for the next steps. 12:26 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-external-hiveserde-tables-in-place-experimental job: https://DATABRICKS_HOST#job/966767509323005 12:31 INFO [databricks.labs.ucx.installer.workflows] ---------- REMOTE LOGS -------------- 12:24 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/pttA 12:24 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.hiveserde_in_place_ziu2z: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_ziu2z 12:24 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.hiveserde_in_place_ziu2z', metastore_id=None, name='hiveserde_in_place_ziu2z', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 12:24 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_storage_dir fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_ziu2z 12:24 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_ziu2z.parquet_serde_ziu2z: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_ziu2z/parquet_serde_ziu2z 12:24 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_ziu2z.parquet_serde_ziu2z', metastore_id=None, name='parquet_serde_ziu2z', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024071513'}, row_filter=None, schema_name='hiveserde_in_place_ziu2z', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_ziu2z/parquet_serde_ziu2z', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 12:24 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_ziu2z.orc_serde_ziu2z: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_ziu2z/orc_serde_ziu2z 12:24 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_ziu2z.orc_serde_ziu2z', metastore_id=None, name='orc_serde_ziu2z', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024071513'}, row_filter=None, schema_name='hiveserde_in_place_ziu2z', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_ziu2z/orc_serde_ziu2z', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 12:24 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_ziu2z.avro_serde_ziu2z: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_ziu2z/avro_serde_ziu2z 12:24 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_ziu2z.avro_serde_ziu2z', metastore_id=None, name='avro_serde_ziu2z', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024071513'}, row_filter=None, schema_name='hiveserde_in_place_ziu2z', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_ziu2z/avro_serde_ziu2z', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 12:24 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1721046289523, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cysdk', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cysdk', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1721046289523, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 12:24 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cysdk.hiveserde_in_place_ziu2z: https://DATABRICKS_HOST/explore/data/ucx_cysdk/hiveserde_in_place_ziu2z 12:24 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cysdk', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cysdk.hiveserde_in_place_ziu2z', metastore_id=None, name='hiveserde_in_place_ziu2z', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 12:24 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sfhdg: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sfhdg 12:24 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sfhdg', metastore_id=None, name='ucx_sfhdg', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 12:25 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.8Qx5/config.yml) doesn't exist. 12:25 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 12:25 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 12:25 INFO [databricks.labs.ucx.install] Fetching installations... 12:25 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.8Qx5 is corrupted. Skipping... 12:25 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 12:25 DEBUG [tests.integration.conftest] Waiting for clusters to start... 12:25 DEBUG [tests.integration.conftest] Waiting for clusters to start... 12:25 INFO [databricks.labs.ucx.install] Installing UCX v0.28.3+220240715122513 12:25 INFO [databricks.labs.ucx.install] Creating ucx schemas... 12:25 INFO [databricks.labs.ucx.install] Creating dashboards... 12:25 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 12:25 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 12:25 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 12:25 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 12:25 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 12:25 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 12:25 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 12:25 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 12:25 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 12:25 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 12:25 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 12:25 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 12:25 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 12:25 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 12:25 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 12:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 12:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 12:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 12:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 12:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 12:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 12:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 12:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 12:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 12:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 12:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 12:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 12:26 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 12:26 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.8Qx5/README for the next steps. 12:26 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-external-hiveserde-tables-in-place-experimental job: https://DATABRICKS_HOST#job/966767509323005 12:31 INFO [databricks.labs.ucx.installer.workflows] ---------- REMOTE LOGS -------------- 12:31 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_storage_dir fixtures 12:31 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_storage_dir fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_ziu2z 12:31 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_dbfs_data_copy fixtures 12:31 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/pttA 12:31 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 cluster fixtures 12:31 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 catalog fixtures 12:31 DEBUG [databricks.labs.ucx.mixins.fixtures] removing catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1721046289523, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cysdk', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cysdk', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1721046289523, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 12:31 INFO [databricks.labs.ucx.install] Deleting UCX v0.28.3+220240715122513 from https://DATABRICKS_HOST 12:31 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_sfhdg 12:31 INFO [databricks.labs.ucx.install] Deleting jobs 12:31 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=486807824755491. 12:31 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=312466648343602. 12:31 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=673322650399338. 12:31 INFO [databricks.labs.ucx.install] Deleting scan-tables-in-mounts-experimental job_id=137799715015827. 12:31 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=700142292140445. 12:31 INFO [databricks.labs.ucx.install] Deleting experimental-workflow-linter job_id=1114948098789876. 12:31 INFO [databricks.labs.ucx.install] Deleting assessment job_id=819088840409525. 12:31 INFO [databricks.labs.ucx.install] Deleting migrate-external-tables-ctas job_id=279892939920638. 12:31 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=745153263538257. 12:31 INFO [databricks.labs.ucx.install] Deleting migrate-external-hiveserde-tables-in-place-experimental job_id=966767509323005. 12:31 INFO [databricks.labs.ucx.install] Deleting migrate-data-reconciliation job_id=509057642942334. 12:31 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=440509870781311. 12:31 INFO [databricks.labs.ucx.install] Deleting failing job_id=385456089232483. 12:31 INFO [databricks.labs.ucx.install] Deleting cluster policy 12:31 INFO [databricks.labs.ucx.install] Deleting secret scope 12:31 INFO [databricks.labs.ucx.install] UnInstalling UCX complete 12:31 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace user fixtures 12:31 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 account group fixtures 12:31 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures 12:31 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 12:31 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 table fixtures 12:31 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_ziu2z.parquet_serde_ziu2z', metastore_id=None, name='parquet_serde_ziu2z', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024071513'}, row_filter=None, schema_name='hiveserde_in_place_ziu2z', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_ziu2z/parquet_serde_ziu2z', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 12:31 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_ziu2z.orc_serde_ziu2z', metastore_id=None, name='orc_serde_ziu2z', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024071513'}, row_filter=None, schema_name='hiveserde_in_place_ziu2z', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_ziu2z/orc_serde_ziu2z', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 12:31 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_ziu2z.avro_serde_ziu2z', metastore_id=None, name='avro_serde_ziu2z', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024071513'}, row_filter=None, schema_name='hiveserde_in_place_ziu2z', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_ziu2z/avro_serde_ziu2z', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 12:31 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 schema fixtures 12:31 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.hiveserde_in_place_ziu2z', metastore_id=None, name='hiveserde_in_place_ziu2z', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 12:31 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cysdk', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cysdk.hiveserde_in_place_ziu2z', metastore_id=None, name='hiveserde_in_place_ziu2z', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 12:31 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sfhdg', metastore_id=None, name='ucx_sfhdg', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw0] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```

_{Running from nightly #125}

[github-actions[bot]]

❌ test_hiveserde_table_in_place_migration_job[hiveserde]: TimeoutError: Timed out after 0:02:00 (7m49.632s)

``` TimeoutError: Timed out after 0:02:00 05:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/NIKd 05:08 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.hiveserde_in_place_mzv7x: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_mzv7x 05:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.hiveserde_in_place_mzv7x', metastore_id=None, name='hiveserde_in_place_mzv7x', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 05:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_storage_dir fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_mzv7x 05:08 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_mzv7x.parquet_serde_mzv7x: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_mzv7x/parquet_serde_mzv7x 05:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_mzv7x.parquet_serde_mzv7x', metastore_id=None, name='parquet_serde_mzv7x', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024071606'}, row_filter=None, schema_name='hiveserde_in_place_mzv7x', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_mzv7x/parquet_serde_mzv7x', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 05:08 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_mzv7x.orc_serde_mzv7x: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_mzv7x/orc_serde_mzv7x 05:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_mzv7x.orc_serde_mzv7x', metastore_id=None, name='orc_serde_mzv7x', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024071606'}, row_filter=None, schema_name='hiveserde_in_place_mzv7x', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_mzv7x/orc_serde_mzv7x', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 05:08 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_mzv7x.avro_serde_mzv7x: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_mzv7x/avro_serde_mzv7x 05:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_mzv7x.avro_serde_mzv7x', metastore_id=None, name='avro_serde_mzv7x', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024071606'}, row_filter=None, schema_name='hiveserde_in_place_mzv7x', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_mzv7x/avro_serde_mzv7x', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 05:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1721106527720, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c8cur', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_c8cur', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1721106527720, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 05:08 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_c8cur.hiveserde_in_place_mzv7x: https://DATABRICKS_HOST/explore/data/ucx_c8cur/hiveserde_in_place_mzv7x 05:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_c8cur', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c8cur.hiveserde_in_place_mzv7x', metastore_id=None, name='hiveserde_in_place_mzv7x', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 05:08 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sbdqe: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sbdqe 05:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sbdqe', metastore_id=None, name='ucx_sbdqe', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw1] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 05:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/NIKd 05:08 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.hiveserde_in_place_mzv7x: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_mzv7x 05:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.hiveserde_in_place_mzv7x', metastore_id=None, name='hiveserde_in_place_mzv7x', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 05:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_storage_dir fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_mzv7x 05:08 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_mzv7x.parquet_serde_mzv7x: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_mzv7x/parquet_serde_mzv7x 05:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_mzv7x.parquet_serde_mzv7x', metastore_id=None, name='parquet_serde_mzv7x', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024071606'}, row_filter=None, schema_name='hiveserde_in_place_mzv7x', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_mzv7x/parquet_serde_mzv7x', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 05:08 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_mzv7x.orc_serde_mzv7x: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_mzv7x/orc_serde_mzv7x 05:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_mzv7x.orc_serde_mzv7x', metastore_id=None, name='orc_serde_mzv7x', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024071606'}, row_filter=None, schema_name='hiveserde_in_place_mzv7x', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_mzv7x/orc_serde_mzv7x', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 05:08 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_mzv7x.avro_serde_mzv7x: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_mzv7x/avro_serde_mzv7x 05:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_mzv7x.avro_serde_mzv7x', metastore_id=None, name='avro_serde_mzv7x', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024071606'}, row_filter=None, schema_name='hiveserde_in_place_mzv7x', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_mzv7x/avro_serde_mzv7x', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 05:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1721106527720, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c8cur', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_c8cur', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1721106527720, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 05:08 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_c8cur.hiveserde_in_place_mzv7x: https://DATABRICKS_HOST/explore/data/ucx_c8cur/hiveserde_in_place_mzv7x 05:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_c8cur', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c8cur.hiveserde_in_place_mzv7x', metastore_id=None, name='hiveserde_in_place_mzv7x', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 05:08 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sbdqe: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sbdqe 05:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sbdqe', metastore_id=None, name='ucx_sbdqe', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 05:09 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.SFPJ/config.yml) doesn't exist. 05:09 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:09 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:09 INFO [databricks.labs.ucx.install] Fetching installations... 05:09 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.SFPJ is corrupted. Skipping... 05:09 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:09 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:13 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:13 INFO [databricks.labs.ucx.install] Installing UCX v0.28.3+620240716051339 05:13 INFO [databricks.labs.ucx.install] Creating ucx schemas... 05:14 INFO [databricks.labs.ucx.install] Creating dashboards... 05:14 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 05:14 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 05:14 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:16 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:16 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:16 ERROR [databricks.labs.blueprint.parallel] installing components(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.SFPJ/dashboards') task failed: Timed out after 0:02:00 Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 543, in _create_dashboard dashboard = Dashboards(self._ws).deploy_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 875, in deploy_dashboard dashboard = self._ws.lakeview.create( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/dashboards.py", line 714, in create res = self._api.do('POST', '/api/2.0/lakeview/dashboards', body=body, headers=headers) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 153, in do response = retryable(self._perform)(method, File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 264, in _perform raise self._make_nicer_error(response=response, **payload) from None databricks.sdk.errors.platform.InternalError: A database error occurred during import-dashboard-new The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 59, in wrapper raise TimeoutError(f'Timed out after {timeout}') from last_err TimeoutError: Timed out after 0:02:00 05:16 ERROR [databricks.labs.blueprint.parallel] More than half 'installing components' tasks failed: 0% results available (0/6). Took 0:02:11.775885 05:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/NIKd 05:08 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.hiveserde_in_place_mzv7x: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_mzv7x 05:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.hiveserde_in_place_mzv7x', metastore_id=None, name='hiveserde_in_place_mzv7x', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 05:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_storage_dir fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_mzv7x 05:08 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_mzv7x.parquet_serde_mzv7x: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_mzv7x/parquet_serde_mzv7x 05:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_mzv7x.parquet_serde_mzv7x', metastore_id=None, name='parquet_serde_mzv7x', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024071606'}, row_filter=None, schema_name='hiveserde_in_place_mzv7x', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_mzv7x/parquet_serde_mzv7x', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 05:08 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_mzv7x.orc_serde_mzv7x: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_mzv7x/orc_serde_mzv7x 05:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_mzv7x.orc_serde_mzv7x', metastore_id=None, name='orc_serde_mzv7x', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024071606'}, row_filter=None, schema_name='hiveserde_in_place_mzv7x', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_mzv7x/orc_serde_mzv7x', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 05:08 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_mzv7x.avro_serde_mzv7x: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_mzv7x/avro_serde_mzv7x 05:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_mzv7x.avro_serde_mzv7x', metastore_id=None, name='avro_serde_mzv7x', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024071606'}, row_filter=None, schema_name='hiveserde_in_place_mzv7x', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_mzv7x/avro_serde_mzv7x', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 05:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1721106527720, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c8cur', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_c8cur', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1721106527720, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 05:08 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_c8cur.hiveserde_in_place_mzv7x: https://DATABRICKS_HOST/explore/data/ucx_c8cur/hiveserde_in_place_mzv7x 05:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_c8cur', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c8cur.hiveserde_in_place_mzv7x', metastore_id=None, name='hiveserde_in_place_mzv7x', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 05:08 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sbdqe: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sbdqe 05:08 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sbdqe', metastore_id=None, name='ucx_sbdqe', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 05:09 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.SFPJ/config.yml) doesn't exist. 05:09 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:09 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:09 INFO [databricks.labs.ucx.install] Fetching installations... 05:09 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.SFPJ is corrupted. Skipping... 05:09 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:09 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:13 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:13 INFO [databricks.labs.ucx.install] Installing UCX v0.28.3+620240716051339 05:13 INFO [databricks.labs.ucx.install] Creating ucx schemas... 05:14 INFO [databricks.labs.ucx.install] Creating dashboards... 05:14 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 05:14 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 05:14 DEBUG [databricks.labs.ucx.install] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration... 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/migration/main... 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:14 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:15 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 05:15 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:16 INFO [databricks.labs.ucx.install] Creating dashboard in /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 05:16 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 05:16 ERROR [databricks.labs.blueprint.parallel] installing components(PosixPath('/home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates'), parent_path='/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.SFPJ/dashboards') task failed: Timed out after 0:02:00 Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/install.py", line 543, in _create_dashboard dashboard = Dashboards(self._ws).deploy_dashboard( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/dashboards.py", line 875, in deploy_dashboard dashboard = self._ws.lakeview.create( File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/service/dashboards.py", line 714, in create res = self._api.do('POST', '/api/2.0/lakeview/dashboards', body=body, headers=headers) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 153, in do response = retryable(self._perform)(method, File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 54, in wrapper raise err File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 264, in _perform raise self._make_nicer_error(response=response, **payload) from None databricks.sdk.errors.platform.InternalError: A database error occurred during import-dashboard-new The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 59, in wrapper raise TimeoutError(f'Timed out after {timeout}') from last_err TimeoutError: Timed out after 0:02:00 05:16 ERROR [databricks.labs.blueprint.parallel] More than half 'installing components' tasks failed: 0% results available (0/6). Took 0:02:11.775885 05:16 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_storage_dir fixtures 05:16 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_storage_dir fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_mzv7x 05:16 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_dbfs_data_copy fixtures 05:16 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/NIKd 05:16 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 cluster fixtures 05:16 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 catalog fixtures 05:16 DEBUG [databricks.labs.ucx.mixins.fixtures] removing catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1721106527720, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c8cur', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_c8cur', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1721106527720, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 05:16 INFO [databricks.labs.ucx.install] Deleting UCX v0.28.3+620240716051339 from https://DATABRICKS_HOST 05:16 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_sbdqe 05:16 INFO [databricks.labs.ucx.install] Deleting jobs 05:16 ERROR [databricks.labs.ucx.install] No jobs present or jobs already deleted 05:16 INFO [databricks.labs.ucx.install] Deleting cluster policy 05:16 INFO [databricks.labs.ucx.install] Deleting secret scope 05:16 INFO [databricks.labs.ucx.install] UnInstalling UCX complete 05:16 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace user fixtures 05:16 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 account group fixtures 05:16 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures 05:16 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 05:16 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 table fixtures 05:16 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_mzv7x.parquet_serde_mzv7x', metastore_id=None, name='parquet_serde_mzv7x', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024071606'}, row_filter=None, schema_name='hiveserde_in_place_mzv7x', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_mzv7x/parquet_serde_mzv7x', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 05:16 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_mzv7x.orc_serde_mzv7x', metastore_id=None, name='orc_serde_mzv7x', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024071606'}, row_filter=None, schema_name='hiveserde_in_place_mzv7x', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_mzv7x/orc_serde_mzv7x', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 05:16 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_mzv7x.avro_serde_mzv7x', metastore_id=None, name='avro_serde_mzv7x', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024071606'}, row_filter=None, schema_name='hiveserde_in_place_mzv7x', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_mzv7x/avro_serde_mzv7x', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 05:16 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 schema fixtures 05:16 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.hiveserde_in_place_mzv7x', metastore_id=None, name='hiveserde_in_place_mzv7x', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 05:16 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_c8cur', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c8cur.hiveserde_in_place_mzv7x', metastore_id=None, name='hiveserde_in_place_mzv7x', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 05:16 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sbdqe', metastore_id=None, name='ucx_sbdqe', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw1] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```

_{Running from nightly #126}