databrickslabs / ucx

Your best companion for upgrading to Unity Catalog. UCX will guide you, the Databricks customer, through the process of upgrading your account, groups, workspaces, jobs etc. to Unity Catalog.
Other
193 stars 69 forks source link

Test failure: `test_table_migration_job` #1243

Closed github-actions[bot] closed 2 months ago

github-actions[bot] commented 3 months ago
❌ test_table_migration_job: AssertionError: ucx_tmvu6 and ucx_tuq77 not found in ucx_cezij.migrate_kdpld (15m55.905s) ``` AssertionError: ucx_tmvu6 and ucx_tuq77 not found in ucx_cezij.migrate_kdpld assert False [gw5] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 15:31 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.migrate_kdpld: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_kdpld 15:31 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_kdpld', metastore_id=None, name='migrate_kdpld', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:31 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_kdpld.ucx_tmvu6: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_kdpld/ucx_tmvu6 15:31 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_kdpld.ucx_tmvu6', metastore_id=None, name='ucx_tmvu6', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_kdpld', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_kdpld/ucx_tmvu6', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:31 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/CP7A 15:31 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_kdpld.ucx_tuq77: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_kdpld/ucx_tuq77 15:31 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_kdpld.ucx_tuq77', metastore_id=None, name='ucx_tuq77', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_kdpld', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/CP7A', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:31 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1712158273148, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cezij', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cezij', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1712158273148, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 15:31 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cezij.migrate_kdpld: https://DATABRICKS_HOST/explore/data/ucx_cezij/migrate_kdpld 15:31 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cezij', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cezij.migrate_kdpld', metastore_id=None, name='migrate_kdpld', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:31 INFO [databricks.labs.ucx.install] UCX v0.21.1+2020240403153114 is already installed on this workspace 15:31 INFO [databricks.labs.ucx.install] Installing UCX v0.21.1+2020240403153116 15:31 INFO [databricks.labs.ucx.install] Creating dashboards... 15:31 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 15:31 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [UCX] UCX Assessment (Estimates)... 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 01_0_group_migration.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 01_0_group_migration.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 00_0_metastore_assignment.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 00_0_metastore_assignment.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 02_0_data_modeling.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 02_0_data_modeling.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 03_0_data_migration.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 03_0_data_migration.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 15:31 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [UCX] UCX Assessment (Main)... 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 10___data_summary.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 10___data_summary.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 15___storage_summary.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 15___storage_summary.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 40___last_summary.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 40___last_summary.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 20___compute_summary.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 20___compute_summary.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 00___assessment_overview.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 00___assessment_overview.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 05___findings_summary.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 05___findings_summary.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 30_0_job_summary.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 30_0_job_summary.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 15:31 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [UCX] UCX Assessment (Azure)... 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 15:31 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [UCX] UCX Assessment (Interactive)... 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 00_0_interactive.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 00_0_interactive.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 02_0_cluster_summary.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 02_0_cluster_summary.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.installer.workflows] Creating jobs from tasks in main 15:31 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-tables-in-mounts-experimental job_id=306461221662319 15:31 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=remove-workspace-local-backup-groups job_id=305380664450782 15:31 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=099-destroy-schema job_id=224696121449609 15:31 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 15:31 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 15:31 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=assessment job_id=214896321057696 15:31 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-groups job_id=101805181676597 15:31 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-groups-experimental job_id=889666695827963 15:31 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-tables job_id=414863330163493 15:31 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=validate-groups-permissions job_id=46134509431868 15:31 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.ucx/README for the next steps. 15:32 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-tables job: https://DATABRICKS_HOST#job/414863330163493 15:32 DEBUG [databricks.labs.ucx.installer.workflows] Validating migrate-tables workflow: https://DATABRICKS_HOST#job/414863330163493 15:32 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion 15:31 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.migrate_kdpld: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_kdpld 15:31 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_kdpld', metastore_id=None, name='migrate_kdpld', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:31 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_kdpld.ucx_tmvu6: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_kdpld/ucx_tmvu6 15:31 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_kdpld.ucx_tmvu6', metastore_id=None, name='ucx_tmvu6', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_kdpld', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_kdpld/ucx_tmvu6', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:31 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/CP7A 15:31 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_kdpld.ucx_tuq77: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_kdpld/ucx_tuq77 15:31 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_kdpld.ucx_tuq77', metastore_id=None, name='ucx_tuq77', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_kdpld', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/CP7A', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:31 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1712158273148, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cezij', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cezij', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1712158273148, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 15:31 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cezij.migrate_kdpld: https://DATABRICKS_HOST/explore/data/ucx_cezij/migrate_kdpld 15:31 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cezij', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cezij.migrate_kdpld', metastore_id=None, name='migrate_kdpld', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:31 INFO [databricks.labs.ucx.install] UCX v0.21.1+2020240403153114 is already installed on this workspace 15:31 INFO [databricks.labs.ucx.install] Installing UCX v0.21.1+2020240403153116 15:31 INFO [databricks.labs.ucx.install] Creating dashboards... 15:31 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 15:31 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [UCX] UCX Assessment (Estimates)... 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 01_0_group_migration.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 01_0_group_migration.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 00_0_metastore_assignment.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 00_0_metastore_assignment.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 02_0_data_modeling.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 02_0_data_modeling.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 03_0_data_migration.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 03_0_data_migration.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 15:31 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [UCX] UCX Assessment (Main)... 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 10___data_summary.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 10___data_summary.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 15___storage_summary.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 15___storage_summary.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 40___last_summary.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 40___last_summary.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 20___compute_summary.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 20___compute_summary.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 00___assessment_overview.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 00___assessment_overview.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 05___findings_summary.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 05___findings_summary.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 30_0_job_summary.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 30_0_job_summary.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 15:31 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [UCX] UCX Assessment (Azure)... 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 15:31 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [UCX] UCX Assessment (Interactive)... 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 00_0_interactive.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 00_0_interactive.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 02_0_cluster_summary.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 02_0_cluster_summary.md because it's a text widget 15:31 DEBUG [databricks.labs.ucx.installer.workflows] Creating jobs from tasks in main 15:31 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-tables-in-mounts-experimental job_id=306461221662319 15:31 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=remove-workspace-local-backup-groups job_id=305380664450782 15:31 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=099-destroy-schema job_id=224696121449609 15:31 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 15:31 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 15:31 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=assessment job_id=214896321057696 15:31 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-groups job_id=101805181676597 15:31 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-groups-experimental job_id=889666695827963 15:31 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-tables job_id=414863330163493 15:31 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=validate-groups-permissions job_id=46134509431868 15:31 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.ucx/README for the next steps. 15:32 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-tables job: https://DATABRICKS_HOST#job/414863330163493 15:32 DEBUG [databricks.labs.ucx.installer.workflows] Validating migrate-tables workflow: https://DATABRICKS_HOST#job/414863330163493 15:32 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion 15:46 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_dbfs_data_copy fixtures 15:46 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/CP7A 15:46 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 table fixtures 15:46 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_kdpld.ucx_tmvu6', metastore_id=None, name='ucx_tmvu6', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_kdpld', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_kdpld/ucx_tmvu6', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:46 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_kdpld.ucx_tuq77', metastore_id=None, name='ucx_tuq77', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_kdpld', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/CP7A', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 15:46 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 schema fixtures 15:46 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_kdpld', metastore_id=None, name='migrate_kdpld', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:47 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cezij', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cezij.migrate_kdpld', metastore_id=None, name='migrate_kdpld', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 15:47 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 catalog fixtures 15:47 DEBUG [databricks.labs.ucx.mixins.fixtures] removing catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1712158273148, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cezij', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cezij', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1712158273148, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 15:47 INFO [databricks.labs.ucx.install] Deleting UCX v0.21.1+2020240403154700 from https://DATABRICKS_HOST 15:47 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_S4emd_migrate_inventory 15:47 INFO [databricks.labs.ucx.install] Deleting jobs 15:47 INFO [databricks.labs.ucx.install] Deleting assessment job_id=214896321057696. 15:47 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=101805181676597. 15:47 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=46134509431868. 15:47 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=414863330163493. 15:47 INFO [databricks.labs.ucx.install] Deleting 099-destroy-schema job_id=224696121449609. 15:47 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=889666695827963. 15:47 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=306461221662319. 15:47 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=305380664450782. 15:47 INFO [databricks.labs.ucx.install] Deleting cluster policy 15:47 INFO [databricks.labs.ucx.install] Deleting secret scope 15:47 INFO [databricks.labs.ucx.install] UnInstalling UCX complete [gw5] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```

Running from nightly #12

github-actions[bot] commented 3 months ago
❌ test_table_migration_job: databricks.sdk.errors.sdk.OperationFailed: failed to reach TERMINATED or SKIPPED, got RunLifeCycleState.INTERNAL_ERROR: Task migrate_external_tables_sync failed with message: Workload failed, see run output for details. This caused all downstream tasks to get skipped. (20m48.192s) ``` databricks.sdk.errors.sdk.OperationFailed: failed to reach TERMINATED or SKIPPED, got RunLifeCycleState.INTERNAL_ERROR: Task migrate_external_tables_sync failed with message: Workload failed, see run output for details. This caused all downstream tasks to get skipped. [gw4] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 16:26 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.migrate_n3mbd: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_n3mbd 16:26 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_n3mbd', metastore_id=None, name='migrate_n3mbd', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 16:26 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_n3mbd.ucx_t2c3o: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_n3mbd/ucx_t2c3o 16:26 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_n3mbd.ucx_t2c3o', metastore_id=None, name='ucx_t2c3o', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_n3mbd', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_n3mbd/ucx_t2c3o', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 16:26 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/tTyX 16:26 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_n3mbd.ucx_twyhp: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_n3mbd/ucx_twyhp 16:26 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_n3mbd.ucx_twyhp', metastore_id=None, name='ucx_twyhp', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_n3mbd', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/tTyX', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 16:26 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1712161603662, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cjwom', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cjwom', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1712161603662, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 16:26 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cjwom.migrate_n3mbd: https://DATABRICKS_HOST/explore/data/ucx_cjwom/migrate_n3mbd 16:26 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cjwom', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cjwom.migrate_n3mbd', metastore_id=None, name='migrate_n3mbd', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 16:26 INFO [databricks.labs.ucx.install] UCX v0.21.1+2120240403162645 is already installed on this workspace 16:26 INFO [databricks.labs.ucx.install] Installing UCX v0.21.1+2120240403162646 16:26 INFO [databricks.labs.ucx.install] Creating dashboards... 16:26 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 16:26 DEBUG [databricks.labs.ucx.framework.dashboards] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 16:26 DEBUG [databricks.labs.ucx.framework.dashboards] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 16:26 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 16:26 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [UCX] UCX Assessment (Estimates)... 16:26 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 01_0_group_migration.md because it's a text widget 16:26 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 01_0_group_migration.md because it's a text widget 16:26 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 00_0_metastore_assignment.md because it's a text widget 16:26 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 00_0_metastore_assignment.md because it's a text widget 16:26 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 02_0_data_modeling.md because it's a text widget 16:26 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 02_0_data_modeling.md because it's a text widget 16:26 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 03_0_data_migration.md because it's a text widget 16:26 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 03_0_data_migration.md because it's a text widget 16:26 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 16:26 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [UCX] UCX Assessment (Main)... 16:27 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 10___data_summary.md because it's a text widget 16:27 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 10___data_summary.md because it's a text widget 16:27 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 15___storage_summary.md because it's a text widget 16:27 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 15___storage_summary.md because it's a text widget 16:27 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 40___last_summary.md because it's a text widget 16:27 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 40___last_summary.md because it's a text widget 16:27 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 20___compute_summary.md because it's a text widget 16:27 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 20___compute_summary.md because it's a text widget 16:27 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 00___assessment_overview.md because it's a text widget 16:27 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 00___assessment_overview.md because it's a text widget 16:27 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 05___findings_summary.md because it's a text widget 16:27 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 05___findings_summary.md because it's a text widget 16:27 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 30_0_job_summary.md because it's a text widget 16:27 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 30_0_job_summary.md because it's a text widget 16:27 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 16:27 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [UCX] UCX Assessment (Azure)... 16:27 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 16:27 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [UCX] UCX Assessment (Interactive)... 16:27 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 00_0_interactive.md because it's a text widget 16:27 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 00_0_interactive.md because it's a text widget 16:27 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 02_0_cluster_summary.md because it's a text widget 16:27 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 02_0_cluster_summary.md because it's a text widget 16:27 DEBUG [databricks.labs.ucx.installer.workflows] Creating jobs from tasks in main 16:27 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-groups job_id=145053830212640 16:27 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=remove-workspace-local-backup-groups job_id=320624512784383 16:27 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 16:27 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 16:27 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=assessment job_id=543818631534250 16:27 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=099-destroy-schema job_id=20905337528316 16:27 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-tables job_id=128030905906255 16:27 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-tables-in-mounts-experimental job_id=529184335205499 16:27 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-groups-experimental job_id=128358812656105 16:27 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=validate-groups-permissions job_id=1120424648967123 16:27 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.ucx/README for the next steps. 16:27 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-tables job: https://DATABRICKS_HOST#job/128030905906255 16:27 DEBUG [databricks.labs.ucx.installer.workflows] Validating migrate-tables workflow: https://DATABRICKS_HOST#job/128030905906255 16:27 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion 16:26 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.migrate_n3mbd: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_n3mbd 16:26 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_n3mbd', metastore_id=None, name='migrate_n3mbd', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 16:26 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_n3mbd.ucx_t2c3o: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_n3mbd/ucx_t2c3o 16:26 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_n3mbd.ucx_t2c3o', metastore_id=None, name='ucx_t2c3o', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_n3mbd', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_n3mbd/ucx_t2c3o', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 16:26 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/tTyX 16:26 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_n3mbd.ucx_twyhp: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_n3mbd/ucx_twyhp 16:26 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_n3mbd.ucx_twyhp', metastore_id=None, name='ucx_twyhp', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_n3mbd', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/tTyX', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 16:26 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1712161603662, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cjwom', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cjwom', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1712161603662, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 16:26 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cjwom.migrate_n3mbd: https://DATABRICKS_HOST/explore/data/ucx_cjwom/migrate_n3mbd 16:26 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cjwom', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cjwom.migrate_n3mbd', metastore_id=None, name='migrate_n3mbd', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 16:26 INFO [databricks.labs.ucx.install] UCX v0.21.1+2120240403162645 is already installed on this workspace 16:26 INFO [databricks.labs.ucx.install] Installing UCX v0.21.1+2120240403162646 16:26 INFO [databricks.labs.ucx.install] Creating dashboards... 16:26 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 16:26 DEBUG [databricks.labs.ucx.framework.dashboards] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 16:26 DEBUG [databricks.labs.ucx.framework.dashboards] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 16:26 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 16:26 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [UCX] UCX Assessment (Estimates)... 16:26 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 01_0_group_migration.md because it's a text widget 16:26 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 01_0_group_migration.md because it's a text widget 16:26 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 00_0_metastore_assignment.md because it's a text widget 16:26 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 00_0_metastore_assignment.md because it's a text widget 16:26 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 02_0_data_modeling.md because it's a text widget 16:26 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 02_0_data_modeling.md because it's a text widget 16:26 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 03_0_data_migration.md because it's a text widget 16:26 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 03_0_data_migration.md because it's a text widget 16:26 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 16:26 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [UCX] UCX Assessment (Main)... 16:27 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 10___data_summary.md because it's a text widget 16:27 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 10___data_summary.md because it's a text widget 16:27 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 15___storage_summary.md because it's a text widget 16:27 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 15___storage_summary.md because it's a text widget 16:27 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 40___last_summary.md because it's a text widget 16:27 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 40___last_summary.md because it's a text widget 16:27 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 20___compute_summary.md because it's a text widget 16:27 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 20___compute_summary.md because it's a text widget 16:27 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 00___assessment_overview.md because it's a text widget 16:27 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 00___assessment_overview.md because it's a text widget 16:27 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 05___findings_summary.md because it's a text widget 16:27 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 05___findings_summary.md because it's a text widget 16:27 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 30_0_job_summary.md because it's a text widget 16:27 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 30_0_job_summary.md because it's a text widget 16:27 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 16:27 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [UCX] UCX Assessment (Azure)... 16:27 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 16:27 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [UCX] UCX Assessment (Interactive)... 16:27 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 00_0_interactive.md because it's a text widget 16:27 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 00_0_interactive.md because it's a text widget 16:27 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 02_0_cluster_summary.md because it's a text widget 16:27 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 02_0_cluster_summary.md because it's a text widget 16:27 DEBUG [databricks.labs.ucx.installer.workflows] Creating jobs from tasks in main 16:27 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-groups job_id=145053830212640 16:27 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=remove-workspace-local-backup-groups job_id=320624512784383 16:27 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 16:27 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 16:27 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=assessment job_id=543818631534250 16:27 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=099-destroy-schema job_id=20905337528316 16:27 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-tables job_id=128030905906255 16:27 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-tables-in-mounts-experimental job_id=529184335205499 16:27 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-groups-experimental job_id=128358812656105 16:27 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=validate-groups-permissions job_id=1120424648967123 16:27 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.ucx/README for the next steps. 16:27 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-tables job: https://DATABRICKS_HOST#job/128030905906255 16:27 DEBUG [databricks.labs.ucx.installer.workflows] Validating migrate-tables workflow: https://DATABRICKS_HOST#job/128030905906255 16:27 INFO [databricks.labs.ucx.installer.workflows] Identified a run in progress waiting for run completion 16:47 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_dbfs_data_copy fixtures 16:47 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/tTyX 16:47 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 table fixtures 16:47 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_n3mbd.ucx_t2c3o', metastore_id=None, name='ucx_t2c3o', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_n3mbd', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_n3mbd/ucx_t2c3o', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 16:47 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_n3mbd.ucx_twyhp', metastore_id=None, name='ucx_twyhp', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='migrate_n3mbd', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/tTyX', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 16:47 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 schema fixtures 16:47 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_n3mbd', metastore_id=None, name='migrate_n3mbd', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 16:47 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cjwom', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cjwom.migrate_n3mbd', metastore_id=None, name='migrate_n3mbd', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 16:47 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 catalog fixtures 16:47 DEBUG [databricks.labs.ucx.mixins.fixtures] removing catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1712161603662, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cjwom', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cjwom', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1712161603662, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 16:47 INFO [databricks.labs.ucx.install] Deleting UCX v0.21.1+2120240403164721 from https://DATABRICKS_HOST 16:47 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_SvzAL_migrate_inventory 16:47 INFO [databricks.labs.ucx.install] Deleting jobs 16:47 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=128358812656105. 16:47 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=145053830212640. 16:47 INFO [databricks.labs.ucx.install] Deleting 099-destroy-schema job_id=20905337528316. 16:47 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=128030905906255. 16:47 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=320624512784383. 16:47 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=529184335205499. 16:47 INFO [databricks.labs.ucx.install] Deleting assessment job_id=543818631534250. 16:47 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=1120424648967123. 16:47 INFO [databricks.labs.ucx.install] Deleting cluster policy 16:47 INFO [databricks.labs.ucx.install] Deleting secret scope 16:47 INFO [databricks.labs.ucx.install] UnInstalling UCX complete [gw4] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```

Running from nightly #13