Test failure: `test_table_migration_job_refreshes_migration_status[regular-migrate-tables]`

[github-actions[bot]]

❌ test_table_migration_job_refreshes_migration_status[regular-migrate-tables]: TimeoutError: Timed out after 0:05:00 (5m51.263s)

``` TimeoutError: Timed out after 0:05:00 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/ymQ7 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.migrate_ochuo: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_ochuo 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_ochuo', metastore_id=None, name='migrate_ochuo', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_ochuo.ucx_tnkkj: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_ochuo/ucx_tnkkj 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_ochuo.ucx_tnkkj', metastore_id=None, name='ucx_tnkkj', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070208'}, row_filter=None, schema_name='migrate_ochuo', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_ochuo/ucx_tnkkj', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_ochuo.ucx_tyxyi: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_ochuo/ucx_tyxyi 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_ochuo.ucx_tyxyi', metastore_id=None, name='ucx_tyxyi', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070208'}, row_filter=None, schema_name='migrate_ochuo', sql_path=None, storage_credential_name=None, storage_location='dbfs:/tmp/ucx_test_fiDP', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_ochuo.ucx_t7r2l: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_ochuo/ucx_t7r2l 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_ochuo.ucx_t7r2l', metastore_id=None, name='ucx_t7r2l', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070208'}, row_filter=None, schema_name='migrate_ochuo', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/ymQ7', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_ochuo.ucx_tvnsl: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_ochuo/ucx_tvnsl 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_ochuo.ucx_tvnsl', metastore_id=None, name='ucx_tvnsl', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070208'}, row_filter=None, schema_name='migrate_ochuo', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_ochuo.ucx_tnkkj', view_dependencies=None) 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_ochuo.ucx_tvdls: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_ochuo/ucx_tvdls 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_ochuo.ucx_tvdls', metastore_id=None, name='ucx_tvdls', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070208'}, row_filter=None, schema_name='migrate_ochuo', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_ochuo.ucx_tvnsl', view_dependencies=None) 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1719903888839, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ch0wv', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_ch0wv', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719903888839, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_ch0wv.migrate_ochuo: https://DATABRICKS_HOST/explore/data/ucx_ch0wv/migrate_ochuo 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_ch0wv', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ch0wv.migrate_ochuo', metastore_id=None, name='migrate_ochuo', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s4hxy: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s4hxy 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s4hxy', metastore_id=None, name='ucx_s4hxy', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw4] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/ymQ7 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.migrate_ochuo: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_ochuo 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_ochuo', metastore_id=None, name='migrate_ochuo', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_ochuo.ucx_tnkkj: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_ochuo/ucx_tnkkj 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_ochuo.ucx_tnkkj', metastore_id=None, name='ucx_tnkkj', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070208'}, row_filter=None, schema_name='migrate_ochuo', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_ochuo/ucx_tnkkj', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_ochuo.ucx_tyxyi: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_ochuo/ucx_tyxyi 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_ochuo.ucx_tyxyi', metastore_id=None, name='ucx_tyxyi', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070208'}, row_filter=None, schema_name='migrate_ochuo', sql_path=None, storage_credential_name=None, storage_location='dbfs:/tmp/ucx_test_fiDP', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_ochuo.ucx_t7r2l: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_ochuo/ucx_t7r2l 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_ochuo.ucx_t7r2l', metastore_id=None, name='ucx_t7r2l', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070208'}, row_filter=None, schema_name='migrate_ochuo', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/ymQ7', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_ochuo.ucx_tvnsl: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_ochuo/ucx_tvnsl 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_ochuo.ucx_tvnsl', metastore_id=None, name='ucx_tvnsl', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070208'}, row_filter=None, schema_name='migrate_ochuo', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_ochuo.ucx_tnkkj', view_dependencies=None) 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_ochuo.ucx_tvdls: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_ochuo/ucx_tvdls 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_ochuo.ucx_tvdls', metastore_id=None, name='ucx_tvdls', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070208'}, row_filter=None, schema_name='migrate_ochuo', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_ochuo.ucx_tvnsl', view_dependencies=None) 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1719903888839, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ch0wv', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_ch0wv', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719903888839, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_ch0wv.migrate_ochuo: https://DATABRICKS_HOST/explore/data/ucx_ch0wv/migrate_ochuo 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_ch0wv', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ch0wv.migrate_ochuo', metastore_id=None, name='migrate_ochuo', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s4hxy: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s4hxy 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s4hxy', metastore_id=None, name='ucx_s4hxy', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:05 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.IXFV/config.yml) doesn't exist. 07:05 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 07:05 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 07:05 INFO [databricks.labs.ucx.install] Fetching installations... 07:05 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.IXFV is corrupted. Skipping... 07:05 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 07:05 DEBUG [tests.integration.conftest] Waiting for clusters to start... 07:05 DEBUG [tests.integration.conftest] Waiting for clusters to start... 07:05 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+1320240702070514 07:05 INFO [databricks.labs.ucx.install] Creating ucx schemas... 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 07:05 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.IXFV/README for the next steps. 07:05 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-tables job: https://DATABRICKS_HOST#job/686900613443797 07:06 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+1320240702070514 07:06 INFO [databricks.labs.ucx.install] Creating ucx schemas... 07:07 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-groups job_id=293326564465132 07:07 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-external-hiveserde-tables-in-place-experimental job_id=494521018890606 07:07 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=validate-groups-permissions job_id=194973782483021 07:07 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=remove-workspace-local-backup-groups job_id=862486770899515 07:07 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=scan-tables-in-mounts-experimental job_id=683627035215238 07:07 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-external-tables-ctas job_id=656624939584238 07:07 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=assessment job_id=530447662841987 07:07 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=failing job_id=758338647449723 07:07 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-data-reconciliation job_id=322194297727155 07:07 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-tables job_id=686900613443797 07:07 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-groups-experimental job_id=886871455179292 07:07 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=experimental-workflow-linter job_id=96495236812015 07:07 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-tables-in-mounts-experimental job_id=145689153129871 07:07 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.IXFV/README for the next steps. 07:07 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-tables job: https://DATABRICKS_HOST#job/686900613443797 07:08 INFO [databricks.labs.ucx.installer.workflows] ---------- REMOTE LOGS -------------- 07:08 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+1320240702070514 07:08 INFO [databricks.labs.ucx.install] Creating ucx schemas... 07:08 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-groups job_id=293326564465132 07:08 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-external-hiveserde-tables-in-place-experimental job_id=494521018890606 07:08 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=validate-groups-permissions job_id=194973782483021 07:08 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=remove-workspace-local-backup-groups job_id=862486770899515 07:08 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=scan-tables-in-mounts-experimental job_id=683627035215238 07:08 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-external-tables-ctas job_id=656624939584238 07:08 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=assessment job_id=530447662841987 07:08 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=failing job_id=758338647449723 07:08 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-data-reconciliation job_id=322194297727155 07:08 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-tables job_id=686900613443797 07:08 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-groups-experimental job_id=886871455179292 07:08 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=experimental-workflow-linter job_id=96495236812015 07:08 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-tables-in-mounts-experimental job_id=145689153129871 07:08 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.IXFV/README for the next steps. 07:08 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-tables job: https://DATABRICKS_HOST#job/686900613443797 07:10 INFO [databricks.labs.ucx.installer.workflows] ---------- REMOTE LOGS -------------- 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/ymQ7 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.migrate_ochuo: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_ochuo 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_ochuo', metastore_id=None, name='migrate_ochuo', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_ochuo.ucx_tnkkj: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_ochuo/ucx_tnkkj 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_ochuo.ucx_tnkkj', metastore_id=None, name='ucx_tnkkj', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070208'}, row_filter=None, schema_name='migrate_ochuo', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_ochuo/ucx_tnkkj', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_ochuo.ucx_tyxyi: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_ochuo/ucx_tyxyi 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_ochuo.ucx_tyxyi', metastore_id=None, name='ucx_tyxyi', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070208'}, row_filter=None, schema_name='migrate_ochuo', sql_path=None, storage_credential_name=None, storage_location='dbfs:/tmp/ucx_test_fiDP', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_ochuo.ucx_t7r2l: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_ochuo/ucx_t7r2l 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_ochuo.ucx_t7r2l', metastore_id=None, name='ucx_t7r2l', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070208'}, row_filter=None, schema_name='migrate_ochuo', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/ymQ7', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_ochuo.ucx_tvnsl: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_ochuo/ucx_tvnsl 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_ochuo.ucx_tvnsl', metastore_id=None, name='ucx_tvnsl', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070208'}, row_filter=None, schema_name='migrate_ochuo', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_ochuo.ucx_tnkkj', view_dependencies=None) 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_ochuo.ucx_tvdls: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_ochuo/ucx_tvdls 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_ochuo.ucx_tvdls', metastore_id=None, name='ucx_tvdls', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070208'}, row_filter=None, schema_name='migrate_ochuo', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_ochuo.ucx_tvnsl', view_dependencies=None) 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1719903888839, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ch0wv', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_ch0wv', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719903888839, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_ch0wv.migrate_ochuo: https://DATABRICKS_HOST/explore/data/ucx_ch0wv/migrate_ochuo 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_ch0wv', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ch0wv.migrate_ochuo', metastore_id=None, name='migrate_ochuo', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s4hxy: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s4hxy 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s4hxy', metastore_id=None, name='ucx_s4hxy', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:05 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.IXFV/config.yml) doesn't exist. 07:05 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 07:05 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 07:05 INFO [databricks.labs.ucx.install] Fetching installations... 07:05 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.IXFV is corrupted. Skipping... 07:05 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 07:05 DEBUG [tests.integration.conftest] Waiting for clusters to start... 07:05 DEBUG [tests.integration.conftest] Waiting for clusters to start... 07:05 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+1320240702070514 07:05 INFO [databricks.labs.ucx.install] Creating ucx schemas... 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 07:05 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.IXFV/README for the next steps. 07:05 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-tables job: https://DATABRICKS_HOST#job/686900613443797 07:06 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+1320240702070514 07:06 INFO [databricks.labs.ucx.install] Creating ucx schemas... 07:07 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-groups job_id=293326564465132 07:07 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-external-hiveserde-tables-in-place-experimental job_id=494521018890606 07:07 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=validate-groups-permissions job_id=194973782483021 07:07 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=remove-workspace-local-backup-groups job_id=862486770899515 07:07 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=scan-tables-in-mounts-experimental job_id=683627035215238 07:07 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-external-tables-ctas job_id=656624939584238 07:07 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=assessment job_id=530447662841987 07:07 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=failing job_id=758338647449723 07:07 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-data-reconciliation job_id=322194297727155 07:07 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-tables job_id=686900613443797 07:07 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-groups-experimental job_id=886871455179292 07:07 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=experimental-workflow-linter job_id=96495236812015 07:07 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-tables-in-mounts-experimental job_id=145689153129871 07:07 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.IXFV/README for the next steps. 07:07 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-tables job: https://DATABRICKS_HOST#job/686900613443797 07:08 INFO [databricks.labs.ucx.installer.workflows] ---------- REMOTE LOGS -------------- 07:08 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+1320240702070514 07:08 INFO [databricks.labs.ucx.install] Creating ucx schemas... 07:08 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-groups job_id=293326564465132 07:08 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-external-hiveserde-tables-in-place-experimental job_id=494521018890606 07:08 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=validate-groups-permissions job_id=194973782483021 07:08 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=remove-workspace-local-backup-groups job_id=862486770899515 07:08 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=scan-tables-in-mounts-experimental job_id=683627035215238 07:08 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-external-tables-ctas job_id=656624939584238 07:08 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=assessment job_id=530447662841987 07:08 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=failing job_id=758338647449723 07:08 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-data-reconciliation job_id=322194297727155 07:08 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-tables job_id=686900613443797 07:08 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-groups-experimental job_id=886871455179292 07:08 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=experimental-workflow-linter job_id=96495236812015 07:08 INFO [databricks.labs.ucx.installer.workflows] Updating configuration for step=migrate-tables-in-mounts-experimental job_id=145689153129871 07:08 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.IXFV/README for the next steps. 07:08 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-tables job: https://DATABRICKS_HOST#job/686900613443797 07:10 INFO [databricks.labs.ucx.installer.workflows] ---------- REMOTE LOGS -------------- 07:10 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 make_storage_dir fixtures 07:10 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_dbfs_data_copy fixtures 07:10 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/ymQ7 07:10 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 cluster fixtures 07:10 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 catalog fixtures 07:10 DEBUG [databricks.labs.ucx.mixins.fixtures] removing catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1719903888839, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ch0wv', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_ch0wv', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719903888839, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 07:10 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while catalog CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1719903888839, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ch0wv', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_ch0wv', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719903888839, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') teardown: Catalog 'ucx_ch0wv' does not exist. 07:10 INFO [databricks.labs.ucx.install] Deleting UCX v0.27.2+1320240702070514 from https://DATABRICKS_HOST 07:10 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_s4hxy 07:10 INFO [databricks.labs.ucx.install] Deleting jobs 07:10 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=293326564465132. 07:10 INFO [databricks.labs.ucx.install] Deleting migrate-external-hiveserde-tables-in-place-experimental job_id=494521018890606. 07:10 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=194973782483021. 07:10 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=862486770899515. 07:10 INFO [databricks.labs.ucx.install] Deleting scan-tables-in-mounts-experimental job_id=683627035215238. 07:10 INFO [databricks.labs.ucx.install] Deleting migrate-external-tables-ctas job_id=656624939584238. 07:10 INFO [databricks.labs.ucx.install] Deleting assessment job_id=530447662841987. 07:10 INFO [databricks.labs.ucx.install] Deleting failing job_id=758338647449723. 07:10 INFO [databricks.labs.ucx.install] Deleting migrate-data-reconciliation job_id=322194297727155. 07:10 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=686900613443797. 07:10 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=886871455179292. 07:10 INFO [databricks.labs.ucx.install] Deleting experimental-workflow-linter job_id=96495236812015. 07:10 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=145689153129871. 07:10 INFO [databricks.labs.ucx.install] Deleting cluster policy 07:10 ERROR [databricks.labs.ucx.install] UCX Policy already deleted 07:10 INFO [databricks.labs.ucx.install] Deleting secret scope 07:10 INFO [databricks.labs.ucx.install] UnInstalling UCX complete 07:10 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace user fixtures 07:10 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 account group fixtures 07:10 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures 07:10 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 07:10 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 5 table fixtures 07:10 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_ochuo.ucx_tnkkj', metastore_id=None, name='ucx_tnkkj', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070208'}, row_filter=None, schema_name='migrate_ochuo', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_ochuo/ucx_tnkkj', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:10 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_ochuo.ucx_tyxyi', metastore_id=None, name='ucx_tyxyi', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070208'}, row_filter=None, schema_name='migrate_ochuo', sql_path=None, storage_credential_name=None, storage_location='dbfs:/tmp/ucx_test_fiDP', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:10 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_ochuo.ucx_t7r2l', metastore_id=None, name='ucx_t7r2l', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070208'}, row_filter=None, schema_name='migrate_ochuo', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/ymQ7', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:10 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_ochuo.ucx_tvnsl', metastore_id=None, name='ucx_tvnsl', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070208'}, row_filter=None, schema_name='migrate_ochuo', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_ochuo.ucx_tnkkj', view_dependencies=None) 07:10 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while table TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_ochuo.ucx_tvnsl', metastore_id=None, name='ucx_tvnsl', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070208'}, row_filter=None, schema_name='migrate_ochuo', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_ochuo.ucx_tnkkj', view_dependencies=None) teardown: [WRONG_COMMAND_FOR_OBJECT_TYPE] The operation DROP TABLE requires a EXTERNAL or MANAGED. But hive_metastore.migrate_ochuo.ucx_tvnsl is a VIEW. Use DROP VIEW instead. SQLSTATE: 42809 07:10 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_ochuo.ucx_tvdls', metastore_id=None, name='ucx_tvdls', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070208'}, row_filter=None, schema_name='migrate_ochuo', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_ochuo.ucx_tvnsl', view_dependencies=None) 07:10 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while table TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_ochuo.ucx_tvdls', metastore_id=None, name='ucx_tvdls', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070208'}, row_filter=None, schema_name='migrate_ochuo', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_ochuo.ucx_tvnsl', view_dependencies=None) teardown: [WRONG_COMMAND_FOR_OBJECT_TYPE] The operation DROP TABLE requires a EXTERNAL or MANAGED. But hive_metastore.migrate_ochuo.ucx_tvdls is a VIEW. Use DROP VIEW instead. SQLSTATE: 42809 07:10 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 schema fixtures 07:10 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_ochuo', metastore_id=None, name='migrate_ochuo', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:10 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_ch0wv', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ch0wv.migrate_ochuo', metastore_id=None, name='migrate_ochuo', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:10 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s4hxy', metastore_id=None, name='ucx_s4hxy', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw4] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```

_{Running from nightly #109}

[JCZuurmond]

From the job run

UCX v0.27.2+1320240702082541

08:32:42  INFO [d.labs.ucx] UCX v0.27.2+1320240702082541 After job finishes, see debug logs at /Workspace/Users/REDACTED/.GxSA/logs/migrate-tables/run-510503637132105-0/migrate_views.log
08:32:42  WARN [d.l.u.assessment.secrets] Secret in config stored in plaintext.
08:32:42  WARN [d.l.u.assessment.secrets] Secret in config stored in plaintext.
08:33:04  INFO [d.l.blueprint.parallel][checking_databases_for_skip_property_0] checking databases for skip property 1/1, rps: 3.579/sec
08:33:04  INFO [d.l.blueprint.parallel] Finished 'checking databases for skip property' tasks: 100% results available (1/1). Took 0:00:00.291709
08:33:04  INFO [d.l.u.hive_metastore.mapping][checking_all_database_properties_0] The intended target for hive_metastore.migrate_f0o7k.ucx_tmii3, ucx_cnpit.migrate_f0o7k.ucx_tmii3, already exists.
08:33:04  INFO [d.l.u.hive_metastore.mapping][checking_all_database_properties_1] The intended target for hive_metastore.migrate_f0o7k.ucx_t0pck, ucx_cnpit.migrate_f0o7k.ucx_t0pck, already exists.
08:33:04  INFO [d.l.u.hive_metastore.mapping][checking_all_database_properties_2] The intended target for hive_metastore.migrate_f0o7k.ucx_tuf86, ucx_cnpit.migrate_f0o7k.ucx_tuf86, already exists.
08:33:05  INFO [d.l.blueprint.parallel][checking_all_database_properties_3] checking all database properties 5/5, rps: 5.394/sec
08:33:05  INFO [d.l.blueprint.parallel] Finished 'checking all database properties' tasks: 40% results available (2/5). Took 0:00:00.937029
08:33:18  INFO [d.l.u.hive_metastore.migration_status] migrate_f0o7k.ucx_tmii3 is set as migrated
08:33:18  INFO [d.l.u.hive_metastore.migration_status] migrate_f0o7k.ucx_t0pck is set as migrated
08:33:19  INFO [d.l.u.hive_metastore.migration_status] migrate_f0o7k.ucx_tuf86 is set as migrated
08:33:34  INFO [d.l.u.hive_metastore.migration_status][migrate_views_0] migrate_f0o7k.ucx_tmii3 is set as migrated
08:33:34  INFO [d.l.u.hive_metastore.migration_status][migrate_views_0] migrate_f0o7k.ucx_t0pck is set as migrated
08:33:34  INFO [d.l.u.hive_metastore.migration_status][migrate_views_0] migrate_f0o7k.ucx_tuf86 is set as migrated

UCX v0.27.2+1320240702082541

08:32:42  INFO [d.labs.ucx] UCX v0.27.2+1320240702082541 After job finishes, see debug logs at /Workspace/Users/REDACTED/.GxSA/logs/migrate-tables/run-510503637132105-0/migrate_views.log
08:32:42  WARN [d.l.u.assessment.secrets] Secret in config stored in plaintext.
08:32:42  WARN [d.l.u.assessment.secrets] Secret in config stored in plaintext.
08:33:04  INFO [d.l.blueprint.parallel][checking_databases_for_skip_property_0] checking databases for skip property 1/1, rps: 3.579/sec
08:33:04  INFO [d.l.blueprint.parallel] Finished 'checking databases for skip property' tasks: 100% results available (1/1). Took 0:00:00.291709
08:33:04  INFO [d.l.u.hive_metastore.mapping][checking_all_database_properties_0] The intended target for hive_metastore.migrate_f0o7k.ucx_tmii3, ucx_cnpit.migrate_f0o7k.ucx_tmii3, already exists.
08:33:04  INFO [d.l.u.hive_metastore.mapping][checking_all_database_properties_1] The intended target for hive_metastore.migrate_f0o7k.ucx_t0pck, ucx_cnpit.migrate_f0o7k.ucx_t0pck, already exists.
08:33:04  INFO [d.l.u.hive_metastore.mapping][checking_all_database_properties_2] The intended target for hive_metastore.migrate_f0o7k.ucx_tuf86, ucx_cnpit.migrate_f0o7k.ucx_tuf86, already exists.
08:33:05  INFO [d.l.blueprint.parallel][checking_all_database_properties_3] checking all database properties 5/5, rps: 5.394/sec
08:33:05  INFO [d.l.blueprint.parallel] Finished 'checking all database properties' tasks: 40% results available (2/5). Took 0:00:00.937029
08:33:18  INFO [d.l.u.hive_metastore.migration_status] migrate_f0o7k.ucx_tmii3 is set as migrated
08:33:18  INFO [d.l.u.hive_metastore.migration_status] migrate_f0o7k.ucx_t0pck is set as migrated
08:33:19  INFO [d.l.u.hive_metastore.migration_status] migrate_f0o7k.ucx_tuf86 is set as migrated
08:33:34  INFO [d.l.u.hive_metastore.migration_status][migrate_views_0] migrate_f0o7k.ucx_tmii3 is set as migrated
08:33:34  INFO [d.l.u.hive_metastore.migration_status][migrate_views_0] migrate_f0o7k.ucx_t0pck is set as migrated
08:33:34  INFO [d.l.u.hive_metastore.migration_status][migrate_views_0] migrate_f0o7k.ucx_tuf86 is set as migrated
08:33:39  WARN [sqlglot][migrate_views_0] 'CREATE VIEW migrate_f0o7k.ucx_tq5d5 (
  id,
  value)
TBLPROPERTIES (
  'RemoveAfter' = '2024070209',' contains unsupported syntax. Falling back to parsing as a 'Command'.
08:33:39  WARN [sqlglot][migrate_views_0] 'CREATE VIEW migrate_f0o7k.ucx_tq5d5 (
  id,
  value)
TBLPROPERTIES (
  'RemoveAfter' = '2024070209',' contains unsupported syntax. Falling back to parsing as a 'Command'.
08:33:39 ERROR [d.l.blueprint.parallel][migrate_views_0] migrate views(ViewToMigrate(src=Table(catalog='hive_metastore', database='migrate_f0o7k', name='ucx_tq5d5', object_type='VIEW', table_format='', location='', view_text="CREATE VIEW migrate_f0o7k.ucx_tq5d5 (\n  id,\n  value)\nTBLPROPERTIES (\n  'RemoveAfter' = '2024070209',\n  'transient_lastDdlTime' = '1719908664')\nWITH SCHEMA BINDING\nAS SELECT * FROM hive_metastore.migrate_f0o7k.ucx_tmii3\n", upgraded_to=None, storage_properties=None, is_partitioned=False), rule=Rule(workspace_name='workspace', catalog_name='ucx_cnpit', src_schema='migrate_f0o7k', dst_schema='migrate_f0o7k', src_table='ucx_tq5d5', dst_table='ucx_tq5d5', recon_tolerance_percent=0, compare_rows=False)), [Grant(principal='REDACTED', action_type='ALL PRIVILEGES', catalog='hive_metastore', database='migrate_f0o7k', table=None, view='ucx_tq5d5', udf=None, any_file=False, anonymous_function=False), Grant(principal='ucx_GPat8', action_type='ALL PRIVILEGES', catalog='hive_metastore', database='migrate_f0o7k', table=None, view='ucx_tq5d5', udf=None, any_file=False, anonymous_function=False), Grant(principal='sdk-5cltrfst@example.com', action_type='ALL PRIVILEGES', catalog='hive_metastore', database='migrate_f0o7k', table=None, view='ucx_tq5d5', udf=None, any_file=False, anonymous_function=False), Grant(principal='ucx_G2mUT', action_type='ALL PRIVILEGES', catalog='hive_metastore', database='migrate_f0o7k', table=None, view='ucx_tq5d5', udf=None, any_file=False, anonymous_function=False), Grant(principal='sdk-ixyvumbd@example.com', action_type='ALL PRIVILEGES', catalog='hive_metastore', database='migrate_f0o7k', table=None, view='ucx_tq5d5', udf=None, any_file=False, anonymous_function=False), Grant(principal='REDACTED', action_type='ALL PRIVILEGES', catalog='hive_metastore', database='migrate_f0o7k', table=None, view='ucx_tq5d5', udf=None, any_file=False, anonymous_function=False)]) task failed: Expected a CREATE statement: Traceback (most recent call last):
  File "/local_disk0/.ephemeral_nfs/cluster_libraries/python/lib/python3.11/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner
    return func(*args, **kwargs), None
           ^^^^^^^^^^^^^^^^^^^^^
  File "/local_disk0/.ephemeral_nfs/cluster_libraries/python/lib/python3.11/site-packages/databricks/labs/ucx/hive_metastore/table_migrate.py", line 201, in _migrate_view
    return self._migrate_view_table(src_view, grants)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/local_disk0/.ephemeral_nfs/cluster_libraries/python/lib/python3.11/site-packages/databricks/labs/ucx/hive_metastore/table_migrate.py", line 214, in _migrate_view_table
    view_migrate_sql = self._sql_migrate_view(src_view)
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/local_disk0/.ephemeral_nfs/cluster_libraries/python/lib/python3.11/site-packages/databricks/labs/ucx/hive_metastore/table_migrate.py", line 233, in _sql_migrate_view
    return src_view.sql_migrate_view(self.index())
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/local_disk0/.ephemeral_nfs/cluster_libraries/python/lib/python3.11/site-packages/databricks/labs/ucx/hive_metastore/view_migrate.py", line 62, in sql_migrate_view
    assert isinstance(create, expressions.Create), 'Expected a CREATE statement'
AssertionError: Expected a CREATE statement
08:33:39  INFO [d.l.blueprint.parallel][migrate_views_0] migrate views 1/1, rps: 0.061/sec
08:33:39 FATAL [d.l.blueprint.parallel] All 'migrate views' tasks failed!!!
08:33:39 ERROR [d.labs.ucx] Execute `databricks workspace export //Users/REDACTED/.GxSA/logs/migrate-tables/run-510503637132105-0/migrate_views.log` locally to troubleshoot with more details. Expected a CREATE statement

[github-actions[bot]]

❌ test_table_migration_job_refreshes_migration_status[regular-migrate-tables]: AssertionError: No migration statuses found (2m48.285s)

``` AssertionError: No migration statuses found assert False databricks.sdk.errors.platform.ResourceDoesNotExist: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.l6hv) doesn't exist. 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/agNs 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.migrate_ejdqi: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_ejdqi 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_ejdqi', metastore_id=None, name='migrate_ejdqi', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_ejdqi.ucx_tpqe4: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_ejdqi/ucx_tpqe4 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_ejdqi.ucx_tpqe4', metastore_id=None, name='ucx_tpqe4', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070308'}, row_filter=None, schema_name='migrate_ejdqi', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_ejdqi/ucx_tpqe4', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_ejdqi.ucx_tvmrf: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_ejdqi/ucx_tvmrf 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_ejdqi.ucx_tvmrf', metastore_id=None, name='ucx_tvmrf', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070308'}, row_filter=None, schema_name='migrate_ejdqi', sql_path=None, storage_credential_name=None, storage_location='dbfs:/tmp/ucx_test_4is6', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_ejdqi.ucx_tijyo: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_ejdqi/ucx_tijyo 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_ejdqi.ucx_tijyo', metastore_id=None, name='ucx_tijyo', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070308'}, row_filter=None, schema_name='migrate_ejdqi', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/agNs', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_ejdqi.ucx_tlwcf: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_ejdqi/ucx_tlwcf 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_ejdqi.ucx_tlwcf', metastore_id=None, name='ucx_tlwcf', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070308'}, row_filter=None, schema_name='migrate_ejdqi', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_ejdqi.ucx_tpqe4', view_dependencies=None) 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_ejdqi.ucx_tkdvs: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_ejdqi/ucx_tkdvs 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_ejdqi.ucx_tkdvs', metastore_id=None, name='ucx_tkdvs', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070308'}, row_filter=None, schema_name='migrate_ejdqi', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_ejdqi.ucx_tlwcf', view_dependencies=None) 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1719990294056, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_chz37', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_chz37', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719990294056, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_chz37.migrate_ejdqi: https://DATABRICKS_HOST/explore/data/ucx_chz37/migrate_ejdqi 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_chz37', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_chz37.migrate_ejdqi', metastore_id=None, name='migrate_ejdqi', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sjxqh: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sjxqh 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sjxqh', metastore_id=None, name='ucx_sjxqh', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw6] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/agNs 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.migrate_ejdqi: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_ejdqi 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_ejdqi', metastore_id=None, name='migrate_ejdqi', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_ejdqi.ucx_tpqe4: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_ejdqi/ucx_tpqe4 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_ejdqi.ucx_tpqe4', metastore_id=None, name='ucx_tpqe4', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070308'}, row_filter=None, schema_name='migrate_ejdqi', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_ejdqi/ucx_tpqe4', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_ejdqi.ucx_tvmrf: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_ejdqi/ucx_tvmrf 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_ejdqi.ucx_tvmrf', metastore_id=None, name='ucx_tvmrf', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070308'}, row_filter=None, schema_name='migrate_ejdqi', sql_path=None, storage_credential_name=None, storage_location='dbfs:/tmp/ucx_test_4is6', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_ejdqi.ucx_tijyo: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_ejdqi/ucx_tijyo 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_ejdqi.ucx_tijyo', metastore_id=None, name='ucx_tijyo', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070308'}, row_filter=None, schema_name='migrate_ejdqi', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/agNs', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_ejdqi.ucx_tlwcf: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_ejdqi/ucx_tlwcf 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_ejdqi.ucx_tlwcf', metastore_id=None, name='ucx_tlwcf', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070308'}, row_filter=None, schema_name='migrate_ejdqi', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_ejdqi.ucx_tpqe4', view_dependencies=None) 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_ejdqi.ucx_tkdvs: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_ejdqi/ucx_tkdvs 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_ejdqi.ucx_tkdvs', metastore_id=None, name='ucx_tkdvs', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070308'}, row_filter=None, schema_name='migrate_ejdqi', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_ejdqi.ucx_tlwcf', view_dependencies=None) 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1719990294056, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_chz37', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_chz37', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719990294056, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_chz37.migrate_ejdqi: https://DATABRICKS_HOST/explore/data/ucx_chz37/migrate_ejdqi 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_chz37', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_chz37.migrate_ejdqi', metastore_id=None, name='migrate_ejdqi', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sjxqh: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sjxqh 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sjxqh', metastore_id=None, name='ucx_sjxqh', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:05 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.l6hv/config.yml) doesn't exist. 07:05 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 07:05 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 07:05 INFO [databricks.labs.ucx.install] Fetching installations... 07:05 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.l6hv is corrupted. Skipping... 07:05 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 07:05 DEBUG [tests.integration.conftest] Waiting for clusters to start... 07:05 DEBUG [tests.integration.conftest] Waiting for clusters to start... 07:05 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+6720240703070525 07:05 INFO [databricks.labs.ucx.install] Creating ucx schemas... 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 07:05 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.l6hv/README for the next steps. 07:05 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-tables job: https://DATABRICKS_HOST#job/1011684138859603 07:07 INFO [databricks.labs.ucx:migrate_dbfs_root_delta_tables] UCX v0.27.2+6720240703070525 After job finishes, see debug logs at /Workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.l6hv/logs/migrate-tables/run-677703057440921-0/migrate_dbfs_root_delta_tables.log 07:07 DEBUG [databricks.sdk:migrate_dbfs_root_delta_tables] GET /api/2.0/clusters/list < 200 OK < { < "clusters": [ < { < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": { < "availability": "SPOT_WITH_FALLBACK_AZURE", < "first_on_demand": 2147483647, < "spot_bid_max_price": -1.0 < }, < "cluster_cores": 4.0, < "cluster_id": "DATABRICKS_CLUSTER_ID", < "cluster_memory_mb": 16384, < "cluster_name": "DEFAULT Test Cluster (Single Node, No Isolation)", < "cluster_source": "UI", < "creator_user_name": "serge.smertin@databricks.com", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "TEST_SCHEMA_tags": { < "Budget": "opex.sales.labs", < "ClusterId": "DATABRICKS_CLUSTER_ID", < "ClusterName": "DEFAULT Test Cluster (Single Node, No Isolation)", < "Creator": "serge.smertin@databricks.com", < "DatabricksInstanceGroupId": "-6814024147286011579", < "DatabricksInstancePoolCreatorId": "4183391249163402", < "DatabricksInstancePoolId": "TEST_INSTANCE_POOL_ID", < "Owner": "labs-oss@databricks.com", < "Vendor": "Databricks" < }, < "disk_spec": {}, < "driver": { < "host_private_ip": "10.139.0.11", < "instance_id": "18169d6aa00940739ce82876d2df4ca5", < "node_attributes": { < "is_spot": false < }, < "node_id": "e8742f800d344cd498d0878b8d3af9e0", < "private_ip": "10.139.64.14", < "public_dns": "172.176.139.94", < "start_timestamp": 1719987394445 < }, < "driver_healthy": true, < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "driver_instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "driver_node_type_id": "Standard_D4s_v3", < "effective_spark_version": "15.2.x-scala2.12", < "enable_elastic_disk": true, < "enable_local_disk_encryption": false, < "init_scripts_safe_mode": false, < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "jdbc_port": 10000, < "last_activity_time": 1719987534730, < "last_restarted_time": 1719987500169, < "last_state_loss_time": 1719987500111, < "node_type_id": "Standard_D4s_v3", < "num_workers": 0, < "pinned_by_user_name": "4183391249163402", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_context_id": 5445134623901475951, < "spark_version": "15.2.x-scala2.12", < "start_time": 1711403415696, < "state": "RUNNING", < "state_message": "" < }, < "... (9 additional elements)" < ] < } 07:07 WARNING [databricks.labs.ucx.assessment.secrets:migrate_dbfs_root_delta_tables] Secret in config stored in plaintext. 07:07 DEBUG [databricks.sdk:migrate_dbfs_root_delta_tables] GET /api/2.1/unity-catalog/external-locations < 200 OK < { < "external_locations": [ < { < "created_at": 1712317369786, < "created_by": "serge.smertin@databricks.com", < "credential_id": "462bd121-a3ff-4f51-899f-236868f3d2ab", < "credential_name": "TEST_STORAGE_CREDENTIAL", < "full_name": "TEST_A_LOCATION", < "id": "98c25265-fb0f-4b15-a727-63855b7f78a7", < "isolation_mode": "ISOLATION_MODE_OPEN", < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "TEST_A_LOCATION", < "owner": "labs.scope.account-admin", < "read_only": false, < "securable_kind": "EXTERNAL_LOCATION_STANDARD", < "securable_type": "EXTERNAL_LOCATION", < "updated_at": 1712566812808, < "updated_by": "serge.smertin@databricks.com", < "url": "TEST_MOUNT_CONTAINER/a" < }, < "... (3 additional elements)" < ] < } 07:07 DEBUG [databricks.labs.blueprint.installation:migrate_dbfs_root_delta_tables] Loading list from CLOUD_ENV_storage_account_info.csv 07:07 DEBUG [databricks.sdk:migrate_dbfs_root_delta_tables] GET /api/2.0/workspace/export?path=/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.l6hv/CLOUD_ENV_storage_account_info.csv&direct_download=true < 200 OK < [raw stream] 07:07 DEBUG [databricks.labs.ucx.framework.crawlers:migrate_dbfs_root_delta_tables] [hive_metastore.ucx_sjxqh.grants] fetching grants inventory 07:07 DEBUG [databricks.labs.lsql.backends:migrate_dbfs_root_delta_tables] [spark][fetch] SELECT * FROM hive_metastore.ucx_sjxqh.grants 07:07 DEBUG [databricks.labs.ucx.framework.crawlers:migrate_dbfs_root_delta_tables] [hive_metastore.ucx_sjxqh.groups] fetching groups inventory 07:07 DEBUG [databricks.labs.lsql.backends:migrate_dbfs_root_delta_tables] [spark][fetch] SELECT * FROM hive_metastore.ucx_sjxqh.groups 07:07 DEBUG [databricks.labs.ucx.framework.crawlers:migrate_dbfs_root_delta_tables] [hive_metastore.ucx_sjxqh.tables] fetching tables inventory 07:07 DEBUG [databricks.labs.lsql.backends:migrate_dbfs_root_delta_tables] [spark][fetch] SELECT * FROM hive_metastore.ucx_sjxqh.tables 07:07 DEBUG [databricks.labs.ucx.framework.crawlers:migrate_dbfs_root_delta_tables] [hive_metastore.ucx_sjxqh.mounts] fetching mounts inventory 07:07 DEBUG [databricks.labs.lsql.backends:migrate_dbfs_root_delta_tables] [spark][fetch] SELECT * FROM ucx_sjxqh.mounts 07:07 ERROR [databricks.labs.ucx:migrate_dbfs_root_delta_tables] Execute `databricks workspace export //Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.l6hv/logs/migrate-tables/run-677703057440921-0/migrate_dbfs_root_delta_tables.log` locally to troubleshoot with more details. 07:07 DEBUG [databricks:migrate_dbfs_root_delta_tables] Task crash details Traceback (most recent call last): File "/local_disk0/.ephemeral_nfs/envs/pythonEnv-46b1c4d9-3191-456b-9e4f-5f4f8b9b5aae/lib/python3.11/site-packages/databricks/labs/ucx/runtime.py", line 100, in trigger current_task(ctx) File "/local_disk0/.ephemeral_nfs/envs/pythonEnv-46b1c4d9-3191-456b-9e4f-5f4f8b9b5aae/lib/python3.11/site-packages/databricks/labs/ucx/hive_metastore/workflows.py", line 29, in migrate_dbfs_root_delta_tables ctx.tables_migrator.migrate_tables( File "/local_disk0/.ephemeral_nfs/envs/pythonEnv-46b1c4d9-3191-456b-9e4f-5f4f8b9b5aae/lib/python3.11/site-packages/databricks/labs/ucx/hive_metastore/table_migrate.py", line 80, in migrate_tables all_principal_grants = None if acl_strategy is None else self._principal_grants.get_interactive_cluster_grants() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/local_disk0/.ephemeral_nfs/envs/pythonEnv-46b1c4d9-3191-456b-9e4f-5f4f8b9b5aae/lib/python3.11/site-packages/databricks/labs/ucx/hive_metastore/grants.py", line 551, in get_interactive_cluster_grants mounts = list(self._mounts_crawler.snapshot()) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/local_disk0/.ephemeral_nfs/envs/pythonEnv-46b1c4d9-3191-456b-9e4f-5f4f8b9b5aae/lib/python3.11/site-packages/databricks/labs/ucx/hive_metastore/locations.py", line 252, in snapshot return self._snapshot(self._try_fetch, self._list_mounts) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/local_disk0/.ephemeral_nfs/envs/pythonEnv-46b1c4d9-3191-456b-9e4f-5f4f8b9b5aae/lib/python3.11/site-packages/databricks/labs/ucx/framework/crawlers.py", line 110, in _snapshot cached_results = list(fetcher()) ^^^^^^^^^^^^^^^ File "/local_disk0/.ephemeral_nfs/envs/pythonEnv-46b1c4d9-3191-456b-9e4f-5f4f8b9b5aae/lib/python3.11/site-packages/databricks/labs/ucx/hive_metastore/locations.py", line 255, in _try_fetch for row in self._fetch( ^^^^^^^^^^^^ File "/local_disk0/.ephemeral_nfs/envs/pythonEnv-46b1c4d9-3191-456b-9e4f-5f4f8b9b5aae/lib/python3.11/site-packages/databricks/labs/lsql/backends.py", line 211, in fetch return iter(self._spark.sql(sql).collect()) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/databricks/spark/python/pyspark/sql/connect/dataframe.py", line 1838, in collect table, schema = self._to_table() ^^^^^^^^^^^^^^^^ File "/databricks/spark/python/pyspark/sql/connect/dataframe.py", line 1873, in _to_table table, schema = self._session.client.to_table(query, self._plan.observations) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/databricks/spark/python/pyspark/sql/connect/client/core.py", line 1051, in to_table table, schema, _, _, _ = self._execute_and_fetch(req, observations) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/databricks/spark/python/pyspark/sql/connect/client/core.py", line 1709, in _execute_and_fetch for response in self._execute_and_fetch_as_iterator( File "/databricks/spark/python/pyspark/sql/connect/client/core.py", line 1683, in _execute_and_fetch_as_iterator raise kb File "/databricks/spark/python/pyspark/sql/connect/client/core.py", line 1671, in _execute_and_fetch_as_iterator for b in generator: File "", line 330, in __next__ File "/databricks/spark/python/pyspark/sql/connect/client/reattach.py", line 135, in send if not self._has_next(): ^^^^^^^^^^^^^^^^ File "/databricks/spark/python/pyspark/sql/connect/client/reattach.py", line 168, in _has_next self._current = self._call_iter( ^^^^^^^^^^^^^^^^ File "/databricks/spark/python/pyspark/sql/connect/client/reattach.py", line 271, in _call_iter return iter_fun() ^^^^^^^^^^ File "/databricks/spark/python/pyspark/sql/connect/client/reattach.py", line 169, in lambda: next(self._iterator) # type: ignore[arg-type] ^^^^^^^^^^^^^^^^^^^^ File "/databricks/python/lib/python3.11/site-packages/grpc/_channel.py", line 540, in __next__ return self._next() ^^^^^^^^^^^^ File "/databricks/python/lib/python3.11/site-packages/grpc/_channel.py", line 957, in _next _common.wait(self._state.condition.wait, _response_ready) File "/databricks/python/lib/python3.11/site-packages/grpc/_common.py", line 156, in wait _wait_once(wait_fn, MAXIMUM_WAIT_TIMEOUT, spin_cb) File "/databricks/python/lib/python3.11/site-packages/grpc/_common.py", line 116, in _wait_once wait_fn(timeout=timeout) File "/usr/lib/python3.11/threading.py", line 324, in wait gotit = waiter.acquire(True, timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ KeyboardInterrupt 07:07 INFO [databricks.labs.ucx:migrate_external_tables_sync] UCX v0.27.2+6720240703070525 After job finishes, see debug logs at /Workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.l6hv/logs/migrate-tables/run-677703057440921-0/migrate_external_tables_sync.log 07:07 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.0/clusters/list < 200 OK < { < "clusters": [ < { < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": { < "availability": "SPOT_WITH_FALLBACK_AZURE", < "first_on_demand": 2147483647, < "spot_bid_max_price": -1.0 < }, < "cluster_cores": 4.0, < "cluster_id": "DATABRICKS_CLUSTER_ID", < "cluster_memory_mb": 16384, < "cluster_name": "DEFAULT Test Cluster (Single Node, No Isolation)", < "cluster_source": "UI", < "creator_user_name": "serge.smertin@databricks.com", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "TEST_SCHEMA_tags": { < "Budget": "opex.sales.labs", < "ClusterId": "DATABRICKS_CLUSTER_ID", < "ClusterName": "DEFAULT Test Cluster (Single Node, No Isolation)", < "Creator": "serge.smertin@databricks.com", < "DatabricksInstanceGroupId": "-6814024147286011579", < "DatabricksInstancePoolCreatorId": "4183391249163402", < "DatabricksInstancePoolId": "TEST_INSTANCE_POOL_ID", < "Owner": "labs-oss@databricks.com", < "Vendor": "Databricks" < }, < "disk_spec": {}, < "driver": { < "host_private_ip": "10.139.0.11", < "instance_id": "18169d6aa00940739ce82876d2df4ca5", < "node_attributes": { < "is_spot": false < }, < "node_id": "e8742f800d344cd498d0878b8d3af9e0", < "private_ip": "10.139.64.14", < "public_dns": "172.176.139.94", < "start_timestamp": 1719987394445 < }, < "driver_healthy": true, < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "driver_instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "driver_node_type_id": "Standard_D4s_v3", < "effective_spark_version": "15.2.x-scala2.12", < "enable_elastic_disk": true, < "enable_local_disk_encryption": false, < "init_scripts_safe_mode": false, < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "jdbc_port": 10000, < "last_activity_time": 1719987534730, < "last_restarted_time": 1719987500169, < "last_state_loss_time": 1719987500111, < "node_type_id": "Standard_D4s_v3", < "num_workers": 0, < "pinned_by_user_name": "4183391249163402", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_context_id": 5445134623901475951, < "spark_version": "15.2.x-scala2.12", < "start_time": 1711403415696, < "state": "RUNNING", < "state_message": "" < }, < "... (9 additional elements)" < ] < } 07:07 WARNING [databricks.labs.ucx.assessment.secrets:migrate_external_tables_sync] Secret in config stored in plaintext. 07:07 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/external-locations < 200 OK < { < "external_locations": [ < { < "created_at": 1712317369786, < "created_by": "serge.smertin@databricks.com", < "credential_id": "462bd121-a3ff-4f51-899f-236868f3d2ab", < "credential_name": "TEST_STORAGE_CREDENTIAL", < "full_name": "TEST_A_LOCATION", < "id": "98c25265-fb0f-4b15-a727-63855b7f78a7", < "isolation_mode": "ISOLATION_MODE_OPEN", < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "TEST_A_LOCATION", < "owner": "labs.scope.account-admin", < "read_only": false, < "securable_kind": "EXTERNAL_LOCATION_STANDARD", < "securable_type": "EXTERNAL_LOCATION", < "updated_at": 1712566812808, < "updated_by": "serge.smertin@databricks.com", < "url": "TEST_MOUNT_CONTAINER/a" < }, < "... (3 additional elements)" < ] < } 07:07 DEBUG [databricks.labs.blueprint.installation:migrate_external_tables_sync] Loading list from CLOUD_ENV_storage_account_info.csv 07:07 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.0/workspace/export?path=/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.l6hv/CLOUD_ENV_storage_account_info.csv&direct_download=true < 200 OK < [raw stream] 07:07 DEBUG [databricks.labs.ucx.framework.crawlers:migrate_external_tables_sync] [hive_metastore.ucx_sjxqh.grants] fetching grants inventory 07:07 DEBUG [databricks.labs.lsql.backends:migrate_external_tables_sync] [spark][fetch] SELECT * FROM hive_metastore.ucx_sjxqh.grants 07:07 DEBUG [databricks.labs.ucx.framework.crawlers:migrate_external_tables_sync] [hive_metastore.ucx_sjxqh.groups] fetching groups inventory 07:07 DEBUG [databricks.labs.lsql.backends:migrate_external_tables_sync] [spark][fetch] SELECT * FROM hive_metastore.ucx_sjxqh.groups 07:07 DEBUG [databricks.labs.ucx.framework.crawlers:migrate_external_tables_sync] [hive_metastore.ucx_sjxqh.tables] fetching tables inventory 07:07 DEBUG [databricks.labs.lsql.backends:migrate_external_tables_sync] [spark][fetch] SELECT * FROM hive_metastore.ucx_sjxqh.tables 07:07 DEBUG [databricks.labs.ucx.framework.crawlers:migrate_external_tables_sync] [hive_metastore.ucx_sjxqh.mounts] fetching mounts inventory 07:07 DEBUG [databricks.labs.lsql.backends:migrate_external_tables_sync] [spark][fetch] SELECT * FROM ucx_sjxqh.mounts 07:07 ERROR [databricks.labs.ucx:migrate_external_tables_sync] Execute `databricks workspace export //Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.l6hv/logs/migrate-tables/run-677703057440921-0/migrate_external_tables_sync.log` locally to troubleshoot with more details. 07:07 DEBUG [databricks:migrate_external_tables_sync] Task crash details Traceback (most recent call last): File "/local_disk0/.ephemeral_nfs/envs/pythonEnv-f6584c34-8c7c-41f1-b4ca-3142cfc30567/lib/python3.11/site-packages/databricks/labs/ucx/runtime.py", line 100, in trigger current_task(ctx) File "/local_disk0/.ephemeral_nfs/envs/pythonEnv-f6584c34-8c7c-41f1-b4ca-3142cfc30567/lib/python3.11/site-packages/databricks/labs/ucx/hive_metastore/workflows.py", line 16, in migrate_external_tables_sync ctx.tables_migrator.migrate_tables( File "/local_disk0/.ephemeral_nfs/envs/pythonEnv-f6584c34-8c7c-41f1-b4ca-3142cfc30567/lib/python3.11/site-packages/databricks/labs/ucx/hive_metastore/table_migrate.py", line 80, in migrate_tables all_principal_grants = None if acl_strategy is None else self._principal_grants.get_interactive_cluster_grants() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/local_disk0/.ephemeral_nfs/envs/pythonEnv-f6584c34-8c7c-41f1-b4ca-3142cfc30567/lib/python3.11/site-packages/databricks/labs/ucx/hive_metastore/grants.py", line 555, in get_interactive_cluster_grants principals = self._get_cluster_principal_mapping(cluster_id) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/local_disk0/.ephemeral_nfs/envs/pythonEnv-f6584c34-8c7c-41f1-b4ca-3142cfc30567/lib/python3.11/site-packages/databricks/labs/ucx/hive_metastore/grants.py", line 629, in _get_cluster_principal_mapping cluster_permission = self._ws.permissions.get("clusters", cluster_id) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/local_disk0/.ephemeral_nfs/envs/pythonEnv-f6584c34-8c7c-41f1-b4ca-3142cfc30567/lib/python3.11/site-packages/databricks/sdk/service/iam.py", line 2607, in get res = self._api.do('GET', ^^^^^^^^^^^^^^^^^^^ File "/local_disk0/.ephemeral_nfs/envs/pythonEnv-f6584c34-8c7c-41f1-b4ca-3142cfc30567/lib/python3.11/site-packages/databricks/sdk/core.py", line 153, in do response = retryable(self._perform)(method, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/local_disk0/.ephemeral_nfs/envs/pythonEnv-f6584c34-8c7c-41f1-b4ca-3142cfc30567/lib/python3.11/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/local_disk0/.ephemeral_nfs/envs/pythonEnv-f6584c34-8c7c-41f1-b4ca-3142cfc30567/lib/python3.11/site-packages/databricks/sdk/core.py", line 249, in _perform response = self._session.request(method, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/databricks/python/lib/python3.11/site-packages/requests/sessions.py", line 589, in request resp = self.send(prep, **send_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/databricks/python/lib/python3.11/site-packages/requests/sessions.py", line 703, in send r = adapter.send(request, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/databricks/python/lib/python3.11/site-packages/requests/adapters.py", line 486, in send resp = conn.urlopen( ^^^^^^^^^^^^^ File "/databricks/python/lib/python3.11/site-packages/urllib3/connectionpool.py", line 714, in urlopen httplib_response = self._make_request( ^^^^^^^^^^^^^^^^^^^ File "/databricks/python/lib/python3.11/site-packages/urllib3/connectionpool.py", line 466, in _make_request six.raise_from(e, None) File "", line 3, in raise_from File "/databricks/python/lib/python3.11/site-packages/urllib3/connectionpool.py", line 461, in _make_request httplib_response = conn.getresponse() ^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.11/http/client.py", line 1374, in getresponse response.begin() File "/usr/lib/python3.11/http/client.py", line 318, in begin version, status, reason = self._read_status() ^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.11/http/client.py", line 279, in _read_status line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1") ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.11/socket.py", line 705, in readinto return self._sock.recv_into(b) ^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.11/ssl.py", line 1278, in recv_into return self.read(nbytes, buffer) ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.11/ssl.py", line 1134, in read return self._sslobj.read(len, buffer) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ KeyboardInterrupt 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/agNs 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.migrate_ejdqi: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_ejdqi 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_ejdqi', metastore_id=None, name='migrate_ejdqi', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_ejdqi.ucx_tpqe4: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_ejdqi/ucx_tpqe4 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_ejdqi.ucx_tpqe4', metastore_id=None, name='ucx_tpqe4', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070308'}, row_filter=None, schema_name='migrate_ejdqi', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_ejdqi/ucx_tpqe4', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_ejdqi.ucx_tvmrf: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_ejdqi/ucx_tvmrf 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_ejdqi.ucx_tvmrf', metastore_id=None, name='ucx_tvmrf', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070308'}, row_filter=None, schema_name='migrate_ejdqi', sql_path=None, storage_credential_name=None, storage_location='dbfs:/tmp/ucx_test_4is6', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_ejdqi.ucx_tijyo: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_ejdqi/ucx_tijyo 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_ejdqi.ucx_tijyo', metastore_id=None, name='ucx_tijyo', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070308'}, row_filter=None, schema_name='migrate_ejdqi', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/agNs', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_ejdqi.ucx_tlwcf: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_ejdqi/ucx_tlwcf 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_ejdqi.ucx_tlwcf', metastore_id=None, name='ucx_tlwcf', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070308'}, row_filter=None, schema_name='migrate_ejdqi', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_ejdqi.ucx_tpqe4', view_dependencies=None) 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_ejdqi.ucx_tkdvs: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_ejdqi/ucx_tkdvs 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_ejdqi.ucx_tkdvs', metastore_id=None, name='ucx_tkdvs', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070308'}, row_filter=None, schema_name='migrate_ejdqi', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_ejdqi.ucx_tlwcf', view_dependencies=None) 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1719990294056, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_chz37', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_chz37', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719990294056, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_chz37.migrate_ejdqi: https://DATABRICKS_HOST/explore/data/ucx_chz37/migrate_ejdqi 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_chz37', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_chz37.migrate_ejdqi', metastore_id=None, name='migrate_ejdqi', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:04 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sjxqh: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sjxqh 07:04 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sjxqh', metastore_id=None, name='ucx_sjxqh', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:05 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.l6hv/config.yml) doesn't exist. 07:05 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 07:05 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 07:05 INFO [databricks.labs.ucx.install] Fetching installations... 07:05 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.l6hv is corrupted. Skipping... 07:05 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 07:05 DEBUG [tests.integration.conftest] Waiting for clusters to start... 07:05 DEBUG [tests.integration.conftest] Waiting for clusters to start... 07:05 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+6720240703070525 07:05 INFO [databricks.labs.ucx.install] Creating ucx schemas... 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 07:05 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 07:05 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.l6hv/README for the next steps. 07:05 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-tables job: https://DATABRICKS_HOST#job/1011684138859603 07:07 INFO [databricks.labs.ucx:migrate_dbfs_root_delta_tables] UCX v0.27.2+6720240703070525 After job finishes, see debug logs at /Workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.l6hv/logs/migrate-tables/run-677703057440921-0/migrate_dbfs_root_delta_tables.log 07:07 DEBUG [databricks.sdk:migrate_dbfs_root_delta_tables] GET /api/2.0/clusters/list < 200 OK < { < "clusters": [ < { < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": { < "availability": "SPOT_WITH_FALLBACK_AZURE", < "first_on_demand": 2147483647, < "spot_bid_max_price": -1.0 < }, < "cluster_cores": 4.0, < "cluster_id": "DATABRICKS_CLUSTER_ID", < "cluster_memory_mb": 16384, < "cluster_name": "DEFAULT Test Cluster (Single Node, No Isolation)", < "cluster_source": "UI", < "creator_user_name": "serge.smertin@databricks.com", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "TEST_SCHEMA_tags": { < "Budget": "opex.sales.labs", < "ClusterId": "DATABRICKS_CLUSTER_ID", < "ClusterName": "DEFAULT Test Cluster (Single Node, No Isolation)", < "Creator": "serge.smertin@databricks.com", < "DatabricksInstanceGroupId": "-6814024147286011579", < "DatabricksInstancePoolCreatorId": "4183391249163402", < "DatabricksInstancePoolId": "TEST_INSTANCE_POOL_ID", < "Owner": "labs-oss@databricks.com", < "Vendor": "Databricks" < }, < "disk_spec": {}, < "driver": { < "host_private_ip": "10.139.0.11", < "instance_id": "18169d6aa00940739ce82876d2df4ca5", < "node_attributes": { < "is_spot": false < }, < "node_id": "e8742f800d344cd498d0878b8d3af9e0", < "private_ip": "10.139.64.14", < "public_dns": "172.176.139.94", < "start_timestamp": 1719987394445 < }, < "driver_healthy": true, < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "driver_instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "driver_node_type_id": "Standard_D4s_v3", < "effective_spark_version": "15.2.x-scala2.12", < "enable_elastic_disk": true, < "enable_local_disk_encryption": false, < "init_scripts_safe_mode": false, < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "jdbc_port": 10000, < "last_activity_time": 1719987534730, < "last_restarted_time": 1719987500169, < "last_state_loss_time": 1719987500111, < "node_type_id": "Standard_D4s_v3", < "num_workers": 0, < "pinned_by_user_name": "4183391249163402", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_context_id": 5445134623901475951, < "spark_version": "15.2.x-scala2.12", < "start_time": 1711403415696, < "state": "RUNNING", < "state_message": "" < }, < "... (9 additional elements)" < ] < } 07:07 WARNING [databricks.labs.ucx.assessment.secrets:migrate_dbfs_root_delta_tables] Secret in config stored in plaintext. 07:07 DEBUG [databricks.sdk:migrate_dbfs_root_delta_tables] GET /api/2.1/unity-catalog/external-locations < 200 OK < { < "external_locations": [ < { < "created_at": 1712317369786, < "created_by": "serge.smertin@databricks.com", < "credential_id": "462bd121-a3ff-4f51-899f-236868f3d2ab", < "credential_name": "TEST_STORAGE_CREDENTIAL", < "full_name": "TEST_A_LOCATION", < "id": "98c25265-fb0f-4b15-a727-63855b7f78a7", < "isolation_mode": "ISOLATION_MODE_OPEN", < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "TEST_A_LOCATION", < "owner": "labs.scope.account-admin", < "read_only": false, < "securable_kind": "EXTERNAL_LOCATION_STANDARD", < "securable_type": "EXTERNAL_LOCATION", < "updated_at": 1712566812808, < "updated_by": "serge.smertin@databricks.com", < "url": "TEST_MOUNT_CONTAINER/a" < }, < "... (3 additional elements)" < ] < } 07:07 DEBUG [databricks.labs.blueprint.installation:migrate_dbfs_root_delta_tables] Loading list from CLOUD_ENV_storage_account_info.csv 07:07 DEBUG [databricks.sdk:migrate_dbfs_root_delta_tables] GET /api/2.0/workspace/export?path=/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.l6hv/CLOUD_ENV_storage_account_info.csv&direct_download=true < 200 OK < [raw stream] 07:07 DEBUG [databricks.labs.ucx.framework.crawlers:migrate_dbfs_root_delta_tables] [hive_metastore.ucx_sjxqh.grants] fetching grants inventory 07:07 DEBUG [databricks.labs.lsql.backends:migrate_dbfs_root_delta_tables] [spark][fetch] SELECT * FROM hive_metastore.ucx_sjxqh.grants 07:07 DEBUG [databricks.labs.ucx.framework.crawlers:migrate_dbfs_root_delta_tables] [hive_metastore.ucx_sjxqh.groups] fetching groups inventory 07:07 DEBUG [databricks.labs.lsql.backends:migrate_dbfs_root_delta_tables] [spark][fetch] SELECT * FROM hive_metastore.ucx_sjxqh.groups 07:07 DEBUG [databricks.labs.ucx.framework.crawlers:migrate_dbfs_root_delta_tables] [hive_metastore.ucx_sjxqh.tables] fetching tables inventory 07:07 DEBUG [databricks.labs.lsql.backends:migrate_dbfs_root_delta_tables] [spark][fetch] SELECT * FROM hive_metastore.ucx_sjxqh.tables 07:07 DEBUG [databricks.labs.ucx.framework.crawlers:migrate_dbfs_root_delta_tables] [hive_metastore.ucx_sjxqh.mounts] fetching mounts inventory 07:07 DEBUG [databricks.labs.lsql.backends:migrate_dbfs_root_delta_tables] [spark][fetch] SELECT * FROM ucx_sjxqh.mounts 07:07 ERROR [databricks.labs.ucx:migrate_dbfs_root_delta_tables] Execute `databricks workspace export //Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.l6hv/logs/migrate-tables/run-677703057440921-0/migrate_dbfs_root_delta_tables.log` locally to troubleshoot with more details. 07:07 DEBUG [databricks:migrate_dbfs_root_delta_tables] Task crash details Traceback (most recent call last): File "/local_disk0/.ephemeral_nfs/envs/pythonEnv-46b1c4d9-3191-456b-9e4f-5f4f8b9b5aae/lib/python3.11/site-packages/databricks/labs/ucx/runtime.py", line 100, in trigger current_task(ctx) File "/local_disk0/.ephemeral_nfs/envs/pythonEnv-46b1c4d9-3191-456b-9e4f-5f4f8b9b5aae/lib/python3.11/site-packages/databricks/labs/ucx/hive_metastore/workflows.py", line 29, in migrate_dbfs_root_delta_tables ctx.tables_migrator.migrate_tables( File "/local_disk0/.ephemeral_nfs/envs/pythonEnv-46b1c4d9-3191-456b-9e4f-5f4f8b9b5aae/lib/python3.11/site-packages/databricks/labs/ucx/hive_metastore/table_migrate.py", line 80, in migrate_tables all_principal_grants = None if acl_strategy is None else self._principal_grants.get_interactive_cluster_grants() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/local_disk0/.ephemeral_nfs/envs/pythonEnv-46b1c4d9-3191-456b-9e4f-5f4f8b9b5aae/lib/python3.11/site-packages/databricks/labs/ucx/hive_metastore/grants.py", line 551, in get_interactive_cluster_grants mounts = list(self._mounts_crawler.snapshot()) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/local_disk0/.ephemeral_nfs/envs/pythonEnv-46b1c4d9-3191-456b-9e4f-5f4f8b9b5aae/lib/python3.11/site-packages/databricks/labs/ucx/hive_metastore/locations.py", line 252, in snapshot return self._snapshot(self._try_fetch, self._list_mounts) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/local_disk0/.ephemeral_nfs/envs/pythonEnv-46b1c4d9-3191-456b-9e4f-5f4f8b9b5aae/lib/python3.11/site-packages/databricks/labs/ucx/framework/crawlers.py", line 110, in _snapshot cached_results = list(fetcher()) ^^^^^^^^^^^^^^^ File "/local_disk0/.ephemeral_nfs/envs/pythonEnv-46b1c4d9-3191-456b-9e4f-5f4f8b9b5aae/lib/python3.11/site-packages/databricks/labs/ucx/hive_metastore/locations.py", line 255, in _try_fetch for row in self._fetch( ^^^^^^^^^^^^ File "/local_disk0/.ephemeral_nfs/envs/pythonEnv-46b1c4d9-3191-456b-9e4f-5f4f8b9b5aae/lib/python3.11/site-packages/databricks/labs/lsql/backends.py", line 211, in fetch return iter(self._spark.sql(sql).collect()) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/databricks/spark/python/pyspark/sql/connect/dataframe.py", line 1838, in collect table, schema = self._to_table() ^^^^^^^^^^^^^^^^ File "/databricks/spark/python/pyspark/sql/connect/dataframe.py", line 1873, in _to_table table, schema = self._session.client.to_table(query, self._plan.observations) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/databricks/spark/python/pyspark/sql/connect/client/core.py", line 1051, in to_table table, schema, _, _, _ = self._execute_and_fetch(req, observations) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/databricks/spark/python/pyspark/sql/connect/client/core.py", line 1709, in _execute_and_fetch for response in self._execute_and_fetch_as_iterator( File "/databricks/spark/python/pyspark/sql/connect/client/core.py", line 1683, in _execute_and_fetch_as_iterator raise kb File "/databricks/spark/python/pyspark/sql/connect/client/core.py", line 1671, in _execute_and_fetch_as_iterator for b in generator: File "", line 330, in __next__ File "/databricks/spark/python/pyspark/sql/connect/client/reattach.py", line 135, in send if not self._has_next(): ^^^^^^^^^^^^^^^^ File "/databricks/spark/python/pyspark/sql/connect/client/reattach.py", line 168, in _has_next self._current = self._call_iter( ^^^^^^^^^^^^^^^^ File "/databricks/spark/python/pyspark/sql/connect/client/reattach.py", line 271, in _call_iter return iter_fun() ^^^^^^^^^^ File "/databricks/spark/python/pyspark/sql/connect/client/reattach.py", line 169, in lambda: next(self._iterator) # type: ignore[arg-type] ^^^^^^^^^^^^^^^^^^^^ File "/databricks/python/lib/python3.11/site-packages/grpc/_channel.py", line 540, in __next__ return self._next() ^^^^^^^^^^^^ File "/databricks/python/lib/python3.11/site-packages/grpc/_channel.py", line 957, in _next _common.wait(self._state.condition.wait, _response_ready) File "/databricks/python/lib/python3.11/site-packages/grpc/_common.py", line 156, in wait _wait_once(wait_fn, MAXIMUM_WAIT_TIMEOUT, spin_cb) File "/databricks/python/lib/python3.11/site-packages/grpc/_common.py", line 116, in _wait_once wait_fn(timeout=timeout) File "/usr/lib/python3.11/threading.py", line 324, in wait gotit = waiter.acquire(True, timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ KeyboardInterrupt 07:07 INFO [databricks.labs.ucx:migrate_external_tables_sync] UCX v0.27.2+6720240703070525 After job finishes, see debug logs at /Workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.l6hv/logs/migrate-tables/run-677703057440921-0/migrate_external_tables_sync.log 07:07 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.0/clusters/list < 200 OK < { < "clusters": [ < { < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": { < "availability": "SPOT_WITH_FALLBACK_AZURE", < "first_on_demand": 2147483647, < "spot_bid_max_price": -1.0 < }, < "cluster_cores": 4.0, < "cluster_id": "DATABRICKS_CLUSTER_ID", < "cluster_memory_mb": 16384, < "cluster_name": "DEFAULT Test Cluster (Single Node, No Isolation)", < "cluster_source": "UI", < "creator_user_name": "serge.smertin@databricks.com", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "TEST_SCHEMA_tags": { < "Budget": "opex.sales.labs", < "ClusterId": "DATABRICKS_CLUSTER_ID", < "ClusterName": "DEFAULT Test Cluster (Single Node, No Isolation)", < "Creator": "serge.smertin@databricks.com", < "DatabricksInstanceGroupId": "-6814024147286011579", < "DatabricksInstancePoolCreatorId": "4183391249163402", < "DatabricksInstancePoolId": "TEST_INSTANCE_POOL_ID", < "Owner": "labs-oss@databricks.com", < "Vendor": "Databricks" < }, < "disk_spec": {}, < "driver": { < "host_private_ip": "10.139.0.11", < "instance_id": "18169d6aa00940739ce82876d2df4ca5", < "node_attributes": { < "is_spot": false < }, < "node_id": "e8742f800d344cd498d0878b8d3af9e0", < "private_ip": "10.139.64.14", < "public_dns": "172.176.139.94", < "start_timestamp": 1719987394445 < }, < "driver_healthy": true, < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "driver_instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "driver_node_type_id": "Standard_D4s_v3", < "effective_spark_version": "15.2.x-scala2.12", < "enable_elastic_disk": true, < "enable_local_disk_encryption": false, < "init_scripts_safe_mode": false, < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "jdbc_port": 10000, < "last_activity_time": 1719987534730, < "last_restarted_time": 1719987500169, < "last_state_loss_time": 1719987500111, < "node_type_id": "Standard_D4s_v3", < "num_workers": 0, < "pinned_by_user_name": "4183391249163402", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_context_id": 5445134623901475951, < "spark_version": "15.2.x-scala2.12", < "start_time": 1711403415696, < "state": "RUNNING", < "state_message": "" < }, < "... (9 additional elements)" < ] < } 07:07 WARNING [databricks.labs.ucx.assessment.secrets:migrate_external_tables_sync] Secret in config stored in plaintext. 07:07 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/external-locations < 200 OK < { < "external_locations": [ < { < "created_at": 1712317369786, < "created_by": "serge.smertin@databricks.com", < "credential_id": "462bd121-a3ff-4f51-899f-236868f3d2ab", < "credential_name": "TEST_STORAGE_CREDENTIAL", < "full_name": "TEST_A_LOCATION", < "id": "98c25265-fb0f-4b15-a727-63855b7f78a7", < "isolation_mode": "ISOLATION_MODE_OPEN", < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "TEST_A_LOCATION", < "owner": "labs.scope.account-admin", < "read_only": false, < "securable_kind": "EXTERNAL_LOCATION_STANDARD", < "securable_type": "EXTERNAL_LOCATION", < "updated_at": 1712566812808, < "updated_by": "serge.smertin@databricks.com", < "url": "TEST_MOUNT_CONTAINER/a" < }, < "... (3 additional elements)" < ] < } 07:07 DEBUG [databricks.labs.blueprint.installation:migrate_external_tables_sync] Loading list from CLOUD_ENV_storage_account_info.csv 07:07 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.0/workspace/export?path=/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.l6hv/CLOUD_ENV_storage_account_info.csv&direct_download=true < 200 OK < [raw stream] 07:07 DEBUG [databricks.labs.ucx.framework.crawlers:migrate_external_tables_sync] [hive_metastore.ucx_sjxqh.grants] fetching grants inventory 07:07 DEBUG [databricks.labs.lsql.backends:migrate_external_tables_sync] [spark][fetch] SELECT * FROM hive_metastore.ucx_sjxqh.grants 07:07 DEBUG [databricks.labs.ucx.framework.crawlers:migrate_external_tables_sync] [hive_metastore.ucx_sjxqh.groups] fetching groups inventory 07:07 DEBUG [databricks.labs.lsql.backends:migrate_external_tables_sync] [spark][fetch] SELECT * FROM hive_metastore.ucx_sjxqh.groups 07:07 DEBUG [databricks.labs.ucx.framework.crawlers:migrate_external_tables_sync] [hive_metastore.ucx_sjxqh.tables] fetching tables inventory 07:07 DEBUG [databricks.labs.lsql.backends:migrate_external_tables_sync] [spark][fetch] SELECT * FROM hive_metastore.ucx_sjxqh.tables 07:07 DEBUG [databricks.labs.ucx.framework.crawlers:migrate_external_tables_sync] [hive_metastore.ucx_sjxqh.mounts] fetching mounts inventory 07:07 DEBUG [databricks.labs.lsql.backends:migrate_external_tables_sync] [spark][fetch] SELECT * FROM ucx_sjxqh.mounts 07:07 ERROR [databricks.labs.ucx:migrate_external_tables_sync] Execute `databricks workspace export //Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.l6hv/logs/migrate-tables/run-677703057440921-0/migrate_external_tables_sync.log` locally to troubleshoot with more details. 07:07 DEBUG [databricks:migrate_external_tables_sync] Task crash details Traceback (most recent call last): File "/local_disk0/.ephemeral_nfs/envs/pythonEnv-f6584c34-8c7c-41f1-b4ca-3142cfc30567/lib/python3.11/site-packages/databricks/labs/ucx/runtime.py", line 100, in trigger current_task(ctx) File "/local_disk0/.ephemeral_nfs/envs/pythonEnv-f6584c34-8c7c-41f1-b4ca-3142cfc30567/lib/python3.11/site-packages/databricks/labs/ucx/hive_metastore/workflows.py", line 16, in migrate_external_tables_sync ctx.tables_migrator.migrate_tables( File "/local_disk0/.ephemeral_nfs/envs/pythonEnv-f6584c34-8c7c-41f1-b4ca-3142cfc30567/lib/python3.11/site-packages/databricks/labs/ucx/hive_metastore/table_migrate.py", line 80, in migrate_tables all_principal_grants = None if acl_strategy is None else self._principal_grants.get_interactive_cluster_grants() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/local_disk0/.ephemeral_nfs/envs/pythonEnv-f6584c34-8c7c-41f1-b4ca-3142cfc30567/lib/python3.11/site-packages/databricks/labs/ucx/hive_metastore/grants.py", line 555, in get_interactive_cluster_grants principals = self._get_cluster_principal_mapping(cluster_id) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/local_disk0/.ephemeral_nfs/envs/pythonEnv-f6584c34-8c7c-41f1-b4ca-3142cfc30567/lib/python3.11/site-packages/databricks/labs/ucx/hive_metastore/grants.py", line 629, in _get_cluster_principal_mapping cluster_permission = self._ws.permissions.get("clusters", cluster_id) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/local_disk0/.ephemeral_nfs/envs/pythonEnv-f6584c34-8c7c-41f1-b4ca-3142cfc30567/lib/python3.11/site-packages/databricks/sdk/service/iam.py", line 2607, in get res = self._api.do('GET', ^^^^^^^^^^^^^^^^^^^ File "/local_disk0/.ephemeral_nfs/envs/pythonEnv-f6584c34-8c7c-41f1-b4ca-3142cfc30567/lib/python3.11/site-packages/databricks/sdk/core.py", line 153, in do response = retryable(self._perform)(method, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/local_disk0/.ephemeral_nfs/envs/pythonEnv-f6584c34-8c7c-41f1-b4ca-3142cfc30567/lib/python3.11/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/local_disk0/.ephemeral_nfs/envs/pythonEnv-f6584c34-8c7c-41f1-b4ca-3142cfc30567/lib/python3.11/site-packages/databricks/sdk/core.py", line 249, in _perform response = self._session.request(method, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/databricks/python/lib/python3.11/site-packages/requests/sessions.py", line 589, in request resp = self.send(prep, **send_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/databricks/python/lib/python3.11/site-packages/requests/sessions.py", line 703, in send r = adapter.send(request, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/databricks/python/lib/python3.11/site-packages/requests/adapters.py", line 486, in send resp = conn.urlopen( ^^^^^^^^^^^^^ File "/databricks/python/lib/python3.11/site-packages/urllib3/connectionpool.py", line 714, in urlopen httplib_response = self._make_request( ^^^^^^^^^^^^^^^^^^^ File "/databricks/python/lib/python3.11/site-packages/urllib3/connectionpool.py", line 466, in _make_request six.raise_from(e, None) File "", line 3, in raise_from File "/databricks/python/lib/python3.11/site-packages/urllib3/connectionpool.py", line 461, in _make_request httplib_response = conn.getresponse() ^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.11/http/client.py", line 1374, in getresponse response.begin() File "/usr/lib/python3.11/http/client.py", line 318, in begin version, status, reason = self._read_status() ^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.11/http/client.py", line 279, in _read_status line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1") ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.11/socket.py", line 705, in readinto return self._sock.recv_into(b) ^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.11/ssl.py", line 1278, in recv_into return self.read(nbytes, buffer) ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.11/ssl.py", line 1134, in read return self._sslobj.read(len, buffer) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ KeyboardInterrupt 07:07 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 make_storage_dir fixtures 07:07 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_dbfs_data_copy fixtures 07:07 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/agNs 07:07 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 cluster fixtures 07:07 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 catalog fixtures 07:07 DEBUG [databricks.labs.ucx.mixins.fixtures] removing catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1719990294056, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_chz37', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_chz37', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719990294056, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 07:07 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while catalog CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1719990294056, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_chz37', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_chz37', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1719990294056, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') teardown: Catalog 'ucx_chz37' does not exist. 07:07 INFO [databricks.labs.ucx.install] Deleting UCX v0.27.2+6720240703070525 from https://DATABRICKS_HOST 07:07 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_sjxqh 07:07 INFO [databricks.labs.ucx.install] Deleting jobs 07:07 INFO [databricks.labs.ucx.install] Deleting experimental-workflow-linter job_id=774773102314938. 07:07 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=1062931278353961. 07:07 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=609299639652098. 07:07 INFO [databricks.labs.ucx.install] Deleting migrate-external-tables-ctas job_id=973090861382537. 07:07 INFO [databricks.labs.ucx.install] Deleting scan-tables-in-mounts-experimental job_id=470711335146389. 07:07 INFO [databricks.labs.ucx.install] Deleting assessment job_id=145521085431742. 07:07 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=1011684138859603. 07:07 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=763639356607091. 07:07 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=961989589551501. 07:07 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=470513509270635. 07:07 INFO [databricks.labs.ucx.install] Deleting migrate-external-hiveserde-tables-in-place-experimental job_id=221156952415640. 07:07 INFO [databricks.labs.ucx.install] Deleting migrate-data-reconciliation job_id=889241125020237. 07:07 INFO [databricks.labs.ucx.install] Deleting failing job_id=322811550143184. 07:07 INFO [databricks.labs.ucx.install] Deleting cluster policy 07:07 ERROR [databricks.labs.ucx.install] UCX Policy already deleted 07:07 INFO [databricks.labs.ucx.install] Deleting secret scope 07:07 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace user fixtures 07:07 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 account group fixtures 07:07 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures 07:07 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 07:07 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 5 table fixtures 07:07 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_ejdqi.ucx_tpqe4', metastore_id=None, name='ucx_tpqe4', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070308'}, row_filter=None, schema_name='migrate_ejdqi', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_ejdqi/ucx_tpqe4', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:07 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_ejdqi.ucx_tvmrf', metastore_id=None, name='ucx_tvmrf', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070308'}, row_filter=None, schema_name='migrate_ejdqi', sql_path=None, storage_credential_name=None, storage_location='dbfs:/tmp/ucx_test_4is6', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:07 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_ejdqi.ucx_tijyo', metastore_id=None, name='ucx_tijyo', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070308'}, row_filter=None, schema_name='migrate_ejdqi', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/agNs', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:07 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_ejdqi.ucx_tlwcf', metastore_id=None, name='ucx_tlwcf', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070308'}, row_filter=None, schema_name='migrate_ejdqi', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_ejdqi.ucx_tpqe4', view_dependencies=None) 07:07 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while table TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_ejdqi.ucx_tlwcf', metastore_id=None, name='ucx_tlwcf', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070308'}, row_filter=None, schema_name='migrate_ejdqi', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_ejdqi.ucx_tpqe4', view_dependencies=None) teardown: [WRONG_COMMAND_FOR_OBJECT_TYPE] The operation DROP TABLE requires a EXTERNAL or MANAGED. But hive_metastore.migrate_ejdqi.ucx_tlwcf is a VIEW. Use DROP VIEW instead. SQLSTATE: 42809 07:07 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_ejdqi.ucx_tkdvs', metastore_id=None, name='ucx_tkdvs', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070308'}, row_filter=None, schema_name='migrate_ejdqi', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_ejdqi.ucx_tlwcf', view_dependencies=None) 07:07 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while table TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_ejdqi.ucx_tkdvs', metastore_id=None, name='ucx_tkdvs', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070308'}, row_filter=None, schema_name='migrate_ejdqi', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_ejdqi.ucx_tlwcf', view_dependencies=None) teardown: [WRONG_COMMAND_FOR_OBJECT_TYPE] The operation DROP TABLE requires a EXTERNAL or MANAGED. But hive_metastore.migrate_ejdqi.ucx_tkdvs is a VIEW. Use DROP VIEW instead. SQLSTATE: 42809 07:07 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 schema fixtures 07:07 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_ejdqi', metastore_id=None, name='migrate_ejdqi', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:07 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_chz37', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_chz37.migrate_ejdqi', metastore_id=None, name='migrate_ejdqi', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:07 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sjxqh', metastore_id=None, name='ucx_sjxqh', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) ```

_{Running from nightly #110}

[github-actions[bot]]

❌ test_table_migration_job_refreshes_migration_status[regular-migrate-tables]: AssertionError: No migration statuses found (7m51.137s)

``` AssertionError: No migration statuses found assert False 07:10 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/M46h 07:10 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.migrate_eq5ls: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_eq5ls 07:10 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_eq5ls', metastore_id=None, name='migrate_eq5ls', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:10 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_eq5ls.ucx_tvsjj: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_eq5ls/ucx_tvsjj 07:10 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_eq5ls.ucx_tvsjj', metastore_id=None, name='ucx_tvsjj', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070608'}, row_filter=None, schema_name='migrate_eq5ls', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_eq5ls/ucx_tvsjj', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:10 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_eq5ls.ucx_t1lhm: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_eq5ls/ucx_t1lhm 07:10 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_eq5ls.ucx_t1lhm', metastore_id=None, name='ucx_t1lhm', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070608'}, row_filter=None, schema_name='migrate_eq5ls', sql_path=None, storage_credential_name=None, storage_location='dbfs:/tmp/ucx_test_Nvjd', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:10 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_eq5ls.ucx_tz5lc: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_eq5ls/ucx_tz5lc 07:10 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_eq5ls.ucx_tz5lc', metastore_id=None, name='ucx_tz5lc', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070608'}, row_filter=None, schema_name='migrate_eq5ls', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/M46h', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:10 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_eq5ls.ucx_t2bi2: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_eq5ls/ucx_t2bi2 07:10 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_eq5ls.ucx_t2bi2', metastore_id=None, name='ucx_t2bi2', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070608'}, row_filter=None, schema_name='migrate_eq5ls', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_eq5ls.ucx_tvsjj', view_dependencies=None) 07:10 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_eq5ls.ucx_tfm7e: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_eq5ls/ucx_tfm7e 07:10 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_eq5ls.ucx_tfm7e', metastore_id=None, name='ucx_tfm7e', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070608'}, row_filter=None, schema_name='migrate_eq5ls', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_eq5ls.ucx_t2bi2', view_dependencies=None) 07:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720249859751, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ccq7s', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_ccq7s', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720249859751, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 07:11 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_ccq7s.migrate_eq5ls: https://DATABRICKS_HOST/explore/data/ucx_ccq7s/migrate_eq5ls 07:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_ccq7s', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ccq7s.migrate_eq5ls', metastore_id=None, name='migrate_eq5ls', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:11 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s0lsz: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s0lsz 07:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s0lsz', metastore_id=None, name='ucx_s0lsz', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw5] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 07:10 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/M46h 07:10 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.migrate_eq5ls: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_eq5ls 07:10 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_eq5ls', metastore_id=None, name='migrate_eq5ls', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:10 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_eq5ls.ucx_tvsjj: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_eq5ls/ucx_tvsjj 07:10 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_eq5ls.ucx_tvsjj', metastore_id=None, name='ucx_tvsjj', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070608'}, row_filter=None, schema_name='migrate_eq5ls', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_eq5ls/ucx_tvsjj', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:10 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_eq5ls.ucx_t1lhm: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_eq5ls/ucx_t1lhm 07:10 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_eq5ls.ucx_t1lhm', metastore_id=None, name='ucx_t1lhm', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070608'}, row_filter=None, schema_name='migrate_eq5ls', sql_path=None, storage_credential_name=None, storage_location='dbfs:/tmp/ucx_test_Nvjd', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:10 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_eq5ls.ucx_tz5lc: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_eq5ls/ucx_tz5lc 07:10 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_eq5ls.ucx_tz5lc', metastore_id=None, name='ucx_tz5lc', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070608'}, row_filter=None, schema_name='migrate_eq5ls', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/M46h', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:10 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_eq5ls.ucx_t2bi2: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_eq5ls/ucx_t2bi2 07:10 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_eq5ls.ucx_t2bi2', metastore_id=None, name='ucx_t2bi2', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070608'}, row_filter=None, schema_name='migrate_eq5ls', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_eq5ls.ucx_tvsjj', view_dependencies=None) 07:10 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_eq5ls.ucx_tfm7e: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_eq5ls/ucx_tfm7e 07:10 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_eq5ls.ucx_tfm7e', metastore_id=None, name='ucx_tfm7e', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070608'}, row_filter=None, schema_name='migrate_eq5ls', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_eq5ls.ucx_t2bi2', view_dependencies=None) 07:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720249859751, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ccq7s', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_ccq7s', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720249859751, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 07:11 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_ccq7s.migrate_eq5ls: https://DATABRICKS_HOST/explore/data/ucx_ccq7s/migrate_eq5ls 07:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_ccq7s', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ccq7s.migrate_eq5ls', metastore_id=None, name='migrate_eq5ls', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:11 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s0lsz: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s0lsz 07:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s0lsz', metastore_id=None, name='ucx_s0lsz', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:11 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.FQpM/config.yml) doesn't exist. 07:11 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 07:11 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 07:11 INFO [databricks.labs.ucx.install] Fetching installations... 07:11 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.FQpM is corrupted. Skipping... 07:11 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 07:11 DEBUG [tests.integration.conftest] Waiting for clusters to start... 07:14 DEBUG [tests.integration.conftest] Waiting for clusters to start... 07:14 INFO [databricks.labs.ucx.install] Installing UCX v0.28.1+920240706071434 07:14 INFO [databricks.labs.ucx.install] Creating ucx schemas... 07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 07:14 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.FQpM/README for the next steps. 07:14 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-tables job: https://DATABRICKS_HOST#job/692342399391274 07:18 INFO [databricks.labs.ucx:migrate_external_tables_sync] UCX v0.28.1+920240706071434 After job finishes, see debug logs at /Workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.FQpM/logs/migrate-tables/run-208191967108727-0/migrate_external_tables_sync.log 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.0/clusters/list < 200 OK < { < "clusters": [ < { < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": { < "availability": "SPOT_WITH_FALLBACK_AZURE", < "first_on_demand": 2147483647, < "spot_bid_max_price": -1.0 < }, < "cluster_cores": 4.0, < "cluster_id": "DATABRICKS_CLUSTER_ID", < "cluster_memory_mb": 16384, < "cluster_name": "DEFAULT Test Cluster (Single Node, No Isolation)", < "cluster_source": "UI", < "creator_user_name": "serge.smertin@databricks.com", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "TEST_SCHEMA_tags": { < "Budget": "opex.sales.labs", < "ClusterId": "DATABRICKS_CLUSTER_ID", < "ClusterName": "DEFAULT Test Cluster (Single Node, No Isolation)", < "Creator": "serge.smertin@databricks.com", < "DatabricksInstanceGroupId": "-6814024147286011579", < "DatabricksInstancePoolCreatorId": "4183391249163402", < "DatabricksInstancePoolId": "TEST_INSTANCE_POOL_ID", < "Owner": "labs-oss@databricks.com", < "Vendor": "Databricks" < }, < "disk_spec": {}, < "driver": { < "host_private_ip": "10.139.0.15", < "instance_id": "a0edf99c9fca40bc8a18e4e00478f73c", < "node_attributes": { < "is_spot": false < }, < "node_id": "4df542d2ac904435a0ebba4bf4944c03", < "private_ip": "10.139.64.15", < "public_dns": "172.177.17.138", < "start_timestamp": 1720249599013 < }, < "driver_healthy": true, < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "driver_instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "driver_node_type_id": "Standard_D4s_v3", < "effective_spark_version": "15.2.x-scala2.12", < "enable_elastic_disk": true, < "enable_local_disk_encryption": false, < "init_scripts_safe_mode": false, < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "jdbc_port": 10000, < "last_activity_time": 1720249832646, < "last_restarted_time": 1720249806897, < "last_state_loss_time": 1720249806808, < "node_type_id": "Standard_D4s_v3", < "num_workers": 0, < "pinned_by_user_name": "4183391249163402", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_context_id": 7993977489192808159, < "spark_version": "15.2.x-scala2.12", < "start_time": 1711403415696, < "state": "RUNNING", < "state_message": "" < }, < "... (8 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/external-locations < 200 OK < { < "external_locations": [ < { < "created_at": 1712317369786, < "created_by": "serge.smertin@databricks.com", < "credential_id": "462bd121-a3ff-4f51-899f-236868f3d2ab", < "credential_name": "TEST_STORAGE_CREDENTIAL", < "full_name": "TEST_A_LOCATION", < "id": "98c25265-fb0f-4b15-a727-63855b7f78a7", < "isolation_mode": "ISOLATION_MODE_OPEN", < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "TEST_A_LOCATION", < "owner": "labs.scope.account-admin", < "read_only": false, < "securable_kind": "EXTERNAL_LOCATION_STANDARD", < "securable_type": "EXTERNAL_LOCATION", < "updated_at": 1712566812808, < "updated_by": "serge.smertin@databricks.com", < "url": "TEST_MOUNT_CONTAINER/a" < }, < "... (3 additional elements)" < ] < } 07:18 DEBUG [databricks.labs.blueprint.installation:migrate_external_tables_sync] Loading list from CLOUD_ENV_storage_account_info.csv 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.0/workspace/export?path=/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.FQpM/CLOUD_ENV_storage_account_info.csv&direct_download=true < 200 OK < [raw stream] 07:18 DEBUG [databricks.labs.ucx.framework.crawlers:migrate_external_tables_sync] [hive_metastore.ucx_s0lsz.grants] fetching grants inventory 07:18 DEBUG [databricks.labs.lsql.backends:migrate_external_tables_sync] [spark][fetch] SELECT * FROM hive_metastore.ucx_s0lsz.grants 07:18 DEBUG [databricks.labs.ucx.framework.crawlers:migrate_external_tables_sync] [hive_metastore.ucx_s0lsz.groups] fetching groups inventory 07:18 DEBUG [databricks.labs.lsql.backends:migrate_external_tables_sync] [spark][fetch] SELECT * FROM hive_metastore.ucx_s0lsz.groups 07:18 DEBUG [databricks.labs.ucx.framework.crawlers:migrate_external_tables_sync] [hive_metastore.ucx_s0lsz.tables] fetching tables inventory 07:18 DEBUG [databricks.labs.lsql.backends:migrate_external_tables_sync] [spark][fetch] SELECT * FROM hive_metastore.ucx_s0lsz.tables 07:18 DEBUG [databricks.labs.ucx.framework.crawlers:migrate_external_tables_sync] [hive_metastore.ucx_s0lsz.mounts] fetching mounts inventory 07:18 DEBUG [databricks.labs.lsql.backends:migrate_external_tables_sync] [spark][fetch] SELECT * FROM ucx_s0lsz.mounts 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.0/permissions/clusters/TEST_LEGACY_SPN_CLUSTER_ID < 200 OK < { < "access_control_list": [ < { < "all_permissions": [ < { < "inherited": false, < "permission_level": "CAN_MANAGE" < } < ], < "display_name": "Serge Smertin", < "user_name": "serge.smertin@databricks.com" < }, < "... (1 additional elements)" < ], < "object_id": "/clusters/TEST_LEGACY_SPN_CLUSTER_ID", < "object_type": "cluster" < } 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/catalogs < 200 OK < { < "catalogs": [ < { < "browse_only": false, < "catalog_type": "MANAGED_CATALOG", < "comment": "Main catalog (auto-created)", < "created_at": 1696359177243, < "created_by": "serge.smertin@databricks.com", < "full_name": "main", < "id": "bba166bb-4f35-4d09-a794-6b8fdb29fe18", < "isolation_mode": "OPEN", < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "main", < "owner": "serge.smertin@databricks.com", < "securable_kind": "CATALOG_STANDARD", < "securable_type": "CATALOG", < "updated_at": 1696359177243, < "updated_by": "serge.smertin@databricks.com" < }, < "... (4 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/schemas?catalog_name=main < 200 OK < { < "schemas": [ < { < "browse_only": false, < "catalog_name": "main", < "catalog_type": "MANAGED_CATALOG", < "comment": "Default schema (auto-created)", < "created_at": 1696359177258, < "created_by": "serge.smertin@databricks.com", < "full_name": "main.TEST_SCHEMA", < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "TEST_SCHEMA", < "owner": "serge.smertin@databricks.com", < "schema_id": "382945c5-4402-4c30-be5a-b3f5f0b3ab06", < "securable_kind": "SCHEMA_STANDARD", < "securable_type": "SCHEMA", < "updated_at": 1696359177258, < "updated_by": "serge.smertin@databricks.com" < }, < "... (1 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/tables?catalog_name=main&schema_name=TEST_SCHEMA < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "main", < "columns": [ < { < "name": "id", < "nullable": true, < "position": 0, < "type_json": "{\"name\":\"id\",\"type\":\"long\",\"nullable\":true,\"metadata\":{}}", < "type_name": "LONG", < "type_precision": 0, < "type_scale": 0, < "type_text": "bigint" < }, < "... (2 additional elements)" < ], < "created_at": 1698497863946, < "created_by": "serge.smertin@databricks.com", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "data_source_format": "DELTA", < "delta_runtime_properties_kvpairs": {}, < "full_name": "main.TEST_SCHEMA.dummy", < "generation": 0, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "dummy", < "owner": "serge.smertin@databricks.com", < "properties": { < "delta.checkpoint.writeStatsAsJson": "false", < "delta.checkpoint.writeStatsAsStruct": "true", < "delta.lastCommitTimestamp": "1698497863000", < "delta.lastUpdateVersion": "0", < "delta.minReaderVersion": "1", < "delta.minWriterVersion": "2" < }, < "properties_pairs": { < "properties": { < "delta.checkpoint.writeStatsAsJson": "false", < "delta.checkpoint.writeStatsAsStruct": "true", < "delta.lastCommitTimestamp": "1698497863000", < "delta.lastUpdateVersion": "0", < "delta.minReaderVersion": "1", < "delta.minWriterVersion": "2" < } < }, < "schema_name": "TEST_SCHEMA", < "securable_kind": "TABLE_DELTA", < "securable_type": "TABLE", < "storage_location": "abfss://labs-CLOUD_ENV-TEST_CATALOG-container@databrickslabsstorage.dfs.core.windows.net/8952c1e3-b265-4a... (64 more bytes)", < "table_id": "28504279-361d-4c1a-b5b1-76a13d192281", < "table_type": "MANAGED", < "updated_at": 1698497863946, < "updated_by": "serge.smertin@databricks.com" < } < ] < } 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/tables?catalog_name=main&schema_name=information_schema < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "main", < "columns": [ < { < "comment": "Principal that granted the privilege.", < "name": "grantor", < "nullable": false, < "position": 0, < "type_json": "{\"name\":\"grantor\",\"type\":\"string\",\"nullable\":false,\"metadata\":{\"comment\":\"Principal that granted... (18 more bytes)", < "type_name": "STRING", < "type_precision": 0, < "type_scale": 0, < "type_text": "string" < }, < "... (5 additional elements)" < ], < "comment": "Lists principals that have privileges on the catalogs.", < "created_at": 1696359177258, < "created_by": "System user", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "delta_runtime_properties_kvpairs": {}, < "full_name": "main.information_schema.catalog_privileges", < "generation": 0, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "catalog_privileges", < "owner": "System user", < "properties": { < "view.query.out.col.0": "grantor", < "view.query.out.col.1": "grantee", < "view.query.out.col.2": "catalog_name", < "view.query.out.col.3": "privilege_type", < "view.query.out.col.4": "is_grantable", < "view.query.out.col.5": "inherited_from", < "view.query.out.numCols": "6" < }, < "properties_pairs": { < "properties": { < "view.query.out.col.0": "grantor", < "view.query.out.col.1": "grantee", < "view.query.out.col.2": "catalog_name", < "view.query.out.col.3": "privilege_type", < "view.query.out.col.4": "is_grantable", < "view.query.out.col.5": "inherited_from", < "view.query.out.numCols": "6" < } < }, < "schema_name": "information_schema", < "securable_kind": "TABLE_SYSTEM", < "securable_type": "TABLE", < "table_id": "762d1462-35d6-46c8-9280-147a090b99b3", < "table_type": "VIEW", < "updated_at": 1696359177258, < "updated_by": "System user", < "view_definition": "SELECT * FROM system.information_schema.catalog_privileges WHERE catalog_name = 'main'" < }, < "... (27 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/schemas?catalog_name=TEST_CATALOG < 200 OK < { < "schemas": [ < { < "browse_only": false, < "catalog_name": "TEST_CATALOG", < "catalog_type": "MANAGED_CATALOG", < "created_at": 1712316840772, < "created_by": "serge.smertin@databricks.com", < "full_name": "TEST_CATALOG.TEST_SCHEMA", < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "TEST_SCHEMA", < "owner": "serge.smertin@databricks.com", < "schema_id": "8f7855ec-de46-4e1c-af0f-a3f516fe9112", < "securable_kind": "SCHEMA_STANDARD", < "securable_type": "SCHEMA", < "updated_at": 1712316840772, < "updated_by": "serge.smertin@databricks.com" < }, < "... (1 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/tables?catalog_name=TEST_CATALOG&schema_name=TEST_SCHEMA < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "TEST_CATALOG", < "columns": [ < { < "name": "first", < "nullable": false, < "position": 0, < "type_json": "{\"name\":\"first\",\"type\":\"string\",\"nullable\":false,\"metadata\":{}}", < "type_name": "STRING", < "type_precision": 0, < "type_scale": 0, < "type_text": "string" < }, < "... (1 additional elements)" < ], < "created_at": 1712923653973, < "created_by": "william.conti@databricks.com", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "data_source_format": "DELTA", < "delta_runtime_properties_kvpairs": {}, < "full_name": "TEST_CATALOG.TEST_SCHEMA.foo", < "generation": 0, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "foo", < "owner": "william.conti@databricks.com", < "properties": { < "delta.checkpoint.writeStatsAsJson": "false", < "delta.checkpoint.writeStatsAsStruct": "true", < "delta.enableDeletionVectors": "true", < "delta.feature.deletionVectors": "supported", < "delta.feature.invariants": "supported", < "delta.lastCommitTimestamp": "1712923653000", < "delta.lastUpdateVersion": "0", < "delta.minReaderVersion": "3", < "delta.minWriterVersion": "7" < }, < "properties_pairs": { < "properties": { < "delta.checkpoint.writeStatsAsJson": "false", < "delta.checkpoint.writeStatsAsStruct": "true", < "delta.enableDeletionVectors": "true", < "delta.feature.deletionVectors": "supported", < "delta.feature.invariants": "supported", < "delta.lastCommitTimestamp": "1712923653000", < "delta.lastUpdateVersion": "0", < "delta.minReaderVersion": "3", < "delta.minWriterVersion": "7" < } < }, < "schema_name": "TEST_SCHEMA", < "securable_kind": "TABLE_DELTA", < "securable_type": "TABLE", < "storage_location": "abfss://labs-CLOUD_ENV-TEST_CATALOG-container@databrickslabsstorage.dfs.core.windows.net/8952c1e3-b265-4a... (64 more bytes)", < "table_id": "ddb0d4b1-4e58-40f0-afa8-af19b68715d4", < "table_type": "MANAGED", < "updated_at": 1712923653973, < "updated_by": "william.conti@databricks.com" < } < ] < } 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/tables?catalog_name=TEST_CATALOG&schema_name=information_schema < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "TEST_CATALOG", < "columns": [ < { < "comment": "Principal that granted the privilege.", < "name": "grantor", < "nullable": false, < "position": 0, < "type_json": "{\"name\":\"grantor\",\"type\":\"string\",\"nullable\":false,\"metadata\":{\"comment\":\"Principal that granted... (18 more bytes)", < "type_name": "STRING", < "type_precision": 0, < "type_scale": 0, < "type_text": "string" < }, < "... (5 additional elements)" < ], < "comment": "Lists principals that have privileges on the catalogs.", < "created_at": 1712148158177, < "created_by": "System user", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "delta_runtime_properties_kvpairs": {}, < "full_name": "TEST_CATALOG.information_schema.catalog_privileges", < "generation": 0, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "catalog_privileges", < "owner": "System user", < "properties": { < "view.query.out.col.0": "grantor", < "view.query.out.col.1": "grantee", < "view.query.out.col.2": "catalog_name", < "view.query.out.col.3": "privilege_type", < "view.query.out.col.4": "is_grantable", < "view.query.out.col.5": "inherited_from", < "view.query.out.numCols": "6" < }, < "properties_pairs": { < "properties": { < "view.query.out.col.0": "grantor", < "view.query.out.col.1": "grantee", < "view.query.out.col.2": "catalog_name", < "view.query.out.col.3": "privilege_type", < "view.query.out.col.4": "is_grantable", < "view.query.out.col.5": "inherited_from", < "view.query.out.numCols": "6" < } < }, < "schema_name": "information_schema", < "securable_kind": "TABLE_SYSTEM", < "securable_type": "TABLE", < "table_id": "d9284504-8f54-470b-9e23-c235768ddcf1", < "table_type": "VIEW", < "updated_at": 1712148158177, < "updated_by": "System user", < "view_definition": "SELECT * FROM system.information_schema.catalog_privileges WHERE catalog_name = 'TEST_CATALOG'" < }, < "... (27 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/schemas?catalog_name=system < 200 OK < { < "schemas": [ < { < "browse_only": false, < "catalog_name": "system", < "catalog_type": "SYSTEM_CATALOG", < "created_at": 1710734599812, < "created_by": "System user", < "full_name": "system.access", < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "access", < "owner": "System user", < "schema_id": "3fd0cfdc-5ad5-4232-90bb-04fa12d06617", < "securable_kind": "SCHEMA_SYSTEM", < "securable_type": "SCHEMA", < "updated_at": 1710734599812, < "updated_by": "System user" < }, < "... (7 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/tables?catalog_name=system&schema_name=access < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "system", < "columns": [ < { < "name": "account_id", < "nullable": true, < "position": 0, < "type_json": "{\"name\":\"account_id\",\"type\":\"string\",\"nullable\":true,\"metadata\":{}}", < "type_name": "STRING", < "type_precision": 0, < "type_scale": 0, < "type_text": "string" < }, < "... (15 additional elements)" < ], < "created_at": 1710734599843, < "created_by": "System user", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "data_source_format": "DELTASHARING", < "delta_runtime_properties_kvpairs": {}, < "full_name": "system.access.audit", < "generation": 13, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "audit", < "owner": "System user", < "properties": { < "delta.autoOptimize.autoCompact": "auto", < "delta.autoOptimize.optimizeWrite": "true", < "delta.enableChangeDataFeed": "true", < "delta.lastCommitTimestamp": "1718981307000", < "delta.lastUpdateVersion": "154386", < "delta.minReaderVersion": "1", < "delta.minWriterVersion": "4" < }, < "properties_pairs": { < "properties": { < "delta.autoOptimize.autoCompact": "auto", < "delta.autoOptimize.optimizeWrite": "true", < "delta.enableChangeDataFeed": "true", < "delta.lastCommitTimestamp": "1718981307000", < "delta.lastUpdateVersion": "154386", < "delta.minReaderVersion": "1", < "delta.minWriterVersion": "4" < } < }, < "schema_name": "access", < "securable_kind": "TABLE_SYSTEM_DELTASHARING", < "securable_type": "TABLE", < "storage_location": "uc-deltasharing://system.access.audit#system.access.audit", < "table_id": "903ad991-71da-466d-8357-b2a23b02038f", < "table_type": "MANAGED", < "updated_at": 1718981323508, < "updated_by": "System user" < }, < "... (3 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/tables?catalog_name=system&schema_name=ai < 200 OK < {} 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/tables?catalog_name=system&schema_name=billing < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "system", < "created_at": 1712185605206, < "created_by": "System user", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "data_source_format": "DELTASHARING", < "delta_runtime_properties_kvpairs": {}, < "full_name": "system.billing.list_prices", < "generation": 0, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "list_prices", < "owner": "System user", < "schema_name": "billing", < "securable_kind": "TABLE_SYSTEM_DELTASHARING", < "securable_type": "TABLE", < "storage_location": "uc-deltasharing://system.billing.list_prices#system.billing.list_prices", < "table_id": "3e71cdc4-467d-495c-b4d7-cef63fcecb3d", < "table_type": "MANAGED", < "updated_at": 1712185605206, < "updated_by": "System user" < }, < "... (1 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/tables?catalog_name=system&schema_name=compute < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "system", < "columns": [ < { < "name": "account_id", < "nullable": true, < "position": 0, < "type_json": "{\"name\":\"account_id\",\"type\":\"string\",\"nullable\":true,\"metadata\":{}}", < "type_name": "STRING", < "type_precision": 0, < "type_scale": 0, < "type_text": "string" < }, < "... (24 additional elements)" < ], < "created_at": 1712185610644, < "created_by": "System user", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "data_source_format": "DELTASHARING", < "delta_runtime_properties_kvpairs": {}, < "full_name": "system.compute.clusters", < "generation": 1, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "clusters", < "owner": "System user", < "properties": { < "deltaSharing.enableChangeDataFeed": "true" < }, < "properties_pairs": { < "properties": { < "deltaSharing.enableChangeDataFeed": "true" < } < }, < "schema_name": "compute", < "securable_kind": "TABLE_SYSTEM_DELTASHARING", < "securable_type": "TABLE", < "storage_location": "uc-deltasharing://system.compute.clusters#system.compute.clusters", < "table_id": "cd40a20d-464e-4e9e-8fe5-a9b7c79f2445", < "table_type": "MANAGED", < "updated_at": 1712185676459, < "updated_by": "System user" < }, < "... (3 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/tables?catalog_name=system&schema_name=information_schema < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "system", < "columns": [ < { < "comment": "Principal that granted the privilege.", < "name": "grantor", < "nullable": false, < "position": 0, < "type_json": "{\"name\":\"grantor\",\"type\":\"string\",\"nullable\":false,\"metadata\":{\"comment\":\"Principal that granted... (18 more bytes)", < "type_name": "STRING", < "type_precision": 0, < "type_scale": 0, < "type_text": "string" < }, < "... (5 additional elements)" < ], < "comment": "Lists principals that have privileges on the catalogs.", < "created_at": 1696359177071, < "created_by": "System user", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "data_source_format": "UNITY_CATALOG", < "delta_runtime_properties_kvpairs": {}, < "full_name": "system.information_schema.catalog_privileges", < "generation": 0, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "catalog_privileges", < "owner": "System user", < "schema_name": "information_schema", < "securable_kind": "TABLE_SYSTEM", < "securable_type": "TABLE", < "table_id": "231f3847-910c-4b6e-bcac-5b92bf5dcd53", < "table_type": "EXTERNAL", < "updated_at": 1696359177071, < "updated_by": "System user" < }, < "... (42 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/tables?catalog_name=system&schema_name=lineage < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "system", < "created_at": 1712185633489, < "created_by": "System user", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "data_source_format": "DELTASHARING", < "delta_runtime_properties_kvpairs": {}, < "full_name": "system.lineage.column_lineage", < "generation": 0, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "column_lineage", < "owner": "System user", < "schema_name": "lineage", < "securable_kind": "TABLE_SYSTEM_DELTASHARING", < "securable_type": "TABLE", < "storage_location": "uc-deltasharing://system.lineage.column_lineage#system.lineage.column_lineage", < "table_id": "3d9f6c7a-eac4-4bd7-b505-7d3b0ee04bab", < "table_type": "MANAGED", < "updated_at": 1712185633489, < "updated_by": "System user" < }, < "... (1 additional elements)" < ] < } 07:18 INFO [databricks.labs.ucx:migrate_dbfs_root_non_delta_tables] UCX v0.28.1+920240706071434 After job finishes, see debug logs at /Workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.FQpM/logs/migrate-tables/run-208191967108727-0/migrate_dbfs_root_non_delta_tables.log 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.0/clusters/list < 200 OK < { < "clusters": [ < { < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": { < "availability": "SPOT_WITH_FALLBACK_AZURE", < "first_on_demand": 2147483647, < "spot_bid_max_price": -1.0 < }, < "cluster_cores": 4.0, < "cluster_id": "DATABRICKS_CLUSTER_ID", < "cluster_memory_mb": 16384, < "cluster_name": "DEFAULT Test Cluster (Single Node, No Isolation)", < "cluster_source": "UI", < "creator_user_name": "serge.smertin@databricks.com", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "TEST_SCHEMA_tags": { < "Budget": "opex.sales.labs", < "ClusterId": "DATABRICKS_CLUSTER_ID", < "ClusterName": "DEFAULT Test Cluster (Single Node, No Isolation)", < "Creator": "serge.smertin@databricks.com", < "DatabricksInstanceGroupId": "-6814024147286011579", < "DatabricksInstancePoolCreatorId": "4183391249163402", < "DatabricksInstancePoolId": "TEST_INSTANCE_POOL_ID", < "Owner": "labs-oss@databricks.com", < "Vendor": "Databricks" < }, < "disk_spec": {}, < "driver": { < "host_private_ip": "10.139.0.15", < "instance_id": "a0edf99c9fca40bc8a18e4e00478f73c", < "node_attributes": { < "is_spot": false < }, < "node_id": "4df542d2ac904435a0ebba4bf4944c03", < "private_ip": "10.139.64.15", < "public_dns": "172.177.17.138", < "start_timestamp": 1720249599013 < }, < "driver_healthy": true, < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "driver_instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "driver_node_type_id": "Standard_D4s_v3", < "effective_spark_version": "15.2.x-scala2.12", < "enable_elastic_disk": true, < "enable_local_disk_encryption": false, < "init_scripts_safe_mode": false, < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "jdbc_port": 10000, < "last_activity_time": 1720249832646, < "last_restarted_time": 1720249806897, < "last_state_loss_time": 1720249806808, < "node_type_id": "Standard_D4s_v3", < "num_workers": 0, < "pinned_by_user_name": "4183391249163402", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_context_id": 7993977489192808159, < "spark_version": "15.2.x-scala2.12", < "start_time": 1711403415696, < "state": "RUNNING", < "state_message": "" < }, < "... (8 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/external-locations < 200 OK < { < "external_locations": [ < { < "created_at": 1712317369786, < "created_by": "serge.smertin@databricks.com", < "credential_id": "462bd121-a3ff-4f51-899f-236868f3d2ab", < "credential_name": "TEST_STORAGE_CREDENTIAL", < "full_name": "TEST_A_LOCATION", < "id": "98c25265-fb0f-4b15-a727-63855b7f78a7", < "isolation_mode": "ISOLATION_MODE_OPEN", < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "TEST_A_LOCATION", < "owner": "labs.scope.account-admin", < "read_only": false, < "securable_kind": "EXTERNAL_LOCATION_STANDARD", < "securable_type": "EXTERNAL_LOCATION", < "updated_at": 1712566812808, < "updated_by": "serge.smertin@databricks.com", < "url": "TEST_MOUNT_CONTAINER/a" < }, < "... (3 additional elements)" < ] < } 07:18 DEBUG [databricks.labs.blueprint.installation:migrate_dbfs_root_non_delta_tables] Loading list from CLOUD_ENV_storage_account_info.csv 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.0/workspace/export?path=/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.FQpM/CLOUD_ENV_storage_account_info.csv&direct_download=true < 200 OK < [raw stream] 07:18 DEBUG [databricks.labs.ucx.framework.crawlers:migrate_dbfs_root_non_delta_tables] [hive_metastore.ucx_s0lsz.grants] fetching grants inventory 07:18 DEBUG [databricks.labs.lsql.backends:migrate_dbfs_root_non_delta_tables] [spark][fetch] SELECT * FROM hive_metastore.ucx_s0lsz.grants 07:18 DEBUG [databricks.labs.ucx.framework.crawlers:migrate_dbfs_root_non_delta_tables] [hive_metastore.ucx_s0lsz.groups] fetching groups inventory 07:18 DEBUG [databricks.labs.lsql.backends:migrate_dbfs_root_non_delta_tables] [spark][fetch] SELECT * FROM hive_metastore.ucx_s0lsz.groups 07:18 DEBUG [databricks.labs.ucx.framework.crawlers:migrate_dbfs_root_non_delta_tables] [hive_metastore.ucx_s0lsz.tables] fetching tables inventory 07:18 DEBUG [databricks.labs.lsql.backends:migrate_dbfs_root_non_delta_tables] [spark][fetch] SELECT * FROM hive_metastore.ucx_s0lsz.tables 07:18 DEBUG [databricks.labs.ucx.framework.crawlers:migrate_dbfs_root_non_delta_tables] [hive_metastore.ucx_s0lsz.mounts] fetching mounts inventory 07:18 DEBUG [databricks.labs.lsql.backends:migrate_dbfs_root_non_delta_tables] [spark][fetch] SELECT * FROM ucx_s0lsz.mounts 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.0/permissions/clusters/TEST_LEGACY_SPN_CLUSTER_ID < 200 OK < { < "access_control_list": [ < { < "all_permissions": [ < { < "inherited": false, < "permission_level": "CAN_MANAGE" < } < ], < "display_name": "Serge Smertin", < "user_name": "serge.smertin@databricks.com" < }, < "... (1 additional elements)" < ], < "object_id": "/clusters/TEST_LEGACY_SPN_CLUSTER_ID", < "object_type": "cluster" < } 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/catalogs < 200 OK < { < "catalogs": [ < { < "browse_only": false, < "catalog_type": "MANAGED_CATALOG", < "comment": "Main catalog (auto-created)", < "created_at": 1696359177243, < "created_by": "serge.smertin@databricks.com", < "full_name": "main", < "id": "bba166bb-4f35-4d09-a794-6b8fdb29fe18", < "isolation_mode": "OPEN", < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "main", < "owner": "serge.smertin@databricks.com", < "securable_kind": "CATALOG_STANDARD", < "securable_type": "CATALOG", < "updated_at": 1696359177243, < "updated_by": "serge.smertin@databricks.com" < }, < "... (4 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/schemas?catalog_name=main < 200 OK < { < "schemas": [ < { < "browse_only": false, < "catalog_name": "main", < "catalog_type": "MANAGED_CATALOG", < "comment": "Default schema (auto-created)", < "created_at": 1696359177258, < "created_by": "serge.smertin@databricks.com", < "full_name": "main.TEST_SCHEMA", < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "TEST_SCHEMA", < "owner": "serge.smertin@databricks.com", < "schema_id": "382945c5-4402-4c30-be5a-b3f5f0b3ab06", < "securable_kind": "SCHEMA_STANDARD", < "securable_type": "SCHEMA", < "updated_at": 1696359177258, < "updated_by": "serge.smertin@databricks.com" < }, < "... (1 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/tables?catalog_name=main&schema_name=TEST_SCHEMA < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "main", < "columns": [ < { < "name": "id", < "nullable": true, < "position": 0, < "type_json": "{\"name\":\"id\",\"type\":\"long\",\"nullable\":true,\"metadata\":{}}", < "type_name": "LONG", < "type_precision": 0, < "type_scale": 0, < "type_text": "bigint" < }, < "... (2 additional elements)" < ], < "created_at": 1698497863946, < "created_by": "serge.smertin@databricks.com", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "data_source_format": "DELTA", < "delta_runtime_properties_kvpairs": {}, < "full_name": "main.TEST_SCHEMA.dummy", < "generation": 0, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "dummy", < "owner": "serge.smertin@databricks.com", < "properties": { < "delta.checkpoint.writeStatsAsJson": "false", < "delta.checkpoint.writeStatsAsStruct": "true", < "delta.lastCommitTimestamp": "1698497863000", < "delta.lastUpdateVersion": "0", < "delta.minReaderVersion": "1", < "delta.minWriterVersion": "2" < }, < "properties_pairs": { < "properties": { < "delta.checkpoint.writeStatsAsJson": "false", < "delta.checkpoint.writeStatsAsStruct": "true", < "delta.lastCommitTimestamp": "1698497863000", < "delta.lastUpdateVersion": "0", < "delta.minReaderVersion": "1", < "delta.minWriterVersion": "2" < } < }, < "schema_name": "TEST_SCHEMA", < "securable_kind": "TABLE_DELTA", < "securable_type": "TABLE", < "storage_location": "abfss://labs-CLOUD_ENV-TEST_CATALOG-container@databrickslabsstorage.dfs.core.windows.net/8952c1e3-b265-4a... (64 more bytes)", < "table_id": "28504279-361d-4c1a-b5b1-76a13d192281", < "table_type": "MANAGED", < "updated_at": 1698497863946, < "updated_by": "serge.smertin@databricks.com" < } < ] < } 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/tables?catalog_name=main&schema_name=information_schema < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "main", < "columns": [ < { < "comment": "Principal that granted the privilege.", < "name": "grantor", < "nullable": false, < "position": 0, < "type_json": "{\"name\":\"grantor\",\"type\":\"string\",\"nullable\":false,\"metadata\":{\"comment\":\"Principal that granted... (18 more bytes)", < "type_name": "STRING", < "type_precision": 0, < "type_scale": 0, < "type_text": "string" < }, < "... (5 additional elements)" < ], < "comment": "Lists principals that have privileges on the catalogs.", < "created_at": 1696359177258, < "created_by": "System user", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "delta_runtime_properties_kvpairs": {}, < "full_name": "main.information_schema.catalog_privileges", < "generation": 0, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "catalog_privileges", < "owner": "System user", < "properties": { < "view.query.out.col.0": "grantor", < "view.query.out.col.1": "grantee", < "view.query.out.col.2": "catalog_name", < "view.query.out.col.3": "privilege_type", < "view.query.out.col.4": "is_grantable", < "view.query.out.col.5": "inherited_from", < "view.query.out.numCols": "6" < }, < "properties_pairs": { < "properties": { < "view.query.out.col.0": "grantor", < "view.query.out.col.1": "grantee", < "view.query.out.col.2": "catalog_name", < "view.query.out.col.3": "privilege_type", < "view.query.out.col.4": "is_grantable", < "view.query.out.col.5": "inherited_from", < "view.query.out.numCols": "6" < } < }, < "schema_name": "information_schema", < "securable_kind": "TABLE_SYSTEM", < "securable_type": "TABLE", < "table_id": "762d1462-35d6-46c8-9280-147a090b99b3", < "table_type": "VIEW", < "updated_at": 1696359177258, < "updated_by": "System user", < "view_definition": "SELECT * FROM system.information_schema.catalog_privileges WHERE catalog_name = 'main'" < }, < "... (27 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/schemas?catalog_name=TEST_CATALOG < 200 OK < { < "schemas": [ < { < "browse_only": false, < "catalog_name": "TEST_CATALOG", < "catalog_type": "MANAGED_CATALOG", < "created_at": 1712316840772, < "created_by": "serge.smertin@databricks.com", < "full_name": "TEST_CATALOG.TEST_SCHEMA", < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "TEST_SCHEMA", < "owner": "serge.smertin@databricks.com", < "schema_id": "8f7855ec-de46-4e1c-af0f-a3f516fe9112", < "securable_kind": "SCHEMA_STANDARD", < "securable_type": "SCHEMA", < "updated_at": 1712316840772, < "updated_by": "serge.smertin@databricks.com" < }, < "... (1 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/tables?catalog_name=TEST_CATALOG&schema_name=TEST_SCHEMA < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "TEST_CATALOG", < "columns": [ < { < "name": "first", < "nullable": false, < "position": 0, < "type_json": "{\"name\":\"first\",\"type\":\"string\",\"nullable\":false,\"metadata\":{}}", < "type_name": "STRING", < "type_precision": 0, < "type_scale": 0, < "type_text": "string" < }, < "... (1 additional elements)" < ], < "created_at": 1712923653973, < "created_by": "william.conti@databricks.com", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "data_source_format": "DELTA", < "delta_runtime_properties_kvpairs": {}, < "full_name": "TEST_CATALOG.TEST_SCHEMA.foo", < "generation": 0, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "foo", < "owner": "william.conti@databricks.com", < "properties": { < "delta.checkpoint.writeStatsAsJson": "false", < "delta.checkpoint.writeStatsAsStruct": "true", < "delta.enableDeletionVectors": "true", < "delta.feature.deletionVectors": "supported", < "delta.feature.invariants": "supported", < "delta.lastCommitTimestamp": "1712923653000", < "delta.lastUpdateVersion": "0", < "delta.minReaderVersion": "3", < "delta.minWriterVersion": "7" < }, < "properties_pairs": { < "properties": { < "delta.checkpoint.writeStatsAsJson": "false", < "delta.checkpoint.writeStatsAsStruct": "true", < "delta.enableDeletionVectors": "true", < "delta.feature.deletionVectors": "supported", < "delta.feature.invariants": "supported", < "delta.lastCommitTimestamp": "1712923653000", < "delta.lastUpdateVersion": "0", < "delta.minReaderVersion": "3", < "delta.minWriterVersion": "7" < } < }, < "schema_name": "TEST_SCHEMA", < "securable_kind": "TABLE_DELTA", < "securable_type": "TABLE", < "storage_location": "abfss://labs-CLOUD_ENV-TEST_CATALOG-container@databrickslabsstorage.dfs.core.windows.net/8952c1e3-b265-4a... (64 more bytes)", < "table_id": "ddb0d4b1-4e58-40f0-afa8-af19b68715d4", < "table_type": "MANAGED", < "updated_at": 1712923653973, < "updated_by": "william.conti@databricks.com" < } < ] < } 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/tables?catalog_name=TEST_CATALOG&schema_name=information_schema < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "TEST_CATALOG", < "columns": [ < { < "comment": "Principal that granted the privilege.", < "name": "grantor", < "nullable": false, < "position": 0, < "type_json": "{\"name\":\"grantor\",\"type\":\"string\",\"nullable\":false,\"metadata\":{\"comment\":\"Principal that granted... (18 more bytes)", < "type_name": "STRING", < "type_precision": 0, < "type_scale": 0, < "type_text": "string" < }, < "... (5 additional elements)" < ], < "comment": "Lists principals that have privileges on the catalogs.", < "created_at": 1712148158177, < "created_by": "System user", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "delta_runtime_properties_kvpairs": {}, < "full_name": "TEST_CATALOG.information_schema.catalog_privileges", < "generation": 0, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "catalog_privileges", < "owner": "System user", < "properties": { < "view.query.out.col.0": "grantor", < "view.query.out.col.1": "grantee", < "view.query.out.col.2": "catalog_name", < "view.query.out.col.3": "privilege_type", < "view.query.out.col.4": "is_grantable", < "view.query.out.col.5": "inherited_from", < "view.query.out.numCols": "6" < }, < "properties_pairs": { < "properties": { < "view.query.out.col.0": "grantor", < "view.query.out.col.1": "grantee", < "view.query.out.col.2": "catalog_name", < "view.query.out.col.3": "privilege_type", < "view.query.out.col.4": "is_grantable", < "view.query.out.col.5": "inherited_from", < "view.query.out.numCols": "6" < } < }, < "schema_name": "information_schema", < "securable_kind": "TABLE_SYSTEM", < "securable_type": "TABLE", < "table_id": "d9284504-8f54-470b-9e23-c235768ddcf1", < "table_type": "VIEW", < "updated_at": 1712148158177, < "updated_by": "System user", < "view_definition": "SELECT * FROM system.information_schema.catalog_privileges WHERE catalog_name = 'TEST_CATALOG'" < }, < "... (27 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/schemas?catalog_name=system < 200 OK < { < "schemas": [ < { < "browse_only": false, < "catalog_name": "system", < "catalog_type": "SYSTEM_CATALOG", < "created_at": 1710734599812, < "created_by": "System user", < "full_name": "system.access", < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "access", < "owner": "System user", < "schema_id": "3fd0cfdc-5ad5-4232-90bb-04fa12d06617", < "securable_kind": "SCHEMA_SYSTEM", < "securable_type": "SCHEMA", < "updated_at": 1710734599812, < "updated_by": "System user" < }, < "... (7 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/tables?catalog_name=system&schema_name=access < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "system", < "columns": [ < { < "name": "account_id", < "nullable": true, < "position": 0, < "type_json": "{\"name\":\"account_id\",\"type\":\"string\",\"nullable\":true,\"metadata\":{}}", < "type_name": "STRING", < "type_precision": 0, < "type_scale": 0, < "type_text": "string" < }, < "... (15 additional elements)" < ], < "created_at": 1710734599843, < "created_by": "System user", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "data_source_format": "DELTASHARING", < "delta_runtime_properties_kvpairs": {}, < "full_name": "system.access.audit", < "generation": 13, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "audit", < "owner": "System user", < "properties": { < "delta.autoOptimize.autoCompact": "auto", < "delta.autoOptimize.optimizeWrite": "true", < "delta.enableChangeDataFeed": "true", < "delta.lastCommitTimestamp": "1718981307000", < "delta.lastUpdateVersion": "154386", < "delta.minReaderVersion": "1", < "delta.minWriterVersion": "4" < }, < "properties_pairs": { < "properties": { < "delta.autoOptimize.autoCompact": "auto", < "delta.autoOptimize.optimizeWrite": "true", < "delta.enableChangeDataFeed": "true", < "delta.lastCommitTimestamp": "1718981307000", < "delta.lastUpdateVersion": "154386", < "delta.minReaderVersion": "1", < "delta.minWriterVersion": "4" < } < }, < "schema_name": "access", < "securable_kind": "TABLE_SYSTEM_DELTASHARING", < "securable_type": "TABLE", < "storage_location": "uc-deltasharing://system.access.audit#system.access.audit", < "table_id": "903ad991-71da-466d-8357-b2a23b02038f", < "table_type": "MANAGED", < "updated_at": 1718981323508, < "updated_by": "System user" < }, < "... (3 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/tables?catalog_name=system&schema_name=ai < 200 OK < {} 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/tables?catalog_name=system&schema_name=billing < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "system", < "created_at": 1712185605206, < "created_by": "System user", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "data_source_format": "DELTASHARING", < "delta_runtime_properties_kvpairs": {}, < "full_name": "system.billing.list_prices", < "generation": 0, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "list_prices", < "owner": "System user", < "schema_name": "billing", < "securable_kind": "TABLE_SYSTEM_DELTASHARING", < "securable_type": "TABLE", < "storage_location": "uc-deltasharing://system.billing.list_prices#system.billing.list_prices", < "table_id": "3e71cdc4-467d-495c-b4d7-cef63fcecb3d", < "table_type": "MANAGED", < "updated_at": 1712185605206, < "updated_by": "System user" < }, < "... (1 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/tables?catalog_name=system&schema_name=compute < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "system", < "columns": [ < { < "name": "account_id", < "nullable": true, < "position": 0, < "type_json": "{\"name\":\"account_id\",\"type\":\"string\",\"nullable\":true,\"metadata\":{}}", < "type_name": "STRING", < "type_precision": 0, < "type_scale": 0, < "type_text": "string" < }, < "... (24 additional elements)" < ], < "created_at": 1712185610644, < "created_by": "System user", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "data_source_format": "DELTASHARING", < "delta_runtime_properties_kvpairs": {}, < "full_name": "system.compute.clusters", < "generation": 1, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "clusters", < "owner": "System user", < "properties": { < "deltaSharing.enableChangeDataFeed": "true" < }, < "properties_pairs": { < "properties": { < "deltaSharing.enableChangeDataFeed": "true" < } < }, < "schema_name": "compute", < "securable_kind": "TABLE_SYSTEM_DELTASHARING", < "securable_type": "TABLE", < "storage_location": "uc-deltasharing://system.compute.clusters#system.compute.clusters", < "table_id": "cd40a20d-464e-4e9e-8fe5-a9b7c79f2445", < "table_type": "MANAGED", < "updated_at": 1712185676459, < "updated_by": "System user" < }, < "... (3 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/tables?catalog_name=system&schema_name=information_schema < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "system", < "columns": [ < { < "comment": "Principal that granted the privilege.", < "name": "grantor", < "nullable": false, < "position": 0, < "type_json": "{\"name\":\"grantor\",\"type\":\"string\",\"nullable\":false,\"metadata\":{\"comment\":\"Principal that granted... (18 more bytes)", < "type_name": "STRING", < "type_precision": 0, < "type_scale": 0, < "type_text": "string" < }, < "... (5 additional elements)" < ], < "comment": "Lists principals that have privileges on the catalogs.", < "created_at": 1696359177071, < "created_by": "System user", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "data_source_format": "UNITY_CATALOG", < "delta_runtime_properties_kvpairs": {}, < "full_name": "system.information_schema.catalog_privileges", < "generation": 0, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "catalog_privileges", < "owner": "System user", < "schema_name": "information_schema", < "securable_kind": "TABLE_SYSTEM", < "securable_type": "TABLE", < "table_id": "231f3847-910c-4b6e-bcac-5b92bf5dcd53", < "table_type": "EXTERNAL", < "updated_at": 1696359177071, < "updated_by": "System user" < }, < "... (42 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/tables?catalog_name=system&schema_name=lineage < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "system", < "created_at": 1712185633489, < "created_by": "System user", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "data_source_format": "DELTASHARING", < "delta_runtime_properties_kvpairs": {}, < "full_name": "system.lineage.column_lineage", < "generation": 0, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "column_lineage", < "owner": "System user", < "schema_name": "lineage", < "securable_kind": "TABLE_SYSTEM_DELTASHARING", < "securable_type": "TABLE", < "storage_location": "uc-deltasharing://system.lineage.column_lineage#system.lineage.column_lineage", < "table_id": "3d9f6c7a-eac4-4bd7-b505-7d3b0ee04bab", < "table_type": "MANAGED", < "updated_at": 1712185633489, < "updated_by": "System user" < }, < "... (1 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/tables?catalog_name=system&schema_name=marketplace < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "system", < "created_at": 1712185623488, < "created_by": "System user", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "data_source_format": "DELTASHARING", < "delta_runtime_properties_kvpairs": {}, < "full_name": "system.marketplace.listing_access_events", < "generation": 0, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "listing_access_events", < "owner": "System user", < "schema_name": "marketplace", < "securable_kind": "TABLE_SYSTEM_DELTASHARING", < "securable_type": "TABLE", < "storage_location": "uc-deltasharing://system.marketplace.listing_access_events#system.marketplace.listing_access_eve... (3 more bytes)", < "table_id": "44b2524e-4f6b-4c99-99a5-452d41ddb741", < "table_type": "MANAGED", < "updated_at": 1712185623488, < "updated_by": "System user" < }, < "... (1 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/tables?catalog_name=system&schema_name=storage < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "system", < "created_at": 1712185579237, < "created_by": "System user", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "data_source_format": "DELTASHARING", < "delta_runtime_properties_kvpairs": {}, < "full_name": "system.storage.predictive_optimization_operations_history", < "generation": 0, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "predictive_optimization_operations_history", < "owner": "System user", < "schema_name": "storage", < "securable_kind": "TABLE_SYSTEM_DELTASHARING", < "securable_type": "TABLE", < "storage_location": "uc-deltasharing://system.storage.predictive_optimization_operations_history#system.storage.predi... (37 more bytes)", < "table_id": "d80a9a27-d4f7-42c5-adc0-fabf6a948192", < "table_type": "MANAGED", < "updated_at": 1712185579237, < "updated_by": "System user" < } < ] < } 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/schemas?catalog_name=ucx_ccq7s < 200 OK < { < "schemas": [ < { < "browse_only": false, < "catalog_name": "ucx_ccq7s", < "catalog_type": "MANAGED_CATALOG", < "comment": "Default schema (auto-created)", < "created_at": 1720249859767, < "created_by": "0a330eb5-dd51-4d97-b6e4-c474356b1d5d", < "full_name": "ucx_ccq7s.TEST_SCHEMA", < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "TEST_SCHEMA", < "owner": "0a330eb5-dd51-4d97-b6e4-c474356b1d5d", < "schema_id": "5ddaad09-aa39-444f-b78a-8be439490bac", < "securable_kind": "SCHEMA_STANDARD", < "securable_type": "SCHEMA", < "updated_at": 1720249859767, < "updated_by": "0a330eb5-dd51-4d97-b6e4-c474356b1d5d" < }, < "... (2 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/tables?catalog_name=ucx_ccq7s&schema_name=TEST_SCHEMA < 200 OK < {} 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/tables?catalog_name=ucx_ccq7s&schema_name=information_schema < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "ucx_ccq7s", < "columns": [ < { < "comment": "Principal that granted the privilege.", < "name": "grantor", < "nullable": false, < "position": 0, < "type_json": "{\"name\":\"grantor\",\"type\":\"string\",\"nullable\":false,\"metadata\":{\"comment\":\"Principal that granted... (18 more bytes)", < "type_name": "STRING", < "type_precision": 0, < "type_scale": 0, < "type_text": "string" < }, < "... (5 additional elements)" < ], < "comment": "Lists principals that have privileges on the catalogs.", < "created_at": 1720249859767, < "created_by": "System user", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "delta_runtime_properties_kvpairs": {}, < "full_name": "ucx_ccq7s.information_schema.catalog_privileges", < "generation": 0, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "catalog_privileges", < "owner": "System user", < "properties": { < "view.query.out.col.0": "grantor", < "view.query.out.col.1": "grantee", < "view.query.out.col.2": "catalog_name", < "view.query.out.col.3": "privilege_type", < "view.query.out.col.4": "is_grantable", < "view.query.out.col.5": "inherited_from", < "view.query.out.numCols": "6" < }, < "properties_pairs": { < "properties": { < "view.query.out.col.0": "grantor", < "view.query.out.col.1": "grantee", < "view.query.out.col.2": "catalog_name", < "view.query.out.col.3": "privilege_type", < "view.query.out.col.4": "is_grantable", < "view.query.out.col.5": "inherited_from", < "view.query.out.numCols": "6" < } < }, < "schema_name": "information_schema", < "securable_kind": "TABLE_SYSTEM", < "securable_type": "TABLE", < "table_id": "9bcecae5-a970-4f29-a37f-14c6dced4836", < "table_type": "VIEW", < "updated_at": 1720249859767, < "updated_by": "System user", < "view_definition": "SELECT * FROM system.information_schema.catalog_privileges WHERE catalog_name = 'ucx_ccq7s'" < }, < "... (27 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/tables?catalog_name=ucx_ccq7s&schema_name=migrate_eq5ls < 200 OK < {} 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/schemas?catalog_name=ucx_ckvdw < 200 OK < { < "schemas": [ < { < "browse_only": false, < "catalog_name": "ucx_ckvdw", < "catalog_type": "MANAGED_CATALOG", < "comment": "Default schema (auto-created)", < "created_at": 1720250186244, < "created_by": "0a330eb5-dd51-4d97-b6e4-c474356b1d5d", < "full_name": "ucx_ckvdw.TEST_SCHEMA", < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "TEST_SCHEMA", < "owner": "0a330eb5-dd51-4d97-b6e4-c474356b1d5d", < "schema_id": "60833f0b-f700-4abe-8b91-0c712fe63301", < "securable_kind": "SCHEMA_STANDARD", < "securable_type": "SCHEMA", < "updated_at": 1720250186244, < "updated_by": "0a330eb5-dd51-4d97-b6e4-c474356b1d5d" < }, < "... (2 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/tables?catalog_name=ucx_ckvdw&schema_name=TEST_SCHEMA < 200 OK < {} 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/tables?catalog_name=ucx_ckvdw&schema_name=information_schema < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "ucx_ckvdw", < "columns": [ < { < "comment": "Principal that granted the privilege.", < "name": "grantor", < "nullable": false, < "position": 0, < "type_json": "{\"name\":\"grantor\",\"type\":\"string\",\"nullable\":false,\"metadata\":{\"comment\":\"Principal that granted... (18 more bytes)", < "type_name": "STRING", < "type_precision": 0, < "type_scale": 0, < "type_text": "string" < }, < "... (5 additional elements)" < ], < "comment": "Lists principals that have privileges on the catalogs.", < "created_at": 1720250186259, < "created_by": "System user", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "delta_runtime_properties_kvpairs": {}, < "full_name": "ucx_ckvdw.information_schema.catalog_privileges", < "generation": 0, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "catalog_privileges", < "owner": "System user", < "properties": { < "view.query.out.col.0": "grantor", < "view.query.out.col.1": "grantee", < "view.query.out.col.2": "catalog_name", < "view.query.out.col.3": "privilege_type", < "view.query.out.col.4": "is_grantable", < "view.query.out.col.5": "inherited_from", < "view.query.out.numCols": "6" < }, < "properties_pairs": { < "properties": { < "view.query.out.col.0": "grantor", < "view.query.out.col.1": "grantee", < "view.query.out.col.2": "catalog_name", < "view.query.out.col.3": "privilege_type", < "view.query.out.col.4": "is_grantable", < "view.query.out.col.5": "inherited_from", < "view.query.out.numCols": "6" < } < }, < "schema_name": "information_schema", < "securable_kind": "TABLE_SYSTEM", < "securable_type": "TABLE", < "table_id": "c4947ae9-7a4d-42e1-a621-b306fece32e9", < "table_type": "VIEW", < "updated_at": 1720250186259, < "updated_by": "System user", < "view_definition": "SELECT * FROM system.information_schema.catalog_privileges WHERE catalog_name = 'ucx_ckvdw'" < }, < "... (27 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/tables?catalog_name=ucx_ckvdw&schema_name=migrate_ybmtp < 200 OK < {} 07:18 DEBUG [databricks.labs.blueprint.installation:migrate_external_tables_sync] Loading list from mapping.csv 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.0/workspace/export?path=/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.FQpM/mapping.csv&direct_download=true < 200 OK < [raw stream] 07:18 DEBUG [databricks.labs.blueprint.parallel:migrate_external_tables_sync] Starting 1 tasks in 8 threads 07:18 DEBUG [databricks.labs.lsql.backends:migrate_external_tables_sync] [spark][fetch] DESCRIBE SCHEMA EXTENDED migrate_eq5ls 07:18 INFO [databricks.labs.blueprint.parallel:migrate_external_tables_sync] checking databases for skip property 1/1, rps: 0.647/sec 07:18 INFO [databricks.labs.blueprint.parallel:migrate_external_tables_sync] Finished 'checking databases for skip property' tasks: 100% results available (1/1). Took 0:00:01.561973 07:18 DEBUG [databricks.labs.ucx.framework.crawlers:migrate_external_tables_sync] [hive_metastore.ucx_s0lsz.tables] fetching tables inventory 07:18 DEBUG [databricks.labs.lsql.backends:migrate_external_tables_sync] [spark][fetch] SELECT * FROM hive_metastore.ucx_s0lsz.tables 07:18 DEBUG [databricks.labs.blueprint.parallel:migrate_external_tables_sync] Starting 5 tasks in 8 threads 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/tables/ucx_ccq7s.migrate_eq5ls.ucx_tvsjj < 404 Not Found < { < "details": [ < { < "@type": "type.googleapis.com/google.rpc.ErrorInfo", < "domain": "unity-catalog.databricks.com", < "metadata": { < "resourceIdentifier": "ucx_ccq7s.migrate_eq5ls.ucx_tvsjj", < "resourceType": "Table" < }, < "reason": "RESOURCE_DOES_NOT_EXIST" < }, < "... (1 additional elements)" < ], < "error_code": "TABLE_DOES_NOT_EXIST", < "message": "Table 'ucx_ccq7s.migrate_eq5ls.ucx_tvsjj' does not exist." < } 07:18 DEBUG [databricks.labs.lsql.backends:migrate_external_tables_sync] [spark][fetch] SHOW TBLPROPERTIES migrate_eq5ls.ucx_tvsjj 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/tables/ucx_ccq7s.migrate_eq5ls.ucx_tz5lc < 404 Not Found < { < "details": [ < { < "@type": "type.googleapis.com/google.rpc.ErrorInfo", < "domain": "unity-catalog.databricks.com", < "metadata": { < "resourceIdentifier": "ucx_ccq7s.migrate_eq5ls.ucx_tz5lc", < "resourceType": "Table" < }, < "reason": "RESOURCE_DOES_NOT_EXIST" < }, < "... (1 additional elements)" < ], < "error_code": "TABLE_DOES_NOT_EXIST", < "message": "Table 'ucx_ccq7s.migrate_eq5ls.ucx_tz5lc' does not exist." < } 07:18 DEBUG [databricks.labs.lsql.backends:migrate_external_tables_sync] [spark][fetch] SHOW TBLPROPERTIES migrate_eq5ls.ucx_tz5lc 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/tables/ucx_ccq7s.migrate_eq5ls.ucx_tfm7e < 404 Not Found < { < "details": [ < { < "@type": "type.googleapis.com/google.rpc.ErrorInfo", < "domain": "unity-catalog.databricks.com", < "metadata": { < "resourceIdentifier": "ucx_ccq7s.migrate_eq5ls.ucx_tfm7e", < "resourceType": "Table" < }, < "reason": "RESOURCE_DOES_NOT_EXIST" < }, < "... (1 additional elements)" < ], < "error_code": "TABLE_DOES_NOT_EXIST", < "message": "Table 'ucx_ccq7s.migrate_eq5ls.ucx_tfm7e' does not exist." < } 07:18 DEBUG [databricks.labs.lsql.backends:migrate_external_tables_sync] [spark][fetch] SHOW TBLPROPERTIES migrate_eq5ls.ucx_tfm7e 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/tables/ucx_ccq7s.migrate_eq5ls.ucx_t2bi2 < 404 Not Found < { < "details": [ < { < "@type": "type.googleapis.com/google.rpc.ErrorInfo", < "domain": "unity-catalog.databricks.com", < "metadata": { < "resourceIdentifier": "ucx_ccq7s.migrate_eq5ls.ucx_t2bi2", < "resourceType": "Table" < }, < "reason": "RESOURCE_DOES_NOT_EXIST" < }, < "... (1 additional elements)" < ], < "error_code": "TABLE_DOES_NOT_EXIST", < "message": "Table 'ucx_ccq7s.migrate_eq5ls.ucx_t2bi2' does not exist." < } 07:18 DEBUG [databricks.labs.lsql.backends:migrate_external_tables_sync] [spark][fetch] SHOW TBLPROPERTIES migrate_eq5ls.ucx_t2bi2 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/tables/ucx_ccq7s.migrate_eq5ls.ucx_t1lhm < 404 Not Found < { < "details": [ < { < "@type": "type.googleapis.com/google.rpc.ErrorInfo", < "domain": "unity-catalog.databricks.com", < "metadata": { < "resourceIdentifier": "ucx_ccq7s.migrate_eq5ls.ucx_t1lhm", < "resourceType": "Table" < }, < "reason": "RESOURCE_DOES_NOT_EXIST" < }, < "... (1 additional elements)" < ], < "error_code": "TABLE_DOES_NOT_EXIST", < "message": "Table 'ucx_ccq7s.migrate_eq5ls.ucx_t1lhm' does not exist." < } 07:18 DEBUG [databricks.labs.lsql.backends:migrate_external_tables_sync] [spark][fetch] SHOW TBLPROPERTIES migrate_eq5ls.ucx_t1lhm 07:18 INFO [databricks.labs.blueprint.parallel:migrate_external_tables_sync] checking all database properties 5/5, rps: 0.626/sec 07:18 INFO [databricks.labs.blueprint.parallel:migrate_external_tables_sync] Finished 'checking all database properties' tasks: 100% results available (5/5). Took 0:00:08.007288 07:18 DEBUG [databricks.labs.blueprint.parallel:migrate_external_tables_sync] Starting 1 tasks in 8 threads 07:18 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate:migrate_external_tables_sync] Migrating external table hive_metastore.migrate_eq5ls.ucx_tz5lc to using SQL query: SYNC TABLE ucx_ccq7s.migrate_eq5ls.ucx_tz5lc FROM hive_metastore.migrate_eq5ls.ucx_tz5lc; 07:18 DEBUG [databricks.labs.lsql.backends:migrate_external_tables_sync] [spark][fetch] SYNC TABLE ucx_ccq7s.migrate_eq5ls.ucx_tz5lc FROM hive_metastore.migrate_eq5ls.ucx_tz5lc; 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.0/preview/scim/v2/Me < 200 OK < { < "active": true, < "displayName": "labs-account-admin-identity", < "emails": [ < { < "primary": true, < "type": "work", < "value": "**REDACTED**" < } < ], < "externalId": "a0e683bc-a985-4535-8273-d54fed1cd03a", < "groups": [ < { < "$ref": "Groups/688239313962730", < "display": "labs.scope.account-admin", < "type": "direct", < "value": "**REDACTED**" < }, < "... (1 additional elements)" < ], < "id": "481119220561874", < "name": { < "givenName": "labs-account-admin-identity" < }, < "schemas": [ < "urn:ietf:params:scim:schemas:core:2.0:User", < "... (1 additional elements)" < ], < "userName": "0a330eb5-dd51-4d97-b6e4-c474356b1d5d" < } 07:18 DEBUG [databricks.labs.lsql.backends:migrate_external_tables_sync] [spark][execute] ALTER TABLE ucx_ccq7s.migrate_eq5ls.ucx_tz5lc SET TBLPROPERTIES ('upgraded_from' = 'hive_metasto... (81 more bytes) 07:18 INFO [databricks.labs.blueprint.parallel:migrate_external_tables_sync] migrate tables 1/1, rps: 0.204/sec 07:18 INFO [databricks.labs.blueprint.parallel:migrate_external_tables_sync] Finished 'migrate tables' tasks: 100% results available (1/1). Took 0:00:04.921012 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/tables?catalog_name=system&schema_name=marketplace < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "system", < "created_at": 1712185623488, < "created_by": "System user", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "data_source_format": "DELTASHARING", < "delta_runtime_properties_kvpairs": {}, < "full_name": "system.marketplace.listing_access_events", < "generation": 0, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "listing_access_events", < "owner": "System user", < "schema_name": "marketplace", < "securable_kind": "TABLE_SYSTEM_DELTASHARING", < "securable_type": "TABLE", < "storage_location": "uc-deltasharing://system.marketplace.listing_access_events#system.marketplace.listing_access_eve... (3 more bytes)", < "table_id": "44b2524e-4f6b-4c99-99a5-452d41ddb741", < "table_type": "MANAGED", < "updated_at": 1712185623488, < "updated_by": "System user" < }, < "... (1 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/tables?catalog_name=system&schema_name=storage < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "system", < "created_at": 1712185579237, < "created_by": "System user", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "data_source_format": "DELTASHARING", < "delta_runtime_properties_kvpairs": {}, < "full_name": "system.storage.predictive_optimization_operations_history", < "generation": 0, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "predictive_optimization_operations_history", < "owner": "System user", < "schema_name": "storage", < "securable_kind": "TABLE_SYSTEM_DELTASHARING", < "securable_type": "TABLE", < "storage_location": "uc-deltasharing://system.storage.predictive_optimization_operations_history#system.storage.predi... (37 more bytes)", < "table_id": "d80a9a27-d4f7-42c5-adc0-fabf6a948192", < "table_type": "MANAGED", < "updated_at": 1712185579237, < "updated_by": "System user" < } < ] < } 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/schemas?catalog_name=ucx_ccq7s < 200 OK < { < "schemas": [ < { < "browse_only": false, < "catalog_name": "ucx_ccq7s", < "catalog_type": "MANAGED_CATALOG", < "comment": "Default schema (auto-created)", < "created_at": 1720249859767, < "created_by": "0a330eb5-dd51-4d97-b6e4-c474356b1d5d", < "full_name": "ucx_ccq7s.TEST_SCHEMA", < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "TEST_SCHEMA", < "owner": "0a330eb5-dd51-4d97-b6e4-c474356b1d5d", < "schema_id": "5ddaad09-aa39-444f-b78a-8be439490bac", < "securable_kind": "SCHEMA_STANDARD", < "securable_type": "SCHEMA", < "updated_at": 1720249859767, < "updated_by": "0a330eb5-dd51-4d97-b6e4-c474356b1d5d" < }, < "... (2 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/tables?catalog_name=ucx_ccq7s&schema_name=TEST_SCHEMA < 200 OK < {} 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/tables?catalog_name=ucx_ccq7s&schema_name=information_schema < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "ucx_ccq7s", < "columns": [ < { < "comment": "Principal that granted the privilege.", < "name": "grantor", < "nullable": false, < "position": 0, < "type_json": "{\"name\":\"grantor\",\"type\":\"string\",\"nullable\":false,\"metadata\":{\"comment\":\"Principal that granted... (18 more bytes)", < "type_name": "STRING", < "type_precision": 0, < "type_scale": 0, < "type_text": "string" < }, < "... (5 additional elements)" < ], < "comment": "Lists principals that have privileges on the catalogs.", < "created_at": 1720249859767, < "created_by": "System user", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "delta_runtime_properties_kvpairs": {}, < "full_name": "ucx_ccq7s.information_schema.catalog_privileges", < "generation": 0, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "catalog_privileges", < "owner": "System user", < "properties": { < "view.query.out.col.0": "grantor", < "view.query.out.col.1": "grantee", < "view.query.out.col.2": "catalog_name", < "view.query.out.col.3": "privilege_type", < "view.query.out.col.4": "is_grantable", < "view.query.out.col.5": "inherited_from", < "view.query.out.numCols": "6" < }, < "properties_pairs": { < "properties": { < "view.query.out.col.0": "grantor", < "view.query.out.col.1": "grantee", < "view.query.out.col.2": "catalog_name", < "view.query.out.col.3": "privilege_type", < "view.query.out.col.4": "is_grantable", < "view.query.out.col.5": "inherited_from", < "view.query.out.numCols": "6" < } < }, < "schema_name": "information_schema", < "securable_kind": "TABLE_SYSTEM", < "securable_type": "TABLE", < "table_id": "9bcecae5-a970-4f29-a37f-14c6dced4836", < "table_type": "VIEW", < "updated_at": 1720249859767, < "updated_by": "System user", < "view_definition": "SELECT * FROM system.information_schema.catalog_privileges WHERE catalog_name = 'ucx_ccq7s'" < }, < "... (27 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/tables?catalog_name=ucx_ccq7s&schema_name=migrate_eq5ls < 200 OK < {} 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/schemas?catalog_name=ucx_ckvdw < 200 OK < { < "schemas": [ < { < "browse_only": false, < "catalog_name": "ucx_ckvdw", < "catalog_type": "MANAGED_CATALOG", < "comment": "Default schema (auto-created)", < "created_at": 1720250186244, < "created_by": "0a330eb5-dd51-4d97-b6e4-c474356b1d5d", < "full_name": "ucx_ckvdw.TEST_SCHEMA", < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "TEST_SCHEMA", < "owner": "0a330eb5-dd51-4d97-b6e4-c474356b1d5d", < "schema_id": "60833f0b-f700-4abe-8b91-0c712fe63301", < "securable_kind": "SCHEMA_STANDARD", < "securable_type": "SCHEMA", < "updated_at": 1720250186244, < "updated_by": "0a330eb5-dd51-4d97-b6e4-c474356b1d5d" < }, < "... (2 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/tables?catalog_name=ucx_ckvdw&schema_name=TEST_SCHEMA < 200 OK < {} 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/tables?catalog_name=ucx_ckvdw&schema_name=information_schema < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "ucx_ckvdw", < "columns": [ < { < "comment": "Principal that granted the privilege.", < "name": "grantor", < "nullable": false, < "position": 0, < "type_json": "{\"name\":\"grantor\",\"type\":\"string\",\"nullable\":false,\"metadata\":{\"comment\":\"Principal that granted... (18 more bytes)", < "type_name": "STRING", < "type_precision": 0, < "type_scale": 0, < "type_text": "string" < }, < "... (5 additional elements)" < ], < "comment": "Lists principals that have privileges on the catalogs.", < "created_at": 1720250186259, < "created_by": "System user", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "delta_runtime_properties_kvpairs": {}, < "full_name": "ucx_ckvdw.information_schema.catalog_privileges", < "generation": 0, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "catalog_privileges", < "owner": "System user", < "properties": { < "view.query.out.col.0": "grantor", < "view.query.out.col.1": "grantee", < "view.query.out.col.2": "catalog_name", < "view.query.out.col.3": "privilege_type", < "view.query.out.col.4": "is_grantable", < "view.query.out.col.5": "inherited_from", < "view.query.out.numCols": "6" < }, < "properties_pairs": { < "properties": { < "view.query.out.col.0": "grantor", < "view.query.out.col.1": "grantee", < "view.query.out.col.2": "catalog_name", < "view.query.out.col.3": "privilege_type", < "view.query.out.col.4": "is_grantable", < "view.query.out.col.5": "inherited_from", < "view.query.out.numCols": "6" < } < }, < "schema_name": "information_schema", < "securable_kind": "TABLE_SYSTEM", < "securable_type": "TABLE", < "table_id": "c4947ae9-7a4d-42e1-a621-b306fece32e9", < "table_type": "VIEW", < "updated_at": 1720250186259, < "updated_by": "System user", < "view_definition": "SELECT * FROM system.information_schema.catalog_privileges WHERE catalog_name = 'ucx_ckvdw'" < }, < "... (27 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/tables?catalog_name=ucx_ckvdw&schema_name=migrate_ybmtp < 200 OK < {} 07:18 DEBUG [databricks.labs.blueprint.installation:migrate_dbfs_root_non_delta_tables] Loading list from mapping.csv 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.0/workspace/export?path=/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.FQpM/mapping.csv&direct_download=true < 200 OK < [raw stream] 07:18 DEBUG [databricks.labs.blueprint.parallel:migrate_dbfs_root_non_delta_tables] Starting 1 tasks in 8 threads 07:18 DEBUG [databricks.labs.lsql.backends:migrate_dbfs_root_non_delta_tables] [spark][fetch] DESCRIBE SCHEMA EXTENDED migrate_eq5ls 07:18 INFO [databricks.labs.blueprint.parallel:migrate_dbfs_root_non_delta_tables] checking databases for skip property 1/1, rps: 0.587/sec 07:18 INFO [databricks.labs.blueprint.parallel:migrate_dbfs_root_non_delta_tables] Finished 'checking databases for skip property' tasks: 100% results available (1/1). Took 0:00:01.716355 07:18 DEBUG [databricks.labs.ucx.framework.crawlers:migrate_dbfs_root_non_delta_tables] [hive_metastore.ucx_s0lsz.tables] fetching tables inventory 07:18 DEBUG [databricks.labs.lsql.backends:migrate_dbfs_root_non_delta_tables] [spark][fetch] SELECT * FROM hive_metastore.ucx_s0lsz.tables 07:18 DEBUG [databricks.labs.blueprint.parallel:migrate_dbfs_root_non_delta_tables] Starting 5 tasks in 8 threads 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/tables/ucx_ccq7s.migrate_eq5ls.ucx_tvsjj < 404 Not Found < { < "details": [ < { < "@type": "type.googleapis.com/google.rpc.ErrorInfo", < "domain": "unity-catalog.databricks.com", < "metadata": { < "resourceIdentifier": "ucx_ccq7s.migrate_eq5ls.ucx_tvsjj", < "resourceType": "Table" < }, < "reason": "RESOURCE_DOES_NOT_EXIST" < }, < "... (1 additional elements)" < ], < "error_code": "TABLE_DOES_NOT_EXIST", < "message": "Table 'ucx_ccq7s.migrate_eq5ls.ucx_tvsjj' does not exist." < } 07:18 DEBUG [databricks.labs.lsql.backends:migrate_dbfs_root_non_delta_tables] [spark][fetch] SHOW TBLPROPERTIES migrate_eq5ls.ucx_tvsjj 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/tables/ucx_ccq7s.migrate_eq5ls.ucx_t1lhm < 404 Not Found < { < "details": [ < { < "@type": "type.googleapis.com/google.rpc.ErrorInfo", < "domain": "unity-catalog.databricks.com", < "metadata": { < "resourceIdentifier": "ucx_ccq7s.migrate_eq5ls.ucx_t1lhm", < "resourceType": "Table" < }, < "reason": "RESOURCE_DOES_NOT_EXIST" < }, < "... (1 additional elements)" < ], < "error_code": "TABLE_DOES_NOT_EXIST", < "message": "Table 'ucx_ccq7s.migrate_eq5ls.ucx_t1lhm' does not exist." < } 07:18 DEBUG [databricks.labs.lsql.backends:migrate_dbfs_root_non_delta_tables] [spark][fetch] SHOW TBLPROPERTIES migrate_eq5ls.ucx_t1lhm 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/tables/ucx_ccq7s.migrate_eq5ls.ucx_tz5lc < 404 Not Found < { < "details": [ < { < "@type": "type.googleapis.com/google.rpc.ErrorInfo", < "domain": "unity-catalog.databricks.com", < "metadata": { < "resourceIdentifier": "ucx_ccq7s.migrate_eq5ls.ucx_tz5lc", < "resourceType": "Table" < }, < "reason": "RESOURCE_DOES_NOT_EXIST" < }, < "... (1 additional elements)" < ], < "error_code": "TABLE_DOES_NOT_EXIST", < "message": "Table 'ucx_ccq7s.migrate_eq5ls.ucx_tz5lc' does not exist." < } 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/tables/ucx_ccq7s.migrate_eq5ls.ucx_t2bi2 < 404 Not Found < { < "details": [ < { < "@type": "type.googleapis.com/google.rpc.ErrorInfo", < "domain": "unity-catalog.databricks.com", < "metadata": { < "resourceIdentifier": "ucx_ccq7s.migrate_eq5ls.ucx_t2bi2", < "resourceType": "Table" < }, < "reason": "RESOURCE_DOES_NOT_EXIST" < }, < "... (1 additional elements)" < ], < "error_code": "TABLE_DOES_NOT_EXIST", < "message": "Table 'ucx_ccq7s.migrate_eq5ls.ucx_t2bi2' does not exist." < } 07:18 DEBUG [databricks.labs.lsql.backends:migrate_dbfs_root_non_delta_tables] [spark][fetch] SHOW TBLPROPERTIES migrate_eq5ls.ucx_t2bi2 07:18 DEBUG [databricks.labs.lsql.backends:migrate_dbfs_root_non_delta_tables] [spark][fetch] SHOW TBLPROPERTIES migrate_eq5ls.ucx_tz5lc 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/tables/ucx_ccq7s.migrate_eq5ls.ucx_tfm7e < 404 Not Found < { < "details": [ < { < "@type": "type.googleapis.com/google.rpc.ErrorInfo", < "domain": "unity-catalog.databricks.com", < "metadata": { < "resourceIdentifier": "ucx_ccq7s.migrate_eq5ls.ucx_tfm7e", < "resourceType": "Table" < }, < "reason": "RESOURCE_DOES_NOT_EXIST" < }, < "... (1 additional elements)" < ], < "error_code": "TABLE_DOES_NOT_EXIST", < "message": "Table 'ucx_ccq7s.migrate_eq5ls.ucx_tfm7e' does not exist." < } 07:18 DEBUG [databricks.labs.lsql.backends:migrate_dbfs_root_non_delta_tables] [spark][fetch] SHOW TBLPROPERTIES migrate_eq5ls.ucx_tfm7e 07:18 INFO [databricks.labs.blueprint.parallel:migrate_dbfs_root_non_delta_tables] checking all database properties 5/5, rps: 0.630/sec 07:18 INFO [databricks.labs.blueprint.parallel:migrate_dbfs_root_non_delta_tables] Finished 'checking all database properties' tasks: 100% results available (5/5). Took 0:00:07.968035 07:18 DEBUG [databricks.labs.blueprint.parallel:migrate_dbfs_root_non_delta_tables] Starting 1 tasks in 8 threads 07:18 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate:migrate_dbfs_root_non_delta_tables] Migrating table hive_metastore.migrate_eq5ls.ucx_t1lhm to ucx_ccq7s.migrate_eq5ls.ucx_t1lhm using SQL query: CREATE TABLE IF NOT EXISTS ucx_ccq7s.migrate_eq5ls.ucx_t1lhm AS SELECT * FROM hive_metastore.migrate_eq5ls.ucx_t1lhm 07:18 DEBUG [databricks.labs.lsql.backends:migrate_dbfs_root_non_delta_tables] [spark][execute] CREATE TABLE IF NOT EXISTS ucx_ccq7s.migrate_eq5ls.ucx_t1lhm AS SELECT * FROM hive_metastore.mig... (20 more bytes) 07:18 DEBUG [databricks.labs.lsql.backends:migrate_dbfs_root_non_delta_tables] [spark][execute] ALTER TABLE hive_metastore.migrate_eq5ls.ucx_t1lhm SET TBLPROPERTIES ('upgraded_to' = 'ucx_ccq7s... (27 more bytes) 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.0/preview/scim/v2/Me < 200 OK < { < "active": true, < "displayName": "labs-account-admin-identity", < "emails": [ < { < "primary": true, < "type": "work", < "value": "**REDACTED**" < } < ], < "externalId": "a0e683bc-a985-4535-8273-d54fed1cd03a", < "groups": [ < { < "$ref": "Groups/688239313962730", < "display": "labs.scope.account-admin", < "type": "direct", < "value": "**REDACTED**" < }, < "... (1 additional elements)" < ], < "id": "481119220561874", < "name": { < "givenName": "labs-account-admin-identity" < }, < "schemas": [ < "urn:ietf:params:scim:schemas:core:2.0:User", < "... (1 additional elements)" < ], < "userName": "0a330eb5-dd51-4d97-b6e4-c474356b1d5d" < } 07:18 DEBUG [databricks.labs.lsql.backends:migrate_dbfs_root_non_delta_tables] [spark][execute] ALTER TABLE ucx_ccq7s.migrate_eq5ls.ucx_t1lhm SET TBLPROPERTIES ('upgraded_from' = 'hive_metasto... (81 more bytes) 07:18 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate:migrate_dbfs_root_non_delta_tables] Migrating acls on ucx_ccq7s.migrate_eq5ls.ucx_t1lhm using SQL query: GRANT ALL PRIVILEGES ON TABLE ucx_ccq7s.migrate_eq5ls.ucx_t1lhm TO `serge.smertin@databricks.com` 07:18 DEBUG [databricks.labs.lsql.backends:migrate_dbfs_root_non_delta_tables] [spark][execute] GRANT ALL PRIVILEGES ON TABLE ucx_ccq7s.migrate_eq5ls.ucx_t1lhm TO `serge.smertin@databricks.com... (1 more bytes) 07:18 INFO [databricks.labs.blueprint.parallel:migrate_dbfs_root_non_delta_tables] migrate tables 1/1, rps: 0.025/sec 07:18 INFO [databricks.labs.blueprint.parallel:migrate_dbfs_root_non_delta_tables] Finished 'migrate tables' tasks: 100% results available (1/1). Took 0:00:39.342994 07:10 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/M46h 07:10 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.migrate_eq5ls: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_eq5ls 07:10 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_eq5ls', metastore_id=None, name='migrate_eq5ls', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:10 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_eq5ls.ucx_tvsjj: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_eq5ls/ucx_tvsjj 07:10 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_eq5ls.ucx_tvsjj', metastore_id=None, name='ucx_tvsjj', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070608'}, row_filter=None, schema_name='migrate_eq5ls', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_eq5ls/ucx_tvsjj', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:10 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_eq5ls.ucx_t1lhm: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_eq5ls/ucx_t1lhm 07:10 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_eq5ls.ucx_t1lhm', metastore_id=None, name='ucx_t1lhm', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070608'}, row_filter=None, schema_name='migrate_eq5ls', sql_path=None, storage_credential_name=None, storage_location='dbfs:/tmp/ucx_test_Nvjd', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:10 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_eq5ls.ucx_tz5lc: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_eq5ls/ucx_tz5lc 07:10 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_eq5ls.ucx_tz5lc', metastore_id=None, name='ucx_tz5lc', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070608'}, row_filter=None, schema_name='migrate_eq5ls', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/M46h', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:10 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_eq5ls.ucx_t2bi2: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_eq5ls/ucx_t2bi2 07:10 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_eq5ls.ucx_t2bi2', metastore_id=None, name='ucx_t2bi2', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070608'}, row_filter=None, schema_name='migrate_eq5ls', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_eq5ls.ucx_tvsjj', view_dependencies=None) 07:10 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.migrate_eq5ls.ucx_tfm7e: https://DATABRICKS_HOST/explore/data/hive_metastore/migrate_eq5ls/ucx_tfm7e 07:10 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_eq5ls.ucx_tfm7e', metastore_id=None, name='ucx_tfm7e', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070608'}, row_filter=None, schema_name='migrate_eq5ls', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_eq5ls.ucx_t2bi2', view_dependencies=None) 07:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720249859751, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ccq7s', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_ccq7s', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720249859751, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 07:11 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_ccq7s.migrate_eq5ls: https://DATABRICKS_HOST/explore/data/ucx_ccq7s/migrate_eq5ls 07:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_ccq7s', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ccq7s.migrate_eq5ls', metastore_id=None, name='migrate_eq5ls', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:11 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s0lsz: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s0lsz 07:11 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s0lsz', metastore_id=None, name='ucx_s0lsz', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:11 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.FQpM/config.yml) doesn't exist. 07:11 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 07:11 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 07:11 INFO [databricks.labs.ucx.install] Fetching installations... 07:11 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.FQpM is corrupted. Skipping... 07:11 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 07:11 DEBUG [tests.integration.conftest] Waiting for clusters to start... 07:14 DEBUG [tests.integration.conftest] Waiting for clusters to start... 07:14 INFO [databricks.labs.ucx.install] Installing UCX v0.28.1+920240706071434 07:14 INFO [databricks.labs.ucx.install] Creating ucx schemas... 07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 07:14 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.FQpM/README for the next steps. 07:14 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-tables job: https://DATABRICKS_HOST#job/692342399391274 07:18 INFO [databricks.labs.ucx:migrate_external_tables_sync] UCX v0.28.1+920240706071434 After job finishes, see debug logs at /Workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.FQpM/logs/migrate-tables/run-208191967108727-0/migrate_external_tables_sync.log 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.0/clusters/list < 200 OK < { < "clusters": [ < { < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": { < "availability": "SPOT_WITH_FALLBACK_AZURE", < "first_on_demand": 2147483647, < "spot_bid_max_price": -1.0 < }, < "cluster_cores": 4.0, < "cluster_id": "DATABRICKS_CLUSTER_ID", < "cluster_memory_mb": 16384, < "cluster_name": "DEFAULT Test Cluster (Single Node, No Isolation)", < "cluster_source": "UI", < "creator_user_name": "serge.smertin@databricks.com", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "TEST_SCHEMA_tags": { < "Budget": "opex.sales.labs", < "ClusterId": "DATABRICKS_CLUSTER_ID", < "ClusterName": "DEFAULT Test Cluster (Single Node, No Isolation)", < "Creator": "serge.smertin@databricks.com", < "DatabricksInstanceGroupId": "-6814024147286011579", < "DatabricksInstancePoolCreatorId": "4183391249163402", < "DatabricksInstancePoolId": "TEST_INSTANCE_POOL_ID", < "Owner": "labs-oss@databricks.com", < "Vendor": "Databricks" < }, < "disk_spec": {}, < "driver": { < "host_private_ip": "10.139.0.15", < "instance_id": "a0edf99c9fca40bc8a18e4e00478f73c", < "node_attributes": { < "is_spot": false < }, < "node_id": "4df542d2ac904435a0ebba4bf4944c03", < "private_ip": "10.139.64.15", < "public_dns": "172.177.17.138", < "start_timestamp": 1720249599013 < }, < "driver_healthy": true, < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "driver_instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "driver_node_type_id": "Standard_D4s_v3", < "effective_spark_version": "15.2.x-scala2.12", < "enable_elastic_disk": true, < "enable_local_disk_encryption": false, < "init_scripts_safe_mode": false, < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "jdbc_port": 10000, < "last_activity_time": 1720249832646, < "last_restarted_time": 1720249806897, < "last_state_loss_time": 1720249806808, < "node_type_id": "Standard_D4s_v3", < "num_workers": 0, < "pinned_by_user_name": "4183391249163402", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_context_id": 7993977489192808159, < "spark_version": "15.2.x-scala2.12", < "start_time": 1711403415696, < "state": "RUNNING", < "state_message": "" < }, < "... (8 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/external-locations < 200 OK < { < "external_locations": [ < { < "created_at": 1712317369786, < "created_by": "serge.smertin@databricks.com", < "credential_id": "462bd121-a3ff-4f51-899f-236868f3d2ab", < "credential_name": "TEST_STORAGE_CREDENTIAL", < "full_name": "TEST_A_LOCATION", < "id": "98c25265-fb0f-4b15-a727-63855b7f78a7", < "isolation_mode": "ISOLATION_MODE_OPEN", < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "TEST_A_LOCATION", < "owner": "labs.scope.account-admin", < "read_only": false, < "securable_kind": "EXTERNAL_LOCATION_STANDARD", < "securable_type": "EXTERNAL_LOCATION", < "updated_at": 1712566812808, < "updated_by": "serge.smertin@databricks.com", < "url": "TEST_MOUNT_CONTAINER/a" < }, < "... (3 additional elements)" < ] < } 07:18 DEBUG [databricks.labs.blueprint.installation:migrate_external_tables_sync] Loading list from CLOUD_ENV_storage_account_info.csv 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.0/workspace/export?path=/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.FQpM/CLOUD_ENV_storage_account_info.csv&direct_download=true < 200 OK < [raw stream] 07:18 DEBUG [databricks.labs.ucx.framework.crawlers:migrate_external_tables_sync] [hive_metastore.ucx_s0lsz.grants] fetching grants inventory 07:18 DEBUG [databricks.labs.lsql.backends:migrate_external_tables_sync] [spark][fetch] SELECT * FROM hive_metastore.ucx_s0lsz.grants 07:18 DEBUG [databricks.labs.ucx.framework.crawlers:migrate_external_tables_sync] [hive_metastore.ucx_s0lsz.groups] fetching groups inventory 07:18 DEBUG [databricks.labs.lsql.backends:migrate_external_tables_sync] [spark][fetch] SELECT * FROM hive_metastore.ucx_s0lsz.groups 07:18 DEBUG [databricks.labs.ucx.framework.crawlers:migrate_external_tables_sync] [hive_metastore.ucx_s0lsz.tables] fetching tables inventory 07:18 DEBUG [databricks.labs.lsql.backends:migrate_external_tables_sync] [spark][fetch] SELECT * FROM hive_metastore.ucx_s0lsz.tables 07:18 DEBUG [databricks.labs.ucx.framework.crawlers:migrate_external_tables_sync] [hive_metastore.ucx_s0lsz.mounts] fetching mounts inventory 07:18 DEBUG [databricks.labs.lsql.backends:migrate_external_tables_sync] [spark][fetch] SELECT * FROM ucx_s0lsz.mounts 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.0/permissions/clusters/TEST_LEGACY_SPN_CLUSTER_ID < 200 OK < { < "access_control_list": [ < { < "all_permissions": [ < { < "inherited": false, < "permission_level": "CAN_MANAGE" < } < ], < "display_name": "Serge Smertin", < "user_name": "serge.smertin@databricks.com" < }, < "... (1 additional elements)" < ], < "object_id": "/clusters/TEST_LEGACY_SPN_CLUSTER_ID", < "object_type": "cluster" < } 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/catalogs < 200 OK < { < "catalogs": [ < { < "browse_only": false, < "catalog_type": "MANAGED_CATALOG", < "comment": "Main catalog (auto-created)", < "created_at": 1696359177243, < "created_by": "serge.smertin@databricks.com", < "full_name": "main", < "id": "bba166bb-4f35-4d09-a794-6b8fdb29fe18", < "isolation_mode": "OPEN", < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "main", < "owner": "serge.smertin@databricks.com", < "securable_kind": "CATALOG_STANDARD", < "securable_type": "CATALOG", < "updated_at": 1696359177243, < "updated_by": "serge.smertin@databricks.com" < }, < "... (4 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/schemas?catalog_name=main < 200 OK < { < "schemas": [ < { < "browse_only": false, < "catalog_name": "main", < "catalog_type": "MANAGED_CATALOG", < "comment": "Default schema (auto-created)", < "created_at": 1696359177258, < "created_by": "serge.smertin@databricks.com", < "full_name": "main.TEST_SCHEMA", < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "TEST_SCHEMA", < "owner": "serge.smertin@databricks.com", < "schema_id": "382945c5-4402-4c30-be5a-b3f5f0b3ab06", < "securable_kind": "SCHEMA_STANDARD", < "securable_type": "SCHEMA", < "updated_at": 1696359177258, < "updated_by": "serge.smertin@databricks.com" < }, < "... (1 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/tables?catalog_name=main&schema_name=TEST_SCHEMA < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "main", < "columns": [ < { < "name": "id", < "nullable": true, < "position": 0, < "type_json": "{\"name\":\"id\",\"type\":\"long\",\"nullable\":true,\"metadata\":{}}", < "type_name": "LONG", < "type_precision": 0, < "type_scale": 0, < "type_text": "bigint" < }, < "... (2 additional elements)" < ], < "created_at": 1698497863946, < "created_by": "serge.smertin@databricks.com", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "data_source_format": "DELTA", < "delta_runtime_properties_kvpairs": {}, < "full_name": "main.TEST_SCHEMA.dummy", < "generation": 0, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "dummy", < "owner": "serge.smertin@databricks.com", < "properties": { < "delta.checkpoint.writeStatsAsJson": "false", < "delta.checkpoint.writeStatsAsStruct": "true", < "delta.lastCommitTimestamp": "1698497863000", < "delta.lastUpdateVersion": "0", < "delta.minReaderVersion": "1", < "delta.minWriterVersion": "2" < }, < "properties_pairs": { < "properties": { < "delta.checkpoint.writeStatsAsJson": "false", < "delta.checkpoint.writeStatsAsStruct": "true", < "delta.lastCommitTimestamp": "1698497863000", < "delta.lastUpdateVersion": "0", < "delta.minReaderVersion": "1", < "delta.minWriterVersion": "2" < } < }, < "schema_name": "TEST_SCHEMA", < "securable_kind": "TABLE_DELTA", < "securable_type": "TABLE", < "storage_location": "abfss://labs-CLOUD_ENV-TEST_CATALOG-container@databrickslabsstorage.dfs.core.windows.net/8952c1e3-b265-4a... (64 more bytes)", < "table_id": "28504279-361d-4c1a-b5b1-76a13d192281", < "table_type": "MANAGED", < "updated_at": 1698497863946, < "updated_by": "serge.smertin@databricks.com" < } < ] < } 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/tables?catalog_name=main&schema_name=information_schema < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "main", < "columns": [ < { < "comment": "Principal that granted the privilege.", < "name": "grantor", < "nullable": false, < "position": 0, < "type_json": "{\"name\":\"grantor\",\"type\":\"string\",\"nullable\":false,\"metadata\":{\"comment\":\"Principal that granted... (18 more bytes)", < "type_name": "STRING", < "type_precision": 0, < "type_scale": 0, < "type_text": "string" < }, < "... (5 additional elements)" < ], < "comment": "Lists principals that have privileges on the catalogs.", < "created_at": 1696359177258, < "created_by": "System user", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "delta_runtime_properties_kvpairs": {}, < "full_name": "main.information_schema.catalog_privileges", < "generation": 0, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "catalog_privileges", < "owner": "System user", < "properties": { < "view.query.out.col.0": "grantor", < "view.query.out.col.1": "grantee", < "view.query.out.col.2": "catalog_name", < "view.query.out.col.3": "privilege_type", < "view.query.out.col.4": "is_grantable", < "view.query.out.col.5": "inherited_from", < "view.query.out.numCols": "6" < }, < "properties_pairs": { < "properties": { < "view.query.out.col.0": "grantor", < "view.query.out.col.1": "grantee", < "view.query.out.col.2": "catalog_name", < "view.query.out.col.3": "privilege_type", < "view.query.out.col.4": "is_grantable", < "view.query.out.col.5": "inherited_from", < "view.query.out.numCols": "6" < } < }, < "schema_name": "information_schema", < "securable_kind": "TABLE_SYSTEM", < "securable_type": "TABLE", < "table_id": "762d1462-35d6-46c8-9280-147a090b99b3", < "table_type": "VIEW", < "updated_at": 1696359177258, < "updated_by": "System user", < "view_definition": "SELECT * FROM system.information_schema.catalog_privileges WHERE catalog_name = 'main'" < }, < "... (27 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/schemas?catalog_name=TEST_CATALOG < 200 OK < { < "schemas": [ < { < "browse_only": false, < "catalog_name": "TEST_CATALOG", < "catalog_type": "MANAGED_CATALOG", < "created_at": 1712316840772, < "created_by": "serge.smertin@databricks.com", < "full_name": "TEST_CATALOG.TEST_SCHEMA", < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "TEST_SCHEMA", < "owner": "serge.smertin@databricks.com", < "schema_id": "8f7855ec-de46-4e1c-af0f-a3f516fe9112", < "securable_kind": "SCHEMA_STANDARD", < "securable_type": "SCHEMA", < "updated_at": 1712316840772, < "updated_by": "serge.smertin@databricks.com" < }, < "... (1 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/tables?catalog_name=TEST_CATALOG&schema_name=TEST_SCHEMA < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "TEST_CATALOG", < "columns": [ < { < "name": "first", < "nullable": false, < "position": 0, < "type_json": "{\"name\":\"first\",\"type\":\"string\",\"nullable\":false,\"metadata\":{}}", < "type_name": "STRING", < "type_precision": 0, < "type_scale": 0, < "type_text": "string" < }, < "... (1 additional elements)" < ], < "created_at": 1712923653973, < "created_by": "william.conti@databricks.com", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "data_source_format": "DELTA", < "delta_runtime_properties_kvpairs": {}, < "full_name": "TEST_CATALOG.TEST_SCHEMA.foo", < "generation": 0, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "foo", < "owner": "william.conti@databricks.com", < "properties": { < "delta.checkpoint.writeStatsAsJson": "false", < "delta.checkpoint.writeStatsAsStruct": "true", < "delta.enableDeletionVectors": "true", < "delta.feature.deletionVectors": "supported", < "delta.feature.invariants": "supported", < "delta.lastCommitTimestamp": "1712923653000", < "delta.lastUpdateVersion": "0", < "delta.minReaderVersion": "3", < "delta.minWriterVersion": "7" < }, < "properties_pairs": { < "properties": { < "delta.checkpoint.writeStatsAsJson": "false", < "delta.checkpoint.writeStatsAsStruct": "true", < "delta.enableDeletionVectors": "true", < "delta.feature.deletionVectors": "supported", < "delta.feature.invariants": "supported", < "delta.lastCommitTimestamp": "1712923653000", < "delta.lastUpdateVersion": "0", < "delta.minReaderVersion": "3", < "delta.minWriterVersion": "7" < } < }, < "schema_name": "TEST_SCHEMA", < "securable_kind": "TABLE_DELTA", < "securable_type": "TABLE", < "storage_location": "abfss://labs-CLOUD_ENV-TEST_CATALOG-container@databrickslabsstorage.dfs.core.windows.net/8952c1e3-b265-4a... (64 more bytes)", < "table_id": "ddb0d4b1-4e58-40f0-afa8-af19b68715d4", < "table_type": "MANAGED", < "updated_at": 1712923653973, < "updated_by": "william.conti@databricks.com" < } < ] < } 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/tables?catalog_name=TEST_CATALOG&schema_name=information_schema < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "TEST_CATALOG", < "columns": [ < { < "comment": "Principal that granted the privilege.", < "name": "grantor", < "nullable": false, < "position": 0, < "type_json": "{\"name\":\"grantor\",\"type\":\"string\",\"nullable\":false,\"metadata\":{\"comment\":\"Principal that granted... (18 more bytes)", < "type_name": "STRING", < "type_precision": 0, < "type_scale": 0, < "type_text": "string" < }, < "... (5 additional elements)" < ], < "comment": "Lists principals that have privileges on the catalogs.", < "created_at": 1712148158177, < "created_by": "System user", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "delta_runtime_properties_kvpairs": {}, < "full_name": "TEST_CATALOG.information_schema.catalog_privileges", < "generation": 0, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "catalog_privileges", < "owner": "System user", < "properties": { < "view.query.out.col.0": "grantor", < "view.query.out.col.1": "grantee", < "view.query.out.col.2": "catalog_name", < "view.query.out.col.3": "privilege_type", < "view.query.out.col.4": "is_grantable", < "view.query.out.col.5": "inherited_from", < "view.query.out.numCols": "6" < }, < "properties_pairs": { < "properties": { < "view.query.out.col.0": "grantor", < "view.query.out.col.1": "grantee", < "view.query.out.col.2": "catalog_name", < "view.query.out.col.3": "privilege_type", < "view.query.out.col.4": "is_grantable", < "view.query.out.col.5": "inherited_from", < "view.query.out.numCols": "6" < } < }, < "schema_name": "information_schema", < "securable_kind": "TABLE_SYSTEM", < "securable_type": "TABLE", < "table_id": "d9284504-8f54-470b-9e23-c235768ddcf1", < "table_type": "VIEW", < "updated_at": 1712148158177, < "updated_by": "System user", < "view_definition": "SELECT * FROM system.information_schema.catalog_privileges WHERE catalog_name = 'TEST_CATALOG'" < }, < "... (27 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/schemas?catalog_name=system < 200 OK < { < "schemas": [ < { < "browse_only": false, < "catalog_name": "system", < "catalog_type": "SYSTEM_CATALOG", < "created_at": 1710734599812, < "created_by": "System user", < "full_name": "system.access", < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "access", < "owner": "System user", < "schema_id": "3fd0cfdc-5ad5-4232-90bb-04fa12d06617", < "securable_kind": "SCHEMA_SYSTEM", < "securable_type": "SCHEMA", < "updated_at": 1710734599812, < "updated_by": "System user" < }, < "... (7 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/tables?catalog_name=system&schema_name=access < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "system", < "columns": [ < { < "name": "account_id", < "nullable": true, < "position": 0, < "type_json": "{\"name\":\"account_id\",\"type\":\"string\",\"nullable\":true,\"metadata\":{}}", < "type_name": "STRING", < "type_precision": 0, < "type_scale": 0, < "type_text": "string" < }, < "... (15 additional elements)" < ], < "created_at": 1710734599843, < "created_by": "System user", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "data_source_format": "DELTASHARING", < "delta_runtime_properties_kvpairs": {}, < "full_name": "system.access.audit", < "generation": 13, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "audit", < "owner": "System user", < "properties": { < "delta.autoOptimize.autoCompact": "auto", < "delta.autoOptimize.optimizeWrite": "true", < "delta.enableChangeDataFeed": "true", < "delta.lastCommitTimestamp": "1718981307000", < "delta.lastUpdateVersion": "154386", < "delta.minReaderVersion": "1", < "delta.minWriterVersion": "4" < }, < "properties_pairs": { < "properties": { < "delta.autoOptimize.autoCompact": "auto", < "delta.autoOptimize.optimizeWrite": "true", < "delta.enableChangeDataFeed": "true", < "delta.lastCommitTimestamp": "1718981307000", < "delta.lastUpdateVersion": "154386", < "delta.minReaderVersion": "1", < "delta.minWriterVersion": "4" < } < }, < "schema_name": "access", < "securable_kind": "TABLE_SYSTEM_DELTASHARING", < "securable_type": "TABLE", < "storage_location": "uc-deltasharing://system.access.audit#system.access.audit", < "table_id": "903ad991-71da-466d-8357-b2a23b02038f", < "table_type": "MANAGED", < "updated_at": 1718981323508, < "updated_by": "System user" < }, < "... (3 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/tables?catalog_name=system&schema_name=ai < 200 OK < {} 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/tables?catalog_name=system&schema_name=billing < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "system", < "created_at": 1712185605206, < "created_by": "System user", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "data_source_format": "DELTASHARING", < "delta_runtime_properties_kvpairs": {}, < "full_name": "system.billing.list_prices", < "generation": 0, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "list_prices", < "owner": "System user", < "schema_name": "billing", < "securable_kind": "TABLE_SYSTEM_DELTASHARING", < "securable_type": "TABLE", < "storage_location": "uc-deltasharing://system.billing.list_prices#system.billing.list_prices", < "table_id": "3e71cdc4-467d-495c-b4d7-cef63fcecb3d", < "table_type": "MANAGED", < "updated_at": 1712185605206, < "updated_by": "System user" < }, < "... (1 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/tables?catalog_name=system&schema_name=compute < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "system", < "columns": [ < { < "name": "account_id", < "nullable": true, < "position": 0, < "type_json": "{\"name\":\"account_id\",\"type\":\"string\",\"nullable\":true,\"metadata\":{}}", < "type_name": "STRING", < "type_precision": 0, < "type_scale": 0, < "type_text": "string" < }, < "... (24 additional elements)" < ], < "created_at": 1712185610644, < "created_by": "System user", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "data_source_format": "DELTASHARING", < "delta_runtime_properties_kvpairs": {}, < "full_name": "system.compute.clusters", < "generation": 1, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "clusters", < "owner": "System user", < "properties": { < "deltaSharing.enableChangeDataFeed": "true" < }, < "properties_pairs": { < "properties": { < "deltaSharing.enableChangeDataFeed": "true" < } < }, < "schema_name": "compute", < "securable_kind": "TABLE_SYSTEM_DELTASHARING", < "securable_type": "TABLE", < "storage_location": "uc-deltasharing://system.compute.clusters#system.compute.clusters", < "table_id": "cd40a20d-464e-4e9e-8fe5-a9b7c79f2445", < "table_type": "MANAGED", < "updated_at": 1712185676459, < "updated_by": "System user" < }, < "... (3 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/tables?catalog_name=system&schema_name=information_schema < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "system", < "columns": [ < { < "comment": "Principal that granted the privilege.", < "name": "grantor", < "nullable": false, < "position": 0, < "type_json": "{\"name\":\"grantor\",\"type\":\"string\",\"nullable\":false,\"metadata\":{\"comment\":\"Principal that granted... (18 more bytes)", < "type_name": "STRING", < "type_precision": 0, < "type_scale": 0, < "type_text": "string" < }, < "... (5 additional elements)" < ], < "comment": "Lists principals that have privileges on the catalogs.", < "created_at": 1696359177071, < "created_by": "System user", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "data_source_format": "UNITY_CATALOG", < "delta_runtime_properties_kvpairs": {}, < "full_name": "system.information_schema.catalog_privileges", < "generation": 0, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "catalog_privileges", < "owner": "System user", < "schema_name": "information_schema", < "securable_kind": "TABLE_SYSTEM", < "securable_type": "TABLE", < "table_id": "231f3847-910c-4b6e-bcac-5b92bf5dcd53", < "table_type": "EXTERNAL", < "updated_at": 1696359177071, < "updated_by": "System user" < }, < "... (42 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/tables?catalog_name=system&schema_name=lineage < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "system", < "created_at": 1712185633489, < "created_by": "System user", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "data_source_format": "DELTASHARING", < "delta_runtime_properties_kvpairs": {}, < "full_name": "system.lineage.column_lineage", < "generation": 0, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "column_lineage", < "owner": "System user", < "schema_name": "lineage", < "securable_kind": "TABLE_SYSTEM_DELTASHARING", < "securable_type": "TABLE", < "storage_location": "uc-deltasharing://system.lineage.column_lineage#system.lineage.column_lineage", < "table_id": "3d9f6c7a-eac4-4bd7-b505-7d3b0ee04bab", < "table_type": "MANAGED", < "updated_at": 1712185633489, < "updated_by": "System user" < }, < "... (1 additional elements)" < ] < } 07:18 INFO [databricks.labs.ucx:migrate_dbfs_root_non_delta_tables] UCX v0.28.1+920240706071434 After job finishes, see debug logs at /Workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.FQpM/logs/migrate-tables/run-208191967108727-0/migrate_dbfs_root_non_delta_tables.log 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.0/clusters/list < 200 OK < { < "clusters": [ < { < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": { < "availability": "SPOT_WITH_FALLBACK_AZURE", < "first_on_demand": 2147483647, < "spot_bid_max_price": -1.0 < }, < "cluster_cores": 4.0, < "cluster_id": "DATABRICKS_CLUSTER_ID", < "cluster_memory_mb": 16384, < "cluster_name": "DEFAULT Test Cluster (Single Node, No Isolation)", < "cluster_source": "UI", < "creator_user_name": "serge.smertin@databricks.com", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "TEST_SCHEMA_tags": { < "Budget": "opex.sales.labs", < "ClusterId": "DATABRICKS_CLUSTER_ID", < "ClusterName": "DEFAULT Test Cluster (Single Node, No Isolation)", < "Creator": "serge.smertin@databricks.com", < "DatabricksInstanceGroupId": "-6814024147286011579", < "DatabricksInstancePoolCreatorId": "4183391249163402", < "DatabricksInstancePoolId": "TEST_INSTANCE_POOL_ID", < "Owner": "labs-oss@databricks.com", < "Vendor": "Databricks" < }, < "disk_spec": {}, < "driver": { < "host_private_ip": "10.139.0.15", < "instance_id": "a0edf99c9fca40bc8a18e4e00478f73c", < "node_attributes": { < "is_spot": false < }, < "node_id": "4df542d2ac904435a0ebba4bf4944c03", < "private_ip": "10.139.64.15", < "public_dns": "172.177.17.138", < "start_timestamp": 1720249599013 < }, < "driver_healthy": true, < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "driver_instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "driver_node_type_id": "Standard_D4s_v3", < "effective_spark_version": "15.2.x-scala2.12", < "enable_elastic_disk": true, < "enable_local_disk_encryption": false, < "init_scripts_safe_mode": false, < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "jdbc_port": 10000, < "last_activity_time": 1720249832646, < "last_restarted_time": 1720249806897, < "last_state_loss_time": 1720249806808, < "node_type_id": "Standard_D4s_v3", < "num_workers": 0, < "pinned_by_user_name": "4183391249163402", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_context_id": 7993977489192808159, < "spark_version": "15.2.x-scala2.12", < "start_time": 1711403415696, < "state": "RUNNING", < "state_message": "" < }, < "... (8 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/external-locations < 200 OK < { < "external_locations": [ < { < "created_at": 1712317369786, < "created_by": "serge.smertin@databricks.com", < "credential_id": "462bd121-a3ff-4f51-899f-236868f3d2ab", < "credential_name": "TEST_STORAGE_CREDENTIAL", < "full_name": "TEST_A_LOCATION", < "id": "98c25265-fb0f-4b15-a727-63855b7f78a7", < "isolation_mode": "ISOLATION_MODE_OPEN", < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "TEST_A_LOCATION", < "owner": "labs.scope.account-admin", < "read_only": false, < "securable_kind": "EXTERNAL_LOCATION_STANDARD", < "securable_type": "EXTERNAL_LOCATION", < "updated_at": 1712566812808, < "updated_by": "serge.smertin@databricks.com", < "url": "TEST_MOUNT_CONTAINER/a" < }, < "... (3 additional elements)" < ] < } 07:18 DEBUG [databricks.labs.blueprint.installation:migrate_dbfs_root_non_delta_tables] Loading list from CLOUD_ENV_storage_account_info.csv 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.0/workspace/export?path=/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.FQpM/CLOUD_ENV_storage_account_info.csv&direct_download=true < 200 OK < [raw stream] 07:18 DEBUG [databricks.labs.ucx.framework.crawlers:migrate_dbfs_root_non_delta_tables] [hive_metastore.ucx_s0lsz.grants] fetching grants inventory 07:18 DEBUG [databricks.labs.lsql.backends:migrate_dbfs_root_non_delta_tables] [spark][fetch] SELECT * FROM hive_metastore.ucx_s0lsz.grants 07:18 DEBUG [databricks.labs.ucx.framework.crawlers:migrate_dbfs_root_non_delta_tables] [hive_metastore.ucx_s0lsz.groups] fetching groups inventory 07:18 DEBUG [databricks.labs.lsql.backends:migrate_dbfs_root_non_delta_tables] [spark][fetch] SELECT * FROM hive_metastore.ucx_s0lsz.groups 07:18 DEBUG [databricks.labs.ucx.framework.crawlers:migrate_dbfs_root_non_delta_tables] [hive_metastore.ucx_s0lsz.tables] fetching tables inventory 07:18 DEBUG [databricks.labs.lsql.backends:migrate_dbfs_root_non_delta_tables] [spark][fetch] SELECT * FROM hive_metastore.ucx_s0lsz.tables 07:18 DEBUG [databricks.labs.ucx.framework.crawlers:migrate_dbfs_root_non_delta_tables] [hive_metastore.ucx_s0lsz.mounts] fetching mounts inventory 07:18 DEBUG [databricks.labs.lsql.backends:migrate_dbfs_root_non_delta_tables] [spark][fetch] SELECT * FROM ucx_s0lsz.mounts 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.0/permissions/clusters/TEST_LEGACY_SPN_CLUSTER_ID < 200 OK < { < "access_control_list": [ < { < "all_permissions": [ < { < "inherited": false, < "permission_level": "CAN_MANAGE" < } < ], < "display_name": "Serge Smertin", < "user_name": "serge.smertin@databricks.com" < }, < "... (1 additional elements)" < ], < "object_id": "/clusters/TEST_LEGACY_SPN_CLUSTER_ID", < "object_type": "cluster" < } 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/catalogs < 200 OK < { < "catalogs": [ < { < "browse_only": false, < "catalog_type": "MANAGED_CATALOG", < "comment": "Main catalog (auto-created)", < "created_at": 1696359177243, < "created_by": "serge.smertin@databricks.com", < "full_name": "main", < "id": "bba166bb-4f35-4d09-a794-6b8fdb29fe18", < "isolation_mode": "OPEN", < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "main", < "owner": "serge.smertin@databricks.com", < "securable_kind": "CATALOG_STANDARD", < "securable_type": "CATALOG", < "updated_at": 1696359177243, < "updated_by": "serge.smertin@databricks.com" < }, < "... (4 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/schemas?catalog_name=main < 200 OK < { < "schemas": [ < { < "browse_only": false, < "catalog_name": "main", < "catalog_type": "MANAGED_CATALOG", < "comment": "Default schema (auto-created)", < "created_at": 1696359177258, < "created_by": "serge.smertin@databricks.com", < "full_name": "main.TEST_SCHEMA", < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "TEST_SCHEMA", < "owner": "serge.smertin@databricks.com", < "schema_id": "382945c5-4402-4c30-be5a-b3f5f0b3ab06", < "securable_kind": "SCHEMA_STANDARD", < "securable_type": "SCHEMA", < "updated_at": 1696359177258, < "updated_by": "serge.smertin@databricks.com" < }, < "... (1 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/tables?catalog_name=main&schema_name=TEST_SCHEMA < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "main", < "columns": [ < { < "name": "id", < "nullable": true, < "position": 0, < "type_json": "{\"name\":\"id\",\"type\":\"long\",\"nullable\":true,\"metadata\":{}}", < "type_name": "LONG", < "type_precision": 0, < "type_scale": 0, < "type_text": "bigint" < }, < "... (2 additional elements)" < ], < "created_at": 1698497863946, < "created_by": "serge.smertin@databricks.com", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "data_source_format": "DELTA", < "delta_runtime_properties_kvpairs": {}, < "full_name": "main.TEST_SCHEMA.dummy", < "generation": 0, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "dummy", < "owner": "serge.smertin@databricks.com", < "properties": { < "delta.checkpoint.writeStatsAsJson": "false", < "delta.checkpoint.writeStatsAsStruct": "true", < "delta.lastCommitTimestamp": "1698497863000", < "delta.lastUpdateVersion": "0", < "delta.minReaderVersion": "1", < "delta.minWriterVersion": "2" < }, < "properties_pairs": { < "properties": { < "delta.checkpoint.writeStatsAsJson": "false", < "delta.checkpoint.writeStatsAsStruct": "true", < "delta.lastCommitTimestamp": "1698497863000", < "delta.lastUpdateVersion": "0", < "delta.minReaderVersion": "1", < "delta.minWriterVersion": "2" < } < }, < "schema_name": "TEST_SCHEMA", < "securable_kind": "TABLE_DELTA", < "securable_type": "TABLE", < "storage_location": "abfss://labs-CLOUD_ENV-TEST_CATALOG-container@databrickslabsstorage.dfs.core.windows.net/8952c1e3-b265-4a... (64 more bytes)", < "table_id": "28504279-361d-4c1a-b5b1-76a13d192281", < "table_type": "MANAGED", < "updated_at": 1698497863946, < "updated_by": "serge.smertin@databricks.com" < } < ] < } 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/tables?catalog_name=main&schema_name=information_schema < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "main", < "columns": [ < { < "comment": "Principal that granted the privilege.", < "name": "grantor", < "nullable": false, < "position": 0, < "type_json": "{\"name\":\"grantor\",\"type\":\"string\",\"nullable\":false,\"metadata\":{\"comment\":\"Principal that granted... (18 more bytes)", < "type_name": "STRING", < "type_precision": 0, < "type_scale": 0, < "type_text": "string" < }, < "... (5 additional elements)" < ], < "comment": "Lists principals that have privileges on the catalogs.", < "created_at": 1696359177258, < "created_by": "System user", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "delta_runtime_properties_kvpairs": {}, < "full_name": "main.information_schema.catalog_privileges", < "generation": 0, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "catalog_privileges", < "owner": "System user", < "properties": { < "view.query.out.col.0": "grantor", < "view.query.out.col.1": "grantee", < "view.query.out.col.2": "catalog_name", < "view.query.out.col.3": "privilege_type", < "view.query.out.col.4": "is_grantable", < "view.query.out.col.5": "inherited_from", < "view.query.out.numCols": "6" < }, < "properties_pairs": { < "properties": { < "view.query.out.col.0": "grantor", < "view.query.out.col.1": "grantee", < "view.query.out.col.2": "catalog_name", < "view.query.out.col.3": "privilege_type", < "view.query.out.col.4": "is_grantable", < "view.query.out.col.5": "inherited_from", < "view.query.out.numCols": "6" < } < }, < "schema_name": "information_schema", < "securable_kind": "TABLE_SYSTEM", < "securable_type": "TABLE", < "table_id": "762d1462-35d6-46c8-9280-147a090b99b3", < "table_type": "VIEW", < "updated_at": 1696359177258, < "updated_by": "System user", < "view_definition": "SELECT * FROM system.information_schema.catalog_privileges WHERE catalog_name = 'main'" < }, < "... (27 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/schemas?catalog_name=TEST_CATALOG < 200 OK < { < "schemas": [ < { < "browse_only": false, < "catalog_name": "TEST_CATALOG", < "catalog_type": "MANAGED_CATALOG", < "created_at": 1712316840772, < "created_by": "serge.smertin@databricks.com", < "full_name": "TEST_CATALOG.TEST_SCHEMA", < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "TEST_SCHEMA", < "owner": "serge.smertin@databricks.com", < "schema_id": "8f7855ec-de46-4e1c-af0f-a3f516fe9112", < "securable_kind": "SCHEMA_STANDARD", < "securable_type": "SCHEMA", < "updated_at": 1712316840772, < "updated_by": "serge.smertin@databricks.com" < }, < "... (1 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/tables?catalog_name=TEST_CATALOG&schema_name=TEST_SCHEMA < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "TEST_CATALOG", < "columns": [ < { < "name": "first", < "nullable": false, < "position": 0, < "type_json": "{\"name\":\"first\",\"type\":\"string\",\"nullable\":false,\"metadata\":{}}", < "type_name": "STRING", < "type_precision": 0, < "type_scale": 0, < "type_text": "string" < }, < "... (1 additional elements)" < ], < "created_at": 1712923653973, < "created_by": "william.conti@databricks.com", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "data_source_format": "DELTA", < "delta_runtime_properties_kvpairs": {}, < "full_name": "TEST_CATALOG.TEST_SCHEMA.foo", < "generation": 0, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "foo", < "owner": "william.conti@databricks.com", < "properties": { < "delta.checkpoint.writeStatsAsJson": "false", < "delta.checkpoint.writeStatsAsStruct": "true", < "delta.enableDeletionVectors": "true", < "delta.feature.deletionVectors": "supported", < "delta.feature.invariants": "supported", < "delta.lastCommitTimestamp": "1712923653000", < "delta.lastUpdateVersion": "0", < "delta.minReaderVersion": "3", < "delta.minWriterVersion": "7" < }, < "properties_pairs": { < "properties": { < "delta.checkpoint.writeStatsAsJson": "false", < "delta.checkpoint.writeStatsAsStruct": "true", < "delta.enableDeletionVectors": "true", < "delta.feature.deletionVectors": "supported", < "delta.feature.invariants": "supported", < "delta.lastCommitTimestamp": "1712923653000", < "delta.lastUpdateVersion": "0", < "delta.minReaderVersion": "3", < "delta.minWriterVersion": "7" < } < }, < "schema_name": "TEST_SCHEMA", < "securable_kind": "TABLE_DELTA", < "securable_type": "TABLE", < "storage_location": "abfss://labs-CLOUD_ENV-TEST_CATALOG-container@databrickslabsstorage.dfs.core.windows.net/8952c1e3-b265-4a... (64 more bytes)", < "table_id": "ddb0d4b1-4e58-40f0-afa8-af19b68715d4", < "table_type": "MANAGED", < "updated_at": 1712923653973, < "updated_by": "william.conti@databricks.com" < } < ] < } 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/tables?catalog_name=TEST_CATALOG&schema_name=information_schema < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "TEST_CATALOG", < "columns": [ < { < "comment": "Principal that granted the privilege.", < "name": "grantor", < "nullable": false, < "position": 0, < "type_json": "{\"name\":\"grantor\",\"type\":\"string\",\"nullable\":false,\"metadata\":{\"comment\":\"Principal that granted... (18 more bytes)", < "type_name": "STRING", < "type_precision": 0, < "type_scale": 0, < "type_text": "string" < }, < "... (5 additional elements)" < ], < "comment": "Lists principals that have privileges on the catalogs.", < "created_at": 1712148158177, < "created_by": "System user", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "delta_runtime_properties_kvpairs": {}, < "full_name": "TEST_CATALOG.information_schema.catalog_privileges", < "generation": 0, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "catalog_privileges", < "owner": "System user", < "properties": { < "view.query.out.col.0": "grantor", < "view.query.out.col.1": "grantee", < "view.query.out.col.2": "catalog_name", < "view.query.out.col.3": "privilege_type", < "view.query.out.col.4": "is_grantable", < "view.query.out.col.5": "inherited_from", < "view.query.out.numCols": "6" < }, < "properties_pairs": { < "properties": { < "view.query.out.col.0": "grantor", < "view.query.out.col.1": "grantee", < "view.query.out.col.2": "catalog_name", < "view.query.out.col.3": "privilege_type", < "view.query.out.col.4": "is_grantable", < "view.query.out.col.5": "inherited_from", < "view.query.out.numCols": "6" < } < }, < "schema_name": "information_schema", < "securable_kind": "TABLE_SYSTEM", < "securable_type": "TABLE", < "table_id": "d9284504-8f54-470b-9e23-c235768ddcf1", < "table_type": "VIEW", < "updated_at": 1712148158177, < "updated_by": "System user", < "view_definition": "SELECT * FROM system.information_schema.catalog_privileges WHERE catalog_name = 'TEST_CATALOG'" < }, < "... (27 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/schemas?catalog_name=system < 200 OK < { < "schemas": [ < { < "browse_only": false, < "catalog_name": "system", < "catalog_type": "SYSTEM_CATALOG", < "created_at": 1710734599812, < "created_by": "System user", < "full_name": "system.access", < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "access", < "owner": "System user", < "schema_id": "3fd0cfdc-5ad5-4232-90bb-04fa12d06617", < "securable_kind": "SCHEMA_SYSTEM", < "securable_type": "SCHEMA", < "updated_at": 1710734599812, < "updated_by": "System user" < }, < "... (7 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/tables?catalog_name=system&schema_name=access < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "system", < "columns": [ < { < "name": "account_id", < "nullable": true, < "position": 0, < "type_json": "{\"name\":\"account_id\",\"type\":\"string\",\"nullable\":true,\"metadata\":{}}", < "type_name": "STRING", < "type_precision": 0, < "type_scale": 0, < "type_text": "string" < }, < "... (15 additional elements)" < ], < "created_at": 1710734599843, < "created_by": "System user", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "data_source_format": "DELTASHARING", < "delta_runtime_properties_kvpairs": {}, < "full_name": "system.access.audit", < "generation": 13, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "audit", < "owner": "System user", < "properties": { < "delta.autoOptimize.autoCompact": "auto", < "delta.autoOptimize.optimizeWrite": "true", < "delta.enableChangeDataFeed": "true", < "delta.lastCommitTimestamp": "1718981307000", < "delta.lastUpdateVersion": "154386", < "delta.minReaderVersion": "1", < "delta.minWriterVersion": "4" < }, < "properties_pairs": { < "properties": { < "delta.autoOptimize.autoCompact": "auto", < "delta.autoOptimize.optimizeWrite": "true", < "delta.enableChangeDataFeed": "true", < "delta.lastCommitTimestamp": "1718981307000", < "delta.lastUpdateVersion": "154386", < "delta.minReaderVersion": "1", < "delta.minWriterVersion": "4" < } < }, < "schema_name": "access", < "securable_kind": "TABLE_SYSTEM_DELTASHARING", < "securable_type": "TABLE", < "storage_location": "uc-deltasharing://system.access.audit#system.access.audit", < "table_id": "903ad991-71da-466d-8357-b2a23b02038f", < "table_type": "MANAGED", < "updated_at": 1718981323508, < "updated_by": "System user" < }, < "... (3 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/tables?catalog_name=system&schema_name=ai < 200 OK < {} 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/tables?catalog_name=system&schema_name=billing < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "system", < "created_at": 1712185605206, < "created_by": "System user", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "data_source_format": "DELTASHARING", < "delta_runtime_properties_kvpairs": {}, < "full_name": "system.billing.list_prices", < "generation": 0, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "list_prices", < "owner": "System user", < "schema_name": "billing", < "securable_kind": "TABLE_SYSTEM_DELTASHARING", < "securable_type": "TABLE", < "storage_location": "uc-deltasharing://system.billing.list_prices#system.billing.list_prices", < "table_id": "3e71cdc4-467d-495c-b4d7-cef63fcecb3d", < "table_type": "MANAGED", < "updated_at": 1712185605206, < "updated_by": "System user" < }, < "... (1 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/tables?catalog_name=system&schema_name=compute < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "system", < "columns": [ < { < "name": "account_id", < "nullable": true, < "position": 0, < "type_json": "{\"name\":\"account_id\",\"type\":\"string\",\"nullable\":true,\"metadata\":{}}", < "type_name": "STRING", < "type_precision": 0, < "type_scale": 0, < "type_text": "string" < }, < "... (24 additional elements)" < ], < "created_at": 1712185610644, < "created_by": "System user", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "data_source_format": "DELTASHARING", < "delta_runtime_properties_kvpairs": {}, < "full_name": "system.compute.clusters", < "generation": 1, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "clusters", < "owner": "System user", < "properties": { < "deltaSharing.enableChangeDataFeed": "true" < }, < "properties_pairs": { < "properties": { < "deltaSharing.enableChangeDataFeed": "true" < } < }, < "schema_name": "compute", < "securable_kind": "TABLE_SYSTEM_DELTASHARING", < "securable_type": "TABLE", < "storage_location": "uc-deltasharing://system.compute.clusters#system.compute.clusters", < "table_id": "cd40a20d-464e-4e9e-8fe5-a9b7c79f2445", < "table_type": "MANAGED", < "updated_at": 1712185676459, < "updated_by": "System user" < }, < "... (3 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/tables?catalog_name=system&schema_name=information_schema < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "system", < "columns": [ < { < "comment": "Principal that granted the privilege.", < "name": "grantor", < "nullable": false, < "position": 0, < "type_json": "{\"name\":\"grantor\",\"type\":\"string\",\"nullable\":false,\"metadata\":{\"comment\":\"Principal that granted... (18 more bytes)", < "type_name": "STRING", < "type_precision": 0, < "type_scale": 0, < "type_text": "string" < }, < "... (5 additional elements)" < ], < "comment": "Lists principals that have privileges on the catalogs.", < "created_at": 1696359177071, < "created_by": "System user", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "data_source_format": "UNITY_CATALOG", < "delta_runtime_properties_kvpairs": {}, < "full_name": "system.information_schema.catalog_privileges", < "generation": 0, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "catalog_privileges", < "owner": "System user", < "schema_name": "information_schema", < "securable_kind": "TABLE_SYSTEM", < "securable_type": "TABLE", < "table_id": "231f3847-910c-4b6e-bcac-5b92bf5dcd53", < "table_type": "EXTERNAL", < "updated_at": 1696359177071, < "updated_by": "System user" < }, < "... (42 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/tables?catalog_name=system&schema_name=lineage < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "system", < "created_at": 1712185633489, < "created_by": "System user", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "data_source_format": "DELTASHARING", < "delta_runtime_properties_kvpairs": {}, < "full_name": "system.lineage.column_lineage", < "generation": 0, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "column_lineage", < "owner": "System user", < "schema_name": "lineage", < "securable_kind": "TABLE_SYSTEM_DELTASHARING", < "securable_type": "TABLE", < "storage_location": "uc-deltasharing://system.lineage.column_lineage#system.lineage.column_lineage", < "table_id": "3d9f6c7a-eac4-4bd7-b505-7d3b0ee04bab", < "table_type": "MANAGED", < "updated_at": 1712185633489, < "updated_by": "System user" < }, < "... (1 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/tables?catalog_name=system&schema_name=marketplace < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "system", < "created_at": 1712185623488, < "created_by": "System user", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "data_source_format": "DELTASHARING", < "delta_runtime_properties_kvpairs": {}, < "full_name": "system.marketplace.listing_access_events", < "generation": 0, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "listing_access_events", < "owner": "System user", < "schema_name": "marketplace", < "securable_kind": "TABLE_SYSTEM_DELTASHARING", < "securable_type": "TABLE", < "storage_location": "uc-deltasharing://system.marketplace.listing_access_events#system.marketplace.listing_access_eve... (3 more bytes)", < "table_id": "44b2524e-4f6b-4c99-99a5-452d41ddb741", < "table_type": "MANAGED", < "updated_at": 1712185623488, < "updated_by": "System user" < }, < "... (1 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/tables?catalog_name=system&schema_name=storage < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "system", < "created_at": 1712185579237, < "created_by": "System user", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "data_source_format": "DELTASHARING", < "delta_runtime_properties_kvpairs": {}, < "full_name": "system.storage.predictive_optimization_operations_history", < "generation": 0, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "predictive_optimization_operations_history", < "owner": "System user", < "schema_name": "storage", < "securable_kind": "TABLE_SYSTEM_DELTASHARING", < "securable_type": "TABLE", < "storage_location": "uc-deltasharing://system.storage.predictive_optimization_operations_history#system.storage.predi... (37 more bytes)", < "table_id": "d80a9a27-d4f7-42c5-adc0-fabf6a948192", < "table_type": "MANAGED", < "updated_at": 1712185579237, < "updated_by": "System user" < } < ] < } 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/schemas?catalog_name=ucx_ccq7s < 200 OK < { < "schemas": [ < { < "browse_only": false, < "catalog_name": "ucx_ccq7s", < "catalog_type": "MANAGED_CATALOG", < "comment": "Default schema (auto-created)", < "created_at": 1720249859767, < "created_by": "0a330eb5-dd51-4d97-b6e4-c474356b1d5d", < "full_name": "ucx_ccq7s.TEST_SCHEMA", < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "TEST_SCHEMA", < "owner": "0a330eb5-dd51-4d97-b6e4-c474356b1d5d", < "schema_id": "5ddaad09-aa39-444f-b78a-8be439490bac", < "securable_kind": "SCHEMA_STANDARD", < "securable_type": "SCHEMA", < "updated_at": 1720249859767, < "updated_by": "0a330eb5-dd51-4d97-b6e4-c474356b1d5d" < }, < "... (2 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/tables?catalog_name=ucx_ccq7s&schema_name=TEST_SCHEMA < 200 OK < {} 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/tables?catalog_name=ucx_ccq7s&schema_name=information_schema < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "ucx_ccq7s", < "columns": [ < { < "comment": "Principal that granted the privilege.", < "name": "grantor", < "nullable": false, < "position": 0, < "type_json": "{\"name\":\"grantor\",\"type\":\"string\",\"nullable\":false,\"metadata\":{\"comment\":\"Principal that granted... (18 more bytes)", < "type_name": "STRING", < "type_precision": 0, < "type_scale": 0, < "type_text": "string" < }, < "... (5 additional elements)" < ], < "comment": "Lists principals that have privileges on the catalogs.", < "created_at": 1720249859767, < "created_by": "System user", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "delta_runtime_properties_kvpairs": {}, < "full_name": "ucx_ccq7s.information_schema.catalog_privileges", < "generation": 0, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "catalog_privileges", < "owner": "System user", < "properties": { < "view.query.out.col.0": "grantor", < "view.query.out.col.1": "grantee", < "view.query.out.col.2": "catalog_name", < "view.query.out.col.3": "privilege_type", < "view.query.out.col.4": "is_grantable", < "view.query.out.col.5": "inherited_from", < "view.query.out.numCols": "6" < }, < "properties_pairs": { < "properties": { < "view.query.out.col.0": "grantor", < "view.query.out.col.1": "grantee", < "view.query.out.col.2": "catalog_name", < "view.query.out.col.3": "privilege_type", < "view.query.out.col.4": "is_grantable", < "view.query.out.col.5": "inherited_from", < "view.query.out.numCols": "6" < } < }, < "schema_name": "information_schema", < "securable_kind": "TABLE_SYSTEM", < "securable_type": "TABLE", < "table_id": "9bcecae5-a970-4f29-a37f-14c6dced4836", < "table_type": "VIEW", < "updated_at": 1720249859767, < "updated_by": "System user", < "view_definition": "SELECT * FROM system.information_schema.catalog_privileges WHERE catalog_name = 'ucx_ccq7s'" < }, < "... (27 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/tables?catalog_name=ucx_ccq7s&schema_name=migrate_eq5ls < 200 OK < {} 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/schemas?catalog_name=ucx_ckvdw < 200 OK < { < "schemas": [ < { < "browse_only": false, < "catalog_name": "ucx_ckvdw", < "catalog_type": "MANAGED_CATALOG", < "comment": "Default schema (auto-created)", < "created_at": 1720250186244, < "created_by": "0a330eb5-dd51-4d97-b6e4-c474356b1d5d", < "full_name": "ucx_ckvdw.TEST_SCHEMA", < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "TEST_SCHEMA", < "owner": "0a330eb5-dd51-4d97-b6e4-c474356b1d5d", < "schema_id": "60833f0b-f700-4abe-8b91-0c712fe63301", < "securable_kind": "SCHEMA_STANDARD", < "securable_type": "SCHEMA", < "updated_at": 1720250186244, < "updated_by": "0a330eb5-dd51-4d97-b6e4-c474356b1d5d" < }, < "... (2 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/tables?catalog_name=ucx_ckvdw&schema_name=TEST_SCHEMA < 200 OK < {} 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/tables?catalog_name=ucx_ckvdw&schema_name=information_schema < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "ucx_ckvdw", < "columns": [ < { < "comment": "Principal that granted the privilege.", < "name": "grantor", < "nullable": false, < "position": 0, < "type_json": "{\"name\":\"grantor\",\"type\":\"string\",\"nullable\":false,\"metadata\":{\"comment\":\"Principal that granted... (18 more bytes)", < "type_name": "STRING", < "type_precision": 0, < "type_scale": 0, < "type_text": "string" < }, < "... (5 additional elements)" < ], < "comment": "Lists principals that have privileges on the catalogs.", < "created_at": 1720250186259, < "created_by": "System user", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "delta_runtime_properties_kvpairs": {}, < "full_name": "ucx_ckvdw.information_schema.catalog_privileges", < "generation": 0, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "catalog_privileges", < "owner": "System user", < "properties": { < "view.query.out.col.0": "grantor", < "view.query.out.col.1": "grantee", < "view.query.out.col.2": "catalog_name", < "view.query.out.col.3": "privilege_type", < "view.query.out.col.4": "is_grantable", < "view.query.out.col.5": "inherited_from", < "view.query.out.numCols": "6" < }, < "properties_pairs": { < "properties": { < "view.query.out.col.0": "grantor", < "view.query.out.col.1": "grantee", < "view.query.out.col.2": "catalog_name", < "view.query.out.col.3": "privilege_type", < "view.query.out.col.4": "is_grantable", < "view.query.out.col.5": "inherited_from", < "view.query.out.numCols": "6" < } < }, < "schema_name": "information_schema", < "securable_kind": "TABLE_SYSTEM", < "securable_type": "TABLE", < "table_id": "c4947ae9-7a4d-42e1-a621-b306fece32e9", < "table_type": "VIEW", < "updated_at": 1720250186259, < "updated_by": "System user", < "view_definition": "SELECT * FROM system.information_schema.catalog_privileges WHERE catalog_name = 'ucx_ckvdw'" < }, < "... (27 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/tables?catalog_name=ucx_ckvdw&schema_name=migrate_ybmtp < 200 OK < {} 07:18 DEBUG [databricks.labs.blueprint.installation:migrate_external_tables_sync] Loading list from mapping.csv 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.0/workspace/export?path=/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.FQpM/mapping.csv&direct_download=true < 200 OK < [raw stream] 07:18 DEBUG [databricks.labs.blueprint.parallel:migrate_external_tables_sync] Starting 1 tasks in 8 threads 07:18 DEBUG [databricks.labs.lsql.backends:migrate_external_tables_sync] [spark][fetch] DESCRIBE SCHEMA EXTENDED migrate_eq5ls 07:18 INFO [databricks.labs.blueprint.parallel:migrate_external_tables_sync] checking databases for skip property 1/1, rps: 0.647/sec 07:18 INFO [databricks.labs.blueprint.parallel:migrate_external_tables_sync] Finished 'checking databases for skip property' tasks: 100% results available (1/1). Took 0:00:01.561973 07:18 DEBUG [databricks.labs.ucx.framework.crawlers:migrate_external_tables_sync] [hive_metastore.ucx_s0lsz.tables] fetching tables inventory 07:18 DEBUG [databricks.labs.lsql.backends:migrate_external_tables_sync] [spark][fetch] SELECT * FROM hive_metastore.ucx_s0lsz.tables 07:18 DEBUG [databricks.labs.blueprint.parallel:migrate_external_tables_sync] Starting 5 tasks in 8 threads 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/tables/ucx_ccq7s.migrate_eq5ls.ucx_tvsjj < 404 Not Found < { < "details": [ < { < "@type": "type.googleapis.com/google.rpc.ErrorInfo", < "domain": "unity-catalog.databricks.com", < "metadata": { < "resourceIdentifier": "ucx_ccq7s.migrate_eq5ls.ucx_tvsjj", < "resourceType": "Table" < }, < "reason": "RESOURCE_DOES_NOT_EXIST" < }, < "... (1 additional elements)" < ], < "error_code": "TABLE_DOES_NOT_EXIST", < "message": "Table 'ucx_ccq7s.migrate_eq5ls.ucx_tvsjj' does not exist." < } 07:18 DEBUG [databricks.labs.lsql.backends:migrate_external_tables_sync] [spark][fetch] SHOW TBLPROPERTIES migrate_eq5ls.ucx_tvsjj 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/tables/ucx_ccq7s.migrate_eq5ls.ucx_tz5lc < 404 Not Found < { < "details": [ < { < "@type": "type.googleapis.com/google.rpc.ErrorInfo", < "domain": "unity-catalog.databricks.com", < "metadata": { < "resourceIdentifier": "ucx_ccq7s.migrate_eq5ls.ucx_tz5lc", < "resourceType": "Table" < }, < "reason": "RESOURCE_DOES_NOT_EXIST" < }, < "... (1 additional elements)" < ], < "error_code": "TABLE_DOES_NOT_EXIST", < "message": "Table 'ucx_ccq7s.migrate_eq5ls.ucx_tz5lc' does not exist." < } 07:18 DEBUG [databricks.labs.lsql.backends:migrate_external_tables_sync] [spark][fetch] SHOW TBLPROPERTIES migrate_eq5ls.ucx_tz5lc 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/tables/ucx_ccq7s.migrate_eq5ls.ucx_tfm7e < 404 Not Found < { < "details": [ < { < "@type": "type.googleapis.com/google.rpc.ErrorInfo", < "domain": "unity-catalog.databricks.com", < "metadata": { < "resourceIdentifier": "ucx_ccq7s.migrate_eq5ls.ucx_tfm7e", < "resourceType": "Table" < }, < "reason": "RESOURCE_DOES_NOT_EXIST" < }, < "... (1 additional elements)" < ], < "error_code": "TABLE_DOES_NOT_EXIST", < "message": "Table 'ucx_ccq7s.migrate_eq5ls.ucx_tfm7e' does not exist." < } 07:18 DEBUG [databricks.labs.lsql.backends:migrate_external_tables_sync] [spark][fetch] SHOW TBLPROPERTIES migrate_eq5ls.ucx_tfm7e 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/tables/ucx_ccq7s.migrate_eq5ls.ucx_t2bi2 < 404 Not Found < { < "details": [ < { < "@type": "type.googleapis.com/google.rpc.ErrorInfo", < "domain": "unity-catalog.databricks.com", < "metadata": { < "resourceIdentifier": "ucx_ccq7s.migrate_eq5ls.ucx_t2bi2", < "resourceType": "Table" < }, < "reason": "RESOURCE_DOES_NOT_EXIST" < }, < "... (1 additional elements)" < ], < "error_code": "TABLE_DOES_NOT_EXIST", < "message": "Table 'ucx_ccq7s.migrate_eq5ls.ucx_t2bi2' does not exist." < } 07:18 DEBUG [databricks.labs.lsql.backends:migrate_external_tables_sync] [spark][fetch] SHOW TBLPROPERTIES migrate_eq5ls.ucx_t2bi2 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.1/unity-catalog/tables/ucx_ccq7s.migrate_eq5ls.ucx_t1lhm < 404 Not Found < { < "details": [ < { < "@type": "type.googleapis.com/google.rpc.ErrorInfo", < "domain": "unity-catalog.databricks.com", < "metadata": { < "resourceIdentifier": "ucx_ccq7s.migrate_eq5ls.ucx_t1lhm", < "resourceType": "Table" < }, < "reason": "RESOURCE_DOES_NOT_EXIST" < }, < "... (1 additional elements)" < ], < "error_code": "TABLE_DOES_NOT_EXIST", < "message": "Table 'ucx_ccq7s.migrate_eq5ls.ucx_t1lhm' does not exist." < } 07:18 DEBUG [databricks.labs.lsql.backends:migrate_external_tables_sync] [spark][fetch] SHOW TBLPROPERTIES migrate_eq5ls.ucx_t1lhm 07:18 INFO [databricks.labs.blueprint.parallel:migrate_external_tables_sync] checking all database properties 5/5, rps: 0.626/sec 07:18 INFO [databricks.labs.blueprint.parallel:migrate_external_tables_sync] Finished 'checking all database properties' tasks: 100% results available (5/5). Took 0:00:08.007288 07:18 DEBUG [databricks.labs.blueprint.parallel:migrate_external_tables_sync] Starting 1 tasks in 8 threads 07:18 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate:migrate_external_tables_sync] Migrating external table hive_metastore.migrate_eq5ls.ucx_tz5lc to using SQL query: SYNC TABLE ucx_ccq7s.migrate_eq5ls.ucx_tz5lc FROM hive_metastore.migrate_eq5ls.ucx_tz5lc; 07:18 DEBUG [databricks.labs.lsql.backends:migrate_external_tables_sync] [spark][fetch] SYNC TABLE ucx_ccq7s.migrate_eq5ls.ucx_tz5lc FROM hive_metastore.migrate_eq5ls.ucx_tz5lc; 07:18 DEBUG [databricks.sdk:migrate_external_tables_sync] GET /api/2.0/preview/scim/v2/Me < 200 OK < { < "active": true, < "displayName": "labs-account-admin-identity", < "emails": [ < { < "primary": true, < "type": "work", < "value": "**REDACTED**" < } < ], < "externalId": "a0e683bc-a985-4535-8273-d54fed1cd03a", < "groups": [ < { < "$ref": "Groups/688239313962730", < "display": "labs.scope.account-admin", < "type": "direct", < "value": "**REDACTED**" < }, < "... (1 additional elements)" < ], < "id": "481119220561874", < "name": { < "givenName": "labs-account-admin-identity" < }, < "schemas": [ < "urn:ietf:params:scim:schemas:core:2.0:User", < "... (1 additional elements)" < ], < "userName": "0a330eb5-dd51-4d97-b6e4-c474356b1d5d" < } 07:18 DEBUG [databricks.labs.lsql.backends:migrate_external_tables_sync] [spark][execute] ALTER TABLE ucx_ccq7s.migrate_eq5ls.ucx_tz5lc SET TBLPROPERTIES ('upgraded_from' = 'hive_metasto... (81 more bytes) 07:18 INFO [databricks.labs.blueprint.parallel:migrate_external_tables_sync] migrate tables 1/1, rps: 0.204/sec 07:18 INFO [databricks.labs.blueprint.parallel:migrate_external_tables_sync] Finished 'migrate tables' tasks: 100% results available (1/1). Took 0:00:04.921012 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/tables?catalog_name=system&schema_name=marketplace < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "system", < "created_at": 1712185623488, < "created_by": "System user", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "data_source_format": "DELTASHARING", < "delta_runtime_properties_kvpairs": {}, < "full_name": "system.marketplace.listing_access_events", < "generation": 0, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "listing_access_events", < "owner": "System user", < "schema_name": "marketplace", < "securable_kind": "TABLE_SYSTEM_DELTASHARING", < "securable_type": "TABLE", < "storage_location": "uc-deltasharing://system.marketplace.listing_access_events#system.marketplace.listing_access_eve... (3 more bytes)", < "table_id": "44b2524e-4f6b-4c99-99a5-452d41ddb741", < "table_type": "MANAGED", < "updated_at": 1712185623488, < "updated_by": "System user" < }, < "... (1 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/tables?catalog_name=system&schema_name=storage < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "system", < "created_at": 1712185579237, < "created_by": "System user", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "data_source_format": "DELTASHARING", < "delta_runtime_properties_kvpairs": {}, < "full_name": "system.storage.predictive_optimization_operations_history", < "generation": 0, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "predictive_optimization_operations_history", < "owner": "System user", < "schema_name": "storage", < "securable_kind": "TABLE_SYSTEM_DELTASHARING", < "securable_type": "TABLE", < "storage_location": "uc-deltasharing://system.storage.predictive_optimization_operations_history#system.storage.predi... (37 more bytes)", < "table_id": "d80a9a27-d4f7-42c5-adc0-fabf6a948192", < "table_type": "MANAGED", < "updated_at": 1712185579237, < "updated_by": "System user" < } < ] < } 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/schemas?catalog_name=ucx_ccq7s < 200 OK < { < "schemas": [ < { < "browse_only": false, < "catalog_name": "ucx_ccq7s", < "catalog_type": "MANAGED_CATALOG", < "comment": "Default schema (auto-created)", < "created_at": 1720249859767, < "created_by": "0a330eb5-dd51-4d97-b6e4-c474356b1d5d", < "full_name": "ucx_ccq7s.TEST_SCHEMA", < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "TEST_SCHEMA", < "owner": "0a330eb5-dd51-4d97-b6e4-c474356b1d5d", < "schema_id": "5ddaad09-aa39-444f-b78a-8be439490bac", < "securable_kind": "SCHEMA_STANDARD", < "securable_type": "SCHEMA", < "updated_at": 1720249859767, < "updated_by": "0a330eb5-dd51-4d97-b6e4-c474356b1d5d" < }, < "... (2 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/tables?catalog_name=ucx_ccq7s&schema_name=TEST_SCHEMA < 200 OK < {} 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/tables?catalog_name=ucx_ccq7s&schema_name=information_schema < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "ucx_ccq7s", < "columns": [ < { < "comment": "Principal that granted the privilege.", < "name": "grantor", < "nullable": false, < "position": 0, < "type_json": "{\"name\":\"grantor\",\"type\":\"string\",\"nullable\":false,\"metadata\":{\"comment\":\"Principal that granted... (18 more bytes)", < "type_name": "STRING", < "type_precision": 0, < "type_scale": 0, < "type_text": "string" < }, < "... (5 additional elements)" < ], < "comment": "Lists principals that have privileges on the catalogs.", < "created_at": 1720249859767, < "created_by": "System user", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "delta_runtime_properties_kvpairs": {}, < "full_name": "ucx_ccq7s.information_schema.catalog_privileges", < "generation": 0, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "catalog_privileges", < "owner": "System user", < "properties": { < "view.query.out.col.0": "grantor", < "view.query.out.col.1": "grantee", < "view.query.out.col.2": "catalog_name", < "view.query.out.col.3": "privilege_type", < "view.query.out.col.4": "is_grantable", < "view.query.out.col.5": "inherited_from", < "view.query.out.numCols": "6" < }, < "properties_pairs": { < "properties": { < "view.query.out.col.0": "grantor", < "view.query.out.col.1": "grantee", < "view.query.out.col.2": "catalog_name", < "view.query.out.col.3": "privilege_type", < "view.query.out.col.4": "is_grantable", < "view.query.out.col.5": "inherited_from", < "view.query.out.numCols": "6" < } < }, < "schema_name": "information_schema", < "securable_kind": "TABLE_SYSTEM", < "securable_type": "TABLE", < "table_id": "9bcecae5-a970-4f29-a37f-14c6dced4836", < "table_type": "VIEW", < "updated_at": 1720249859767, < "updated_by": "System user", < "view_definition": "SELECT * FROM system.information_schema.catalog_privileges WHERE catalog_name = 'ucx_ccq7s'" < }, < "... (27 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/tables?catalog_name=ucx_ccq7s&schema_name=migrate_eq5ls < 200 OK < {} 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/schemas?catalog_name=ucx_ckvdw < 200 OK < { < "schemas": [ < { < "browse_only": false, < "catalog_name": "ucx_ckvdw", < "catalog_type": "MANAGED_CATALOG", < "comment": "Default schema (auto-created)", < "created_at": 1720250186244, < "created_by": "0a330eb5-dd51-4d97-b6e4-c474356b1d5d", < "full_name": "ucx_ckvdw.TEST_SCHEMA", < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "TEST_SCHEMA", < "owner": "0a330eb5-dd51-4d97-b6e4-c474356b1d5d", < "schema_id": "60833f0b-f700-4abe-8b91-0c712fe63301", < "securable_kind": "SCHEMA_STANDARD", < "securable_type": "SCHEMA", < "updated_at": 1720250186244, < "updated_by": "0a330eb5-dd51-4d97-b6e4-c474356b1d5d" < }, < "... (2 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/tables?catalog_name=ucx_ckvdw&schema_name=TEST_SCHEMA < 200 OK < {} 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/tables?catalog_name=ucx_ckvdw&schema_name=information_schema < 200 OK < { < "tables": [ < { < "browse_only": false, < "catalog_name": "ucx_ckvdw", < "columns": [ < { < "comment": "Principal that granted the privilege.", < "name": "grantor", < "nullable": false, < "position": 0, < "type_json": "{\"name\":\"grantor\",\"type\":\"string\",\"nullable\":false,\"metadata\":{\"comment\":\"Principal that granted... (18 more bytes)", < "type_name": "STRING", < "type_precision": 0, < "type_scale": 0, < "type_text": "string" < }, < "... (5 additional elements)" < ], < "comment": "Lists principals that have privileges on the catalogs.", < "created_at": 1720250186259, < "created_by": "System user", < "data_access_configuration_id": "00000000-0000-0000-0000-000000000000", < "delta_runtime_properties_kvpairs": {}, < "full_name": "ucx_ckvdw.information_schema.catalog_privileges", < "generation": 0, < "metastore_id": "8952c1e3-b265-4adf-98c3-6f755e2e1453", < "name": "catalog_privileges", < "owner": "System user", < "properties": { < "view.query.out.col.0": "grantor", < "view.query.out.col.1": "grantee", < "view.query.out.col.2": "catalog_name", < "view.query.out.col.3": "privilege_type", < "view.query.out.col.4": "is_grantable", < "view.query.out.col.5": "inherited_from", < "view.query.out.numCols": "6" < }, < "properties_pairs": { < "properties": { < "view.query.out.col.0": "grantor", < "view.query.out.col.1": "grantee", < "view.query.out.col.2": "catalog_name", < "view.query.out.col.3": "privilege_type", < "view.query.out.col.4": "is_grantable", < "view.query.out.col.5": "inherited_from", < "view.query.out.numCols": "6" < } < }, < "schema_name": "information_schema", < "securable_kind": "TABLE_SYSTEM", < "securable_type": "TABLE", < "table_id": "c4947ae9-7a4d-42e1-a621-b306fece32e9", < "table_type": "VIEW", < "updated_at": 1720250186259, < "updated_by": "System user", < "view_definition": "SELECT * FROM system.information_schema.catalog_privileges WHERE catalog_name = 'ucx_ckvdw'" < }, < "... (27 additional elements)" < ] < } 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/tables?catalog_name=ucx_ckvdw&schema_name=migrate_ybmtp < 200 OK < {} 07:18 DEBUG [databricks.labs.blueprint.installation:migrate_dbfs_root_non_delta_tables] Loading list from mapping.csv 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.0/workspace/export?path=/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.FQpM/mapping.csv&direct_download=true < 200 OK < [raw stream] 07:18 DEBUG [databricks.labs.blueprint.parallel:migrate_dbfs_root_non_delta_tables] Starting 1 tasks in 8 threads 07:18 DEBUG [databricks.labs.lsql.backends:migrate_dbfs_root_non_delta_tables] [spark][fetch] DESCRIBE SCHEMA EXTENDED migrate_eq5ls 07:18 INFO [databricks.labs.blueprint.parallel:migrate_dbfs_root_non_delta_tables] checking databases for skip property 1/1, rps: 0.587/sec 07:18 INFO [databricks.labs.blueprint.parallel:migrate_dbfs_root_non_delta_tables] Finished 'checking databases for skip property' tasks: 100% results available (1/1). Took 0:00:01.716355 07:18 DEBUG [databricks.labs.ucx.framework.crawlers:migrate_dbfs_root_non_delta_tables] [hive_metastore.ucx_s0lsz.tables] fetching tables inventory 07:18 DEBUG [databricks.labs.lsql.backends:migrate_dbfs_root_non_delta_tables] [spark][fetch] SELECT * FROM hive_metastore.ucx_s0lsz.tables 07:18 DEBUG [databricks.labs.blueprint.parallel:migrate_dbfs_root_non_delta_tables] Starting 5 tasks in 8 threads 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/tables/ucx_ccq7s.migrate_eq5ls.ucx_tvsjj < 404 Not Found < { < "details": [ < { < "@type": "type.googleapis.com/google.rpc.ErrorInfo", < "domain": "unity-catalog.databricks.com", < "metadata": { < "resourceIdentifier": "ucx_ccq7s.migrate_eq5ls.ucx_tvsjj", < "resourceType": "Table" < }, < "reason": "RESOURCE_DOES_NOT_EXIST" < }, < "... (1 additional elements)" < ], < "error_code": "TABLE_DOES_NOT_EXIST", < "message": "Table 'ucx_ccq7s.migrate_eq5ls.ucx_tvsjj' does not exist." < } 07:18 DEBUG [databricks.labs.lsql.backends:migrate_dbfs_root_non_delta_tables] [spark][fetch] SHOW TBLPROPERTIES migrate_eq5ls.ucx_tvsjj 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/tables/ucx_ccq7s.migrate_eq5ls.ucx_t1lhm < 404 Not Found < { < "details": [ < { < "@type": "type.googleapis.com/google.rpc.ErrorInfo", < "domain": "unity-catalog.databricks.com", < "metadata": { < "resourceIdentifier": "ucx_ccq7s.migrate_eq5ls.ucx_t1lhm", < "resourceType": "Table" < }, < "reason": "RESOURCE_DOES_NOT_EXIST" < }, < "... (1 additional elements)" < ], < "error_code": "TABLE_DOES_NOT_EXIST", < "message": "Table 'ucx_ccq7s.migrate_eq5ls.ucx_t1lhm' does not exist." < } 07:18 DEBUG [databricks.labs.lsql.backends:migrate_dbfs_root_non_delta_tables] [spark][fetch] SHOW TBLPROPERTIES migrate_eq5ls.ucx_t1lhm 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/tables/ucx_ccq7s.migrate_eq5ls.ucx_tz5lc < 404 Not Found < { < "details": [ < { < "@type": "type.googleapis.com/google.rpc.ErrorInfo", < "domain": "unity-catalog.databricks.com", < "metadata": { < "resourceIdentifier": "ucx_ccq7s.migrate_eq5ls.ucx_tz5lc", < "resourceType": "Table" < }, < "reason": "RESOURCE_DOES_NOT_EXIST" < }, < "... (1 additional elements)" < ], < "error_code": "TABLE_DOES_NOT_EXIST", < "message": "Table 'ucx_ccq7s.migrate_eq5ls.ucx_tz5lc' does not exist." < } 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/tables/ucx_ccq7s.migrate_eq5ls.ucx_t2bi2 < 404 Not Found < { < "details": [ < { < "@type": "type.googleapis.com/google.rpc.ErrorInfo", < "domain": "unity-catalog.databricks.com", < "metadata": { < "resourceIdentifier": "ucx_ccq7s.migrate_eq5ls.ucx_t2bi2", < "resourceType": "Table" < }, < "reason": "RESOURCE_DOES_NOT_EXIST" < }, < "... (1 additional elements)" < ], < "error_code": "TABLE_DOES_NOT_EXIST", < "message": "Table 'ucx_ccq7s.migrate_eq5ls.ucx_t2bi2' does not exist." < } 07:18 DEBUG [databricks.labs.lsql.backends:migrate_dbfs_root_non_delta_tables] [spark][fetch] SHOW TBLPROPERTIES migrate_eq5ls.ucx_t2bi2 07:18 DEBUG [databricks.labs.lsql.backends:migrate_dbfs_root_non_delta_tables] [spark][fetch] SHOW TBLPROPERTIES migrate_eq5ls.ucx_tz5lc 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.1/unity-catalog/tables/ucx_ccq7s.migrate_eq5ls.ucx_tfm7e < 404 Not Found < { < "details": [ < { < "@type": "type.googleapis.com/google.rpc.ErrorInfo", < "domain": "unity-catalog.databricks.com", < "metadata": { < "resourceIdentifier": "ucx_ccq7s.migrate_eq5ls.ucx_tfm7e", < "resourceType": "Table" < }, < "reason": "RESOURCE_DOES_NOT_EXIST" < }, < "... (1 additional elements)" < ], < "error_code": "TABLE_DOES_NOT_EXIST", < "message": "Table 'ucx_ccq7s.migrate_eq5ls.ucx_tfm7e' does not exist." < } 07:18 DEBUG [databricks.labs.lsql.backends:migrate_dbfs_root_non_delta_tables] [spark][fetch] SHOW TBLPROPERTIES migrate_eq5ls.ucx_tfm7e 07:18 INFO [databricks.labs.blueprint.parallel:migrate_dbfs_root_non_delta_tables] checking all database properties 5/5, rps: 0.630/sec 07:18 INFO [databricks.labs.blueprint.parallel:migrate_dbfs_root_non_delta_tables] Finished 'checking all database properties' tasks: 100% results available (5/5). Took 0:00:07.968035 07:18 DEBUG [databricks.labs.blueprint.parallel:migrate_dbfs_root_non_delta_tables] Starting 1 tasks in 8 threads 07:18 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate:migrate_dbfs_root_non_delta_tables] Migrating table hive_metastore.migrate_eq5ls.ucx_t1lhm to ucx_ccq7s.migrate_eq5ls.ucx_t1lhm using SQL query: CREATE TABLE IF NOT EXISTS ucx_ccq7s.migrate_eq5ls.ucx_t1lhm AS SELECT * FROM hive_metastore.migrate_eq5ls.ucx_t1lhm 07:18 DEBUG [databricks.labs.lsql.backends:migrate_dbfs_root_non_delta_tables] [spark][execute] CREATE TABLE IF NOT EXISTS ucx_ccq7s.migrate_eq5ls.ucx_t1lhm AS SELECT * FROM hive_metastore.mig... (20 more bytes) 07:18 DEBUG [databricks.labs.lsql.backends:migrate_dbfs_root_non_delta_tables] [spark][execute] ALTER TABLE hive_metastore.migrate_eq5ls.ucx_t1lhm SET TBLPROPERTIES ('upgraded_to' = 'ucx_ccq7s... (27 more bytes) 07:18 DEBUG [databricks.sdk:migrate_dbfs_root_non_delta_tables] GET /api/2.0/preview/scim/v2/Me < 200 OK < { < "active": true, < "displayName": "labs-account-admin-identity", < "emails": [ < { < "primary": true, < "type": "work", < "value": "**REDACTED**" < } < ], < "externalId": "a0e683bc-a985-4535-8273-d54fed1cd03a", < "groups": [ < { < "$ref": "Groups/688239313962730", < "display": "labs.scope.account-admin", < "type": "direct", < "value": "**REDACTED**" < }, < "... (1 additional elements)" < ], < "id": "481119220561874", < "name": { < "givenName": "labs-account-admin-identity" < }, < "schemas": [ < "urn:ietf:params:scim:schemas:core:2.0:User", < "... (1 additional elements)" < ], < "userName": "0a330eb5-dd51-4d97-b6e4-c474356b1d5d" < } 07:18 DEBUG [databricks.labs.lsql.backends:migrate_dbfs_root_non_delta_tables] [spark][execute] ALTER TABLE ucx_ccq7s.migrate_eq5ls.ucx_t1lhm SET TBLPROPERTIES ('upgraded_from' = 'hive_metasto... (81 more bytes) 07:18 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate:migrate_dbfs_root_non_delta_tables] Migrating acls on ucx_ccq7s.migrate_eq5ls.ucx_t1lhm using SQL query: GRANT ALL PRIVILEGES ON TABLE ucx_ccq7s.migrate_eq5ls.ucx_t1lhm TO `serge.smertin@databricks.com` 07:18 DEBUG [databricks.labs.lsql.backends:migrate_dbfs_root_non_delta_tables] [spark][execute] GRANT ALL PRIVILEGES ON TABLE ucx_ccq7s.migrate_eq5ls.ucx_t1lhm TO `serge.smertin@databricks.com... (1 more bytes) 07:18 INFO [databricks.labs.blueprint.parallel:migrate_dbfs_root_non_delta_tables] migrate tables 1/1, rps: 0.025/sec 07:18 INFO [databricks.labs.blueprint.parallel:migrate_dbfs_root_non_delta_tables] Finished 'migrate tables' tasks: 100% results available (1/1). Took 0:00:39.342994 07:18 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 make_storage_dir fixtures 07:18 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_dbfs_data_copy fixtures 07:18 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/M46h 07:18 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 cluster fixtures 07:18 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 catalog fixtures 07:18 DEBUG [databricks.labs.ucx.mixins.fixtures] removing catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720249859751, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ccq7s', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_ccq7s', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720249859751, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 07:18 INFO [databricks.labs.ucx.install] Deleting UCX v0.28.1+920240706071434 from https://DATABRICKS_HOST 07:18 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_s0lsz 07:18 INFO [databricks.labs.ucx.install] Deleting jobs 07:18 INFO [databricks.labs.ucx.install] Deleting assessment job_id=518399404479304. 07:18 INFO [databricks.labs.ucx.install] Deleting migrate-external-hiveserde-tables-in-place-experimental job_id=127460666804140. 07:18 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=1082882860982877. 07:18 INFO [databricks.labs.ucx.install] Deleting migrate-external-tables-ctas job_id=971798705368153. 07:18 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=176396967550792. 07:18 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=933716889332665. 07:18 INFO [databricks.labs.ucx.install] Deleting migrate-data-reconciliation job_id=431266799907685. 07:18 INFO [databricks.labs.ucx.install] Deleting experimental-workflow-linter job_id=593201359221253. 07:18 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=163585540385372. 07:18 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=788424748671214. 07:18 INFO [databricks.labs.ucx.install] Deleting scan-tables-in-mounts-experimental job_id=894538342405101. 07:18 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=692342399391274. 07:18 INFO [databricks.labs.ucx.install] Deleting failing job_id=1019190207726175. 07:18 INFO [databricks.labs.ucx.install] Deleting cluster policy 07:18 INFO [databricks.labs.ucx.install] Deleting secret scope 07:18 INFO [databricks.labs.ucx.install] UnInstalling UCX complete 07:18 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace user fixtures 07:18 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 account group fixtures 07:18 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures 07:18 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 07:18 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 5 table fixtures 07:18 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_eq5ls.ucx_tvsjj', metastore_id=None, name='ucx_tvsjj', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070608'}, row_filter=None, schema_name='migrate_eq5ls', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/migrate_eq5ls/ucx_tvsjj', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:18 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_eq5ls.ucx_t1lhm', metastore_id=None, name='ucx_t1lhm', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070608'}, row_filter=None, schema_name='migrate_eq5ls', sql_path=None, storage_credential_name=None, storage_location='dbfs:/tmp/ucx_test_Nvjd', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:18 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_eq5ls.ucx_tz5lc', metastore_id=None, name='ucx_tz5lc', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070608'}, row_filter=None, schema_name='migrate_eq5ls', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/M46h', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:18 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_eq5ls.ucx_t2bi2', metastore_id=None, name='ucx_t2bi2', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070608'}, row_filter=None, schema_name='migrate_eq5ls', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_eq5ls.ucx_tvsjj', view_dependencies=None) 07:18 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while table TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_eq5ls.ucx_t2bi2', metastore_id=None, name='ucx_t2bi2', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070608'}, row_filter=None, schema_name='migrate_eq5ls', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_eq5ls.ucx_tvsjj', view_dependencies=None) teardown: [WRONG_COMMAND_FOR_OBJECT_TYPE] The operation DROP TABLE requires a EXTERNAL or MANAGED. But hive_metastore.migrate_eq5ls.ucx_t2bi2 is a VIEW. Use DROP VIEW instead. SQLSTATE: 42809 07:18 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_eq5ls.ucx_tfm7e', metastore_id=None, name='ucx_tfm7e', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070608'}, row_filter=None, schema_name='migrate_eq5ls', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_eq5ls.ucx_t2bi2', view_dependencies=None) 07:18 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while table TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.migrate_eq5ls.ucx_tfm7e', metastore_id=None, name='ucx_tfm7e', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070608'}, row_filter=None, schema_name='migrate_eq5ls', sql_path=None, storage_credential_name=None, storage_location=None, table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition='SELECT * FROM hive_metastore.migrate_eq5ls.ucx_t2bi2', view_dependencies=None) teardown: [WRONG_COMMAND_FOR_OBJECT_TYPE] The operation DROP TABLE requires a EXTERNAL or MANAGED. But hive_metastore.migrate_eq5ls.ucx_tfm7e is a VIEW. Use DROP VIEW instead. SQLSTATE: 42809 07:18 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 schema fixtures 07:18 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.migrate_eq5ls', metastore_id=None, name='migrate_eq5ls', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:18 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_ccq7s', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_ccq7s.migrate_eq5ls', metastore_id=None, name='migrate_eq5ls', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:18 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s0lsz', metastore_id=None, name='ucx_s0lsz', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw5] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```

_{Running from nightly #113}