search

databrickslabs / ucx

Your best companion for upgrading to Unity Catalog. UCX will guide you, the Databricks customer, through the process of upgrading your account, groups, workspaces, jobs etc. to Unity Catalog.
Other
196 stars 70 forks source link

whitelist hail #2053

Closed ericvergnaud closed 1 week ago

ericvergnaud commented 1 week ago

Changes

whitelist hail

Linked issues

Progresses #1901

Functionality

None

Tests

github-actions[bot] commented 1 week ago

❌ 79/82 passed, 3 failed, 18 skipped, 6h1m58s total

❌ test_group: TimeoutError: Timed out after 0:00:30 (32.858s) ``` TimeoutError: Timed out after 0:00:30 [gw7] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 11:02 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-xxhnu7ju@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-xxhnu7ju@example.com')], entitlements=[], external_id=None, groups=[], id='7065908611110794', name=Name(family_name=None, given_name='sdk-xxhnu7ju@example.com'), roles=[], schemas=[, ], user_name='sdk-xxhnu7ju@example.com') 11:02 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-xxhnu7ju@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-xxhnu7ju@example.com')], entitlements=[], external_id=None, groups=[], id='7065908611110794', name=Name(family_name=None, given_name='sdk-xxhnu7ju@example.com'), roles=[], schemas=[, ], user_name='sdk-xxhnu7ju@example.com') 11:03 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace user fixtures 11:03 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='sdk-xxhnu7ju@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-xxhnu7ju@example.com')], entitlements=[], external_id=None, groups=[], id='7065908611110794', name=Name(family_name=None, given_name='sdk-xxhnu7ju@example.com'), roles=[], schemas=[, ], user_name='sdk-xxhnu7ju@example.com') 11:03 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures [gw7] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```
❌ test_table_migration_job_refreshes_migration_status[hiveserde-migrate-external-tables-ctas]: TimeoutError: Timed out after 0:05:00 (19m3.12s) ``` TimeoutError: Timed out after 0:05:00 11:15 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/ZoJb 11:15 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.hiveserde_in_place_k9pph: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_k9pph 11:15 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.hiveserde_in_place_k9pph', metastore_id=None, name='hiveserde_in_place_k9pph', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:15 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_storage_dir fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_k9pph 11:16 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_k9pph.parquet_serde_k9pph: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_k9pph/parquet_serde_k9pph 11:16 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_k9pph.parquet_serde_k9pph', metastore_id=None, name='parquet_serde_k9pph', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070312'}, row_filter=None, schema_name='hiveserde_in_place_k9pph', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_k9pph/parquet_serde_k9pph', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:16 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_k9pph.orc_serde_k9pph: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_k9pph/orc_serde_k9pph 11:16 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_k9pph.orc_serde_k9pph', metastore_id=None, name='orc_serde_k9pph', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070312'}, row_filter=None, schema_name='hiveserde_in_place_k9pph', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_k9pph/orc_serde_k9pph', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:16 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_k9pph.avro_serde_k9pph: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_k9pph/avro_serde_k9pph 11:16 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_k9pph.avro_serde_k9pph', metastore_id=None, name='avro_serde_k9pph', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070312'}, row_filter=None, schema_name='hiveserde_in_place_k9pph', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_k9pph/avro_serde_k9pph', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:17 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720005434942, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c9naa', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_c9naa', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720005434942, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 11:17 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_c9naa.hiveserde_in_place_k9pph: https://DATABRICKS_HOST/explore/data/ucx_c9naa/hiveserde_in_place_k9pph 11:17 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_c9naa', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c9naa.hiveserde_in_place_k9pph', metastore_id=None, name='hiveserde_in_place_k9pph', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:18 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s2bz7: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s2bz7 11:18 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s2bz7', metastore_id=None, name='ucx_s2bz7', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw3] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 11:15 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/ZoJb 11:15 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.hiveserde_in_place_k9pph: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_k9pph 11:15 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.hiveserde_in_place_k9pph', metastore_id=None, name='hiveserde_in_place_k9pph', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:15 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_storage_dir fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_k9pph 11:16 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_k9pph.parquet_serde_k9pph: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_k9pph/parquet_serde_k9pph 11:16 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_k9pph.parquet_serde_k9pph', metastore_id=None, name='parquet_serde_k9pph', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070312'}, row_filter=None, schema_name='hiveserde_in_place_k9pph', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_k9pph/parquet_serde_k9pph', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:16 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_k9pph.orc_serde_k9pph: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_k9pph/orc_serde_k9pph 11:16 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_k9pph.orc_serde_k9pph', metastore_id=None, name='orc_serde_k9pph', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070312'}, row_filter=None, schema_name='hiveserde_in_place_k9pph', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_k9pph/orc_serde_k9pph', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:16 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_k9pph.avro_serde_k9pph: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_k9pph/avro_serde_k9pph 11:16 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_k9pph.avro_serde_k9pph', metastore_id=None, name='avro_serde_k9pph', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070312'}, row_filter=None, schema_name='hiveserde_in_place_k9pph', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_k9pph/avro_serde_k9pph', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:17 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720005434942, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c9naa', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_c9naa', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720005434942, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 11:17 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_c9naa.hiveserde_in_place_k9pph: https://DATABRICKS_HOST/explore/data/ucx_c9naa/hiveserde_in_place_k9pph 11:17 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_c9naa', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c9naa.hiveserde_in_place_k9pph', metastore_id=None, name='hiveserde_in_place_k9pph', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:18 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s2bz7: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s2bz7 11:18 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s2bz7', metastore_id=None, name='ucx_s2bz7', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:21 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.iZcN/config.yml) doesn't exist. 11:21 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 11:21 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 11:21 INFO [databricks.labs.ucx.install] Fetching installations... 11:23 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.iZcN is corrupted. Skipping... 11:23 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 11:23 DEBUG [tests.integration.conftest] Waiting for clusters to start... 11:23 DEBUG [tests.integration.conftest] Waiting for clusters to start... 11:23 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+7020240703112304 11:23 INFO [databricks.labs.ucx.install] Creating ucx schemas... 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 11:27 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.iZcN/README for the next steps. 11:27 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-external-tables-ctas job: https://DATABRICKS_HOST#job/712822598012535 11:15 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/ZoJb 11:15 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.hiveserde_in_place_k9pph: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_k9pph 11:15 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.hiveserde_in_place_k9pph', metastore_id=None, name='hiveserde_in_place_k9pph', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:15 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_storage_dir fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_k9pph 11:16 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_k9pph.parquet_serde_k9pph: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_k9pph/parquet_serde_k9pph 11:16 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_k9pph.parquet_serde_k9pph', metastore_id=None, name='parquet_serde_k9pph', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070312'}, row_filter=None, schema_name='hiveserde_in_place_k9pph', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_k9pph/parquet_serde_k9pph', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:16 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_k9pph.orc_serde_k9pph: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_k9pph/orc_serde_k9pph 11:16 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_k9pph.orc_serde_k9pph', metastore_id=None, name='orc_serde_k9pph', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070312'}, row_filter=None, schema_name='hiveserde_in_place_k9pph', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_k9pph/orc_serde_k9pph', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:16 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_k9pph.avro_serde_k9pph: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_k9pph/avro_serde_k9pph 11:16 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_k9pph.avro_serde_k9pph', metastore_id=None, name='avro_serde_k9pph', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070312'}, row_filter=None, schema_name='hiveserde_in_place_k9pph', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_k9pph/avro_serde_k9pph', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:17 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720005434942, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c9naa', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_c9naa', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720005434942, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 11:17 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_c9naa.hiveserde_in_place_k9pph: https://DATABRICKS_HOST/explore/data/ucx_c9naa/hiveserde_in_place_k9pph 11:17 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_c9naa', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c9naa.hiveserde_in_place_k9pph', metastore_id=None, name='hiveserde_in_place_k9pph', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:18 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s2bz7: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s2bz7 11:18 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s2bz7', metastore_id=None, name='ucx_s2bz7', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:21 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.iZcN/config.yml) doesn't exist. 11:21 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 11:21 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 11:21 INFO [databricks.labs.ucx.install] Fetching installations... 11:23 WARNING [databricks.labs.ucx.install] Existing installation at /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.iZcN is corrupted. Skipping... 11:23 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 11:23 DEBUG [tests.integration.conftest] Waiting for clusters to start... 11:23 DEBUG [tests.integration.conftest] Waiting for clusters to start... 11:23 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+7020240703112304 11:23 INFO [databricks.labs.ucx.install] Creating ucx schemas... 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 11:27 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 11:27 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.iZcN/README for the next steps. 11:27 DEBUG [databricks.labs.ucx.installer.workflows] starting migrate-external-tables-ctas job: https://DATABRICKS_HOST#job/712822598012535 11:31 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_storage_dir fixtures 11:31 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_storage_dir fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_k9pph 11:31 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_dbfs_data_copy fixtures 11:31 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/ZoJb 11:31 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 cluster fixtures 11:31 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 catalog fixtures 11:31 DEBUG [databricks.labs.ucx.mixins.fixtures] removing catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720005434942, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c9naa', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_c9naa', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720005434942, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 11:31 INFO [databricks.labs.ucx.install] Deleting UCX v0.27.2+7020240703112304 from https://DATABRICKS_HOST 11:31 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_s2bz7 11:32 INFO [databricks.labs.ucx.install] Deleting jobs 11:32 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=169782745767599. 11:32 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=665463385185456. 11:32 INFO [databricks.labs.ucx.install] Deleting experimental-workflow-linter job_id=140729261709466. 11:32 INFO [databricks.labs.ucx.install] Deleting failing job_id=848921925642057. 11:32 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=737245166053436. 11:32 INFO [databricks.labs.ucx.install] Deleting scan-tables-in-mounts-experimental job_id=846985549648159. 11:32 INFO [databricks.labs.ucx.install] Deleting migrate-external-tables-ctas job_id=712822598012535. 11:32 INFO [databricks.labs.ucx.install] Deleting migrate-data-reconciliation job_id=549063484022066. 11:32 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=718104613035919. 11:32 INFO [databricks.labs.ucx.install] Deleting assessment job_id=962445056306509. 11:32 INFO [databricks.labs.ucx.install] Deleting migrate-external-hiveserde-tables-in-place-experimental job_id=707250615081238. 11:32 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=666427489596227. 11:32 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=557727516849610. 11:32 INFO [databricks.labs.ucx.install] Deleting cluster policy 11:32 INFO [databricks.labs.ucx.install] Deleting secret scope 11:32 INFO [databricks.labs.ucx.install] UnInstalling UCX complete 11:32 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace user fixtures 11:32 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 account group fixtures 11:32 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures 11:32 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 11:32 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 table fixtures 11:32 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_k9pph.parquet_serde_k9pph', metastore_id=None, name='parquet_serde_k9pph', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070312'}, row_filter=None, schema_name='hiveserde_in_place_k9pph', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_k9pph/parquet_serde_k9pph', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:32 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_k9pph.orc_serde_k9pph', metastore_id=None, name='orc_serde_k9pph', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070312'}, row_filter=None, schema_name='hiveserde_in_place_k9pph', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_k9pph/orc_serde_k9pph', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:32 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_k9pph.avro_serde_k9pph', metastore_id=None, name='avro_serde_k9pph', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070312'}, row_filter=None, schema_name='hiveserde_in_place_k9pph', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_k9pph/avro_serde_k9pph', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 11:33 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 schema fixtures 11:33 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.hiveserde_in_place_k9pph', metastore_id=None, name='hiveserde_in_place_k9pph', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:33 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_c9naa', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c9naa.hiveserde_in_place_k9pph', metastore_id=None, name='hiveserde_in_place_k9pph', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:34 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s2bz7', metastore_id=None, name='ucx_s2bz7', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw3] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```
❌ test_running_real_workflow_linter_job: TimeoutError: Timed out after 0:02:00 (9m14.82s) ``` TimeoutError: Timed out after 0:02:00 [gw0] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 11:33 DEBUG [databricks.labs.ucx.mixins.fixtures] added directory fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-TT9H 11:33 DEBUG [databricks.labs.ucx.mixins.fixtures] added notebook fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-TT9H/notebook.ipynb 11:33 INFO [databricks.labs.ucx.mixins.fixtures] Job: https://DATABRICKS_HOST#job/861009904005083 11:33 DEBUG [databricks.labs.ucx.mixins.fixtures] added job fixture: CreateResponse(job_id=861009904005083) 11:34 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_ski2c: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_ski2c 11:34 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_ski2c', metastore_id=None, name='ucx_ski2c', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:34 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.BlYF/config.yml) doesn't exist. 11:34 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 11:34 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 11:34 INFO [databricks.labs.ucx.install] Fetching installations... 11:34 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 11:34 DEBUG [tests.integration.conftest] Waiting for clusters to start... 11:34 DEBUG [tests.integration.conftest] Waiting for clusters to start... 11:34 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+7020240703113427 11:34 INFO [databricks.labs.ucx.install] Creating ucx schemas... 11:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 11:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 11:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 11:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 11:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 11:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 11:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 11:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 11:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 11:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 11:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 11:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 11:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 11:38 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.BlYF/README for the next steps. 11:38 DEBUG [databricks.labs.ucx.installer.workflows] starting experimental-workflow-linter job: https://DATABRICKS_HOST#job/568222036739932 11:41 DEBUG [databricks.labs.ucx.installer.workflows] Validating experimental-workflow-linter workflow: https://DATABRICKS_HOST#job/568222036739932 11:33 DEBUG [databricks.labs.ucx.mixins.fixtures] added directory fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-TT9H 11:33 DEBUG [databricks.labs.ucx.mixins.fixtures] added notebook fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-TT9H/notebook.ipynb 11:33 INFO [databricks.labs.ucx.mixins.fixtures] Job: https://DATABRICKS_HOST#job/861009904005083 11:33 DEBUG [databricks.labs.ucx.mixins.fixtures] added job fixture: CreateResponse(job_id=861009904005083) 11:34 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_ski2c: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_ski2c 11:34 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_ski2c', metastore_id=None, name='ucx_ski2c', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 11:34 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.BlYF/config.yml) doesn't exist. 11:34 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 11:34 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 11:34 INFO [databricks.labs.ucx.install] Fetching installations... 11:34 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 11:34 DEBUG [tests.integration.conftest] Waiting for clusters to start... 11:34 DEBUG [tests.integration.conftest] Waiting for clusters to start... 11:34 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+7020240703113427 11:34 INFO [databricks.labs.ucx.install] Creating ucx schemas... 11:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 11:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 11:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 11:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 11:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 11:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 11:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 11:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 11:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 11:37 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 11:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 11:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 11:38 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 11:38 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.BlYF/README for the next steps. 11:38 DEBUG [databricks.labs.ucx.installer.workflows] starting experimental-workflow-linter job: https://DATABRICKS_HOST#job/568222036739932 11:41 DEBUG [databricks.labs.ucx.installer.workflows] Validating experimental-workflow-linter workflow: https://DATABRICKS_HOST#job/568222036739932 11:42 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 job fixtures 11:42 DEBUG [databricks.labs.ucx.mixins.fixtures] removing job fixture: CreateResponse(job_id=861009904005083) 11:42 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 directory fixtures 11:42 DEBUG [databricks.labs.ucx.mixins.fixtures] removing directory fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-TT9H 11:42 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 notebook fixtures 11:42 DEBUG [databricks.labs.ucx.mixins.fixtures] removing notebook fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-TT9H/notebook.ipynb 11:42 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while notebook /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-TT9H/notebook.ipynb teardown: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-TT9H/notebook.ipynb) doesn't exist. 11:42 INFO [databricks.labs.ucx.install] Deleting UCX v0.27.2+7020240703113427 from https://DATABRICKS_HOST 11:42 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_ski2c 11:42 INFO [databricks.labs.ucx.install] Deleting jobs 11:42 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=893467512984535. 11:42 INFO [databricks.labs.ucx.install] Deleting scan-tables-in-mounts-experimental job_id=584326607196526. 11:42 INFO [databricks.labs.ucx.install] Deleting migrate-external-tables-ctas job_id=622002810748523. 11:42 INFO [databricks.labs.ucx.install] Deleting migrate-external-hiveserde-tables-in-place-experimental job_id=417332683709560. 11:42 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=427335154822641. 11:42 INFO [databricks.labs.ucx.install] Deleting migrate-data-reconciliation job_id=586715647270310. 11:42 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=672669039178276. 11:42 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=283553324649138. 11:42 INFO [databricks.labs.ucx.install] Deleting failing job_id=162666362972253. 11:42 INFO [databricks.labs.ucx.install] Deleting assessment job_id=135028625734542. 11:42 INFO [databricks.labs.ucx.install] Deleting experimental-workflow-linter job_id=568222036739932. 11:42 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=188783854579708. 11:42 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=808196142461747. 11:42 INFO [databricks.labs.ucx.install] Deleting cluster policy 11:42 INFO [databricks.labs.ucx.install] Deleting secret scope 11:42 INFO [databricks.labs.ucx.install] UnInstalling UCX complete 11:42 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace user fixtures 11:42 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 account group fixtures 11:42 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures 11:42 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 11:42 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 11:42 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 schema fixtures 11:42 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_ski2c', metastore_id=None, name='ucx_ski2c', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw0] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```

Running from acceptance #4277