whitelist fugue - Githubissues

❌ 79/84 passed, 5 failed, 21 skipped, 6h34m20s total

❌ test_linter_from_context: TimeoutError: Timed out after 0:05:00 (6m20.937s)

``` TimeoutError: Timed out after 0:05:00 [gw0] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 12:34 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 job fixtures 12:34 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 notebook fixtures 12:35 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_s35yh: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_s35yh 12:35 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s35yh', metastore_id=None, name='ucx_s35yh', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 12:35 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.fBK0/config.yml) doesn't exist. 12:35 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 12:35 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 12:35 INFO [databricks.labs.ucx.install] Fetching installations... 12:35 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 12:35 DEBUG [tests.integration.conftest] Waiting for clusters to start... 12:35 DEBUG [tests.integration.conftest] Waiting for clusters to start... 12:35 INFO [databricks.labs.ucx.install] Deleting UCX v0.28.1+3520240709123527 from https://DATABRICKS_HOST 12:35 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_s35yh 12:35 INFO [databricks.labs.ucx.install] Deleting jobs 12:35 ERROR [databricks.labs.ucx.install] No jobs present or jobs already deleted 12:35 INFO [databricks.labs.ucx.install] Deleting cluster policy 12:35 INFO [databricks.labs.ucx.install] Deleting secret scope 12:35 INFO [databricks.labs.ucx.install] UnInstalling UCX complete 12:35 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace user fixtures 12:35 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 account group fixtures 12:35 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures 12:35 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 12:35 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 12:35 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 schema fixtures 12:35 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_s35yh', metastore_id=None, name='ucx_s35yh', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw0] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```

❌ test_migrate_external_table_hiveserde_in_place: TimeoutError: Timed out after 0:05:00 (16m38.27s)

``` TimeoutError: Timed out after 0:05:00 [gw1] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 12:22 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.hiveserde_in_place_hkek: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_hkek 12:22 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.hiveserde_in_place_hkek', metastore_id=None, name='hiveserde_in_place_hkek', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 12:22 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_storage_dir fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_hkek 12:22 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_hkek.parquet_serde_hkek: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_hkek/parquet_serde_hkek 12:22 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_hkek.parquet_serde_hkek', metastore_id=None, name='parquet_serde_hkek', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070913'}, row_filter=None, schema_name='hiveserde_in_place_hkek', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_hkek/parquet_serde_hkek', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 12:22 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_hkek.orc_serde_hkek: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_hkek/orc_serde_hkek 12:22 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_hkek.orc_serde_hkek', metastore_id=None, name='orc_serde_hkek', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070913'}, row_filter=None, schema_name='hiveserde_in_place_hkek', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_hkek/orc_serde_hkek', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 12:23 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_hkek.avro_serde_hkek: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_hkek/avro_serde_hkek 12:23 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_hkek.avro_serde_hkek', metastore_id=None, name='avro_serde_hkek', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070913'}, row_filter=None, schema_name='hiveserde_in_place_hkek', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_hkek/avro_serde_hkek', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 12:24 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720527851193, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cbsoc', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cbsoc', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720527851193, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 12:24 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cbsoc.hiveserde_in_place_hkek: https://DATABRICKS_HOST/explore/data/ucx_cbsoc/hiveserde_in_place_hkek 12:24 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cbsoc', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cbsoc.hiveserde_in_place_hkek', metastore_id=None, name='hiveserde_in_place_hkek', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 12:24 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_scxfv: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_scxfv 12:24 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_scxfv', metastore_id=None, name='ucx_scxfv', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:25 WARNING [databricks.labs.ucx.hive_metastore.migration_status] Catalog ucx_c9x4h no longer exists. Skipping checking its migration status. 12:26 WARNING [databricks.labs.ucx.hive_metastore.migration_status] Catalog ucx_cqv8r no longer exists. Skipping checking its migration status. 12:26 WARNING [databricks.labs.ucx.hive_metastore.migration_status] Catalog ucx_crmyu no longer exists. Skipping checking its migration status. 12:26 WARNING [databricks.labs.ucx.hive_metastore.migration_status] Catalog ucx_cula8 no longer exists. Skipping checking its migration status. 12:26 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_scxfv.tables] fetching tables inventory 12:26 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_scxfv.tables] crawling new batch for tables 12:26 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_hkek] listing tables and views 12:27 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_hkek.avro_serde_hkek] fetching table metadata 12:27 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_hkek.orc_serde_hkek] fetching table metadata 12:27 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_hkek.parquet_serde_hkek] fetching table metadata 12:27 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_scxfv.tables] found 3 new records for tables 12:29 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_hkek.avro_serde_hkek to ucx_cbsoc.hiveserde_in_place_hkek.avro_serde_hkek using SQL query: CREATE TABLE ucx_cbsoc.hiveserde_in_place_hkek.avro_serde_hkek (id INT, region STRING) USING AVRO LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_hkek/avro_serde_hkek' TBLPROPERTIES ('avro.schema.literal'='{\n "namespace": "org.apache.hive",\n "name": "first_schema",\n "type": "record",\n "fields": [\n { "name":"id", "type":"int" },\n { "name":"region", "type":"string" }\n ] }', 'transient_lastDdlTime'='1720527784') 12:29 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_hkek.orc_serde_hkek to ucx_cbsoc.hiveserde_in_place_hkek.orc_serde_hkek using SQL query: CREATE TABLE ucx_cbsoc.hiveserde_in_place_hkek.orc_serde_hkek (id INT, region STRING) USING ORC PARTITIONED BY (region) LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_hkek/orc_serde_hkek' TBLPROPERTIES ('transient_lastDdlTime'='1720527767') 12:29 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_hkek.parquet_serde_hkek to ucx_cbsoc.hiveserde_in_place_hkek.parquet_serde_hkek using SQL query: CREATE TABLE ucx_cbsoc.hiveserde_in_place_hkek.parquet_serde_hkek (id INT, region STRING) USING PARQUET PARTITIONED BY (region) LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_hkek/parquet_serde_hkek' TBLPROPERTIES ('transient_lastDdlTime'='1720527751') 12:22 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.hiveserde_in_place_hkek: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_hkek 12:22 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.hiveserde_in_place_hkek', metastore_id=None, name='hiveserde_in_place_hkek', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 12:22 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_storage_dir fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_hkek 12:22 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_hkek.parquet_serde_hkek: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_hkek/parquet_serde_hkek 12:22 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_hkek.parquet_serde_hkek', metastore_id=None, name='parquet_serde_hkek', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070913'}, row_filter=None, schema_name='hiveserde_in_place_hkek', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_hkek/parquet_serde_hkek', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 12:22 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_hkek.orc_serde_hkek: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_hkek/orc_serde_hkek 12:22 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_hkek.orc_serde_hkek', metastore_id=None, name='orc_serde_hkek', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070913'}, row_filter=None, schema_name='hiveserde_in_place_hkek', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_hkek/orc_serde_hkek', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 12:23 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.hiveserde_in_place_hkek.avro_serde_hkek: https://DATABRICKS_HOST/explore/data/hive_metastore/hiveserde_in_place_hkek/avro_serde_hkek 12:23 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_hkek.avro_serde_hkek', metastore_id=None, name='avro_serde_hkek', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070913'}, row_filter=None, schema_name='hiveserde_in_place_hkek', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_hkek/avro_serde_hkek', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 12:24 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720527851193, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cbsoc', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cbsoc', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720527851193, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 12:24 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cbsoc.hiveserde_in_place_hkek: https://DATABRICKS_HOST/explore/data/ucx_cbsoc/hiveserde_in_place_hkek 12:24 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cbsoc', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cbsoc.hiveserde_in_place_hkek', metastore_id=None, name='hiveserde_in_place_hkek', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 12:24 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_scxfv: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_scxfv 12:24 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_scxfv', metastore_id=None, name='ucx_scxfv', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:24 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:25 WARNING [databricks.labs.ucx.hive_metastore.migration_status] Catalog ucx_c9x4h no longer exists. Skipping checking its migration status. 12:26 WARNING [databricks.labs.ucx.hive_metastore.migration_status] Catalog ucx_cqv8r no longer exists. Skipping checking its migration status. 12:26 WARNING [databricks.labs.ucx.hive_metastore.migration_status] Catalog ucx_crmyu no longer exists. Skipping checking its migration status. 12:26 WARNING [databricks.labs.ucx.hive_metastore.migration_status] Catalog ucx_cula8 no longer exists. Skipping checking its migration status. 12:26 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_scxfv.tables] fetching tables inventory 12:26 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_scxfv.tables] crawling new batch for tables 12:26 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_hkek] listing tables and views 12:27 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_hkek.avro_serde_hkek] fetching table metadata 12:27 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_hkek.orc_serde_hkek] fetching table metadata 12:27 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.hiveserde_in_place_hkek.parquet_serde_hkek] fetching table metadata 12:27 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_scxfv.tables] found 3 new records for tables 12:29 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_hkek.avro_serde_hkek to ucx_cbsoc.hiveserde_in_place_hkek.avro_serde_hkek using SQL query: CREATE TABLE ucx_cbsoc.hiveserde_in_place_hkek.avro_serde_hkek (id INT, region STRING) USING AVRO LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_hkek/avro_serde_hkek' TBLPROPERTIES ('avro.schema.literal'='{\n "namespace": "org.apache.hive",\n "name": "first_schema",\n "type": "record",\n "fields": [\n { "name":"id", "type":"int" },\n { "name":"region", "type":"string" }\n ] }', 'transient_lastDdlTime'='1720527784') 12:29 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_hkek.orc_serde_hkek to ucx_cbsoc.hiveserde_in_place_hkek.orc_serde_hkek using SQL query: CREATE TABLE ucx_cbsoc.hiveserde_in_place_hkek.orc_serde_hkek (id INT, region STRING) USING ORC PARTITIONED BY (region) LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_hkek/orc_serde_hkek' TBLPROPERTIES ('transient_lastDdlTime'='1720527767') 12:29 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating external table hive_metastore.hiveserde_in_place_hkek.parquet_serde_hkek to ucx_cbsoc.hiveserde_in_place_hkek.parquet_serde_hkek using SQL query: CREATE TABLE ucx_cbsoc.hiveserde_in_place_hkek.parquet_serde_hkek (id INT, region STRING) USING PARQUET PARTITIONED BY (region) LOCATION 'TEST_MOUNT_CONTAINER/a/hiveserde_in_place_hkek/parquet_serde_hkek' TBLPROPERTIES ('transient_lastDdlTime'='1720527751') 12:35 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 catalog fixtures 12:35 DEBUG [databricks.labs.ucx.mixins.fixtures] removing catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720527851193, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cbsoc', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cbsoc', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720527851193, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 12:35 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_storage_dir fixtures 12:35 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_storage_dir fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_hkek 12:35 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures 12:35 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 12:35 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 table fixtures 12:35 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_hkek.parquet_serde_hkek', metastore_id=None, name='parquet_serde_hkek', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070913'}, row_filter=None, schema_name='hiveserde_in_place_hkek', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_hkek/parquet_serde_hkek', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 12:36 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_hkek.orc_serde_hkek', metastore_id=None, name='orc_serde_hkek', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070913'}, row_filter=None, schema_name='hiveserde_in_place_hkek', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_hkek/orc_serde_hkek', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 12:36 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=None, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.hiveserde_in_place_hkek.avro_serde_hkek', metastore_id=None, name='avro_serde_hkek', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070913'}, row_filter=None, schema_name='hiveserde_in_place_hkek', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/hiveserde_in_place_hkek/avro_serde_hkek', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 12:37 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 schema fixtures 12:37 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.hiveserde_in_place_hkek', metastore_id=None, name='hiveserde_in_place_hkek', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 12:37 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cbsoc', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cbsoc.hiveserde_in_place_hkek', metastore_id=None, name='hiveserde_in_place_hkek', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 12:38 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_scxfv', metastore_id=None, name='ucx_scxfv', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw1] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```

❌ test_migrate_external_tables_with_spn_CLOUD_ENV: TimeoutError: Timed out after 0:05:00 (18m51.059s)

``` TimeoutError: Timed out after 0:05:00 12:21 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/vyWY 12:21 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sd3kg: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sd3kg 12:21 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sd3kg', metastore_id=None, name='ucx_sd3kg', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 12:21 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_sd3kg.ucx_tlp5d: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sd3kg/ucx_tlp5d 12:21 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sd3kg.ucx_tlp5d', metastore_id=None, name='ucx_tlp5d', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070913'}, row_filter=None, schema_name='ucx_sd3kg', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/vyWY', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 12:22 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720527730377, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cxr78', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cxr78', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720527730377, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 12:22 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cxr78.ucx_sd3kg: https://DATABRICKS_HOST/explore/data/ucx_cxr78/ucx_sd3kg 12:22 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cxr78', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cxr78.ucx_sd3kg', metastore_id=None, name='ucx_sd3kg', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw4] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 12:21 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/vyWY 12:21 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sd3kg: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sd3kg 12:21 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sd3kg', metastore_id=None, name='ucx_sd3kg', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 12:21 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_sd3kg.ucx_tlp5d: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sd3kg/ucx_tlp5d 12:21 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sd3kg.ucx_tlp5d', metastore_id=None, name='ucx_tlp5d', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070913'}, row_filter=None, schema_name='ucx_sd3kg', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/vyWY', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 12:22 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720527730377, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cxr78', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cxr78', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720527730377, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 12:22 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cxr78.ucx_sd3kg: https://DATABRICKS_HOST/explore/data/ucx_cxr78/ucx_sd3kg 12:22 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cxr78', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cxr78.ucx_sd3kg', metastore_id=None, name='ucx_sd3kg', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 12:22 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: 12:22 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_si2em: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_si2em 12:22 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_si2em', metastore_id=None, name='ucx_si2em', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0709-122226-tqocxdlt [group_name admins CAN_MANAGE] -> [service_principal_name 5a11359f-ba1f-483f-8e00-0fe55ec003ed CAN_ATTACH_TO] 12:22 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_si2em.grants] fetching grants inventory 12:22 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_si2em.grants] crawling new batch for grants 12:22 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_si2em.tables] fetching tables inventory 12:23 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_si2em.tables] crawling new batch for tables 12:23 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sd3kg] listing tables and views 12:23 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sd3kg.ucx_tlp5d] fetching table metadata 12:23 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_si2em.tables] found 1 new records for tables 12:24 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_si2em.udfs] fetching udfs inventory 12:24 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_si2em.udfs] crawling new batch for udfs 12:25 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_sd3kg] listing udfs 12:25 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_si2em.udfs] found 0 new records for udfs 12:26 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_si2em.grants] found 42 new records for grants 12:27 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_si2em.groups] fetching groups inventory 12:27 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_si2em.groups] crawling new batch for groups 12:27 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements... 12:21 DEBUG [databricks.labs.ucx.mixins.fixtures] added make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/vyWY 12:21 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sd3kg: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sd3kg 12:21 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sd3kg', metastore_id=None, name='ucx_sd3kg', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 12:21 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_sd3kg.ucx_tlp5d: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sd3kg/ucx_tlp5d 12:21 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sd3kg.ucx_tlp5d', metastore_id=None, name='ucx_tlp5d', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070913'}, row_filter=None, schema_name='ucx_sd3kg', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/vyWY', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 12:22 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720527730377, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cxr78', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cxr78', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720527730377, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 12:22 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_cxr78.ucx_sd3kg: https://DATABRICKS_HOST/explore/data/ucx_cxr78/ucx_sd3kg 12:22 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cxr78', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cxr78.ucx_sd3kg', metastore_id=None, name='ucx_sd3kg', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 12:22 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: 12:22 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_si2em: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_si2em 12:22 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_si2em', metastore_id=None, name='ucx_si2em', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:22 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster permissions fixture: 0709-122226-tqocxdlt [group_name admins CAN_MANAGE] -> [service_principal_name 5a11359f-ba1f-483f-8e00-0fe55ec003ed CAN_ATTACH_TO] 12:22 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_si2em.grants] fetching grants inventory 12:22 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_si2em.grants] crawling new batch for grants 12:22 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_si2em.tables] fetching tables inventory 12:23 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_si2em.tables] crawling new batch for tables 12:23 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sd3kg] listing tables and views 12:23 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sd3kg.ucx_tlp5d] fetching table metadata 12:23 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_si2em.tables] found 1 new records for tables 12:24 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_si2em.udfs] fetching udfs inventory 12:24 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_si2em.udfs] crawling new batch for udfs 12:25 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_sd3kg] listing udfs 12:25 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_si2em.udfs] found 0 new records for udfs 12:26 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_si2em.grants] found 42 new records for grants 12:27 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_si2em.groups] fetching groups inventory 12:27 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_si2em.groups] crawling new batch for groups 12:27 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements... 12:37 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster permissions fixtures 12:37 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster permissions fixture: 0709-122226-tqocxdlt [group_name admins CAN_MANAGE] -> [service_principal_name 5a11359f-ba1f-483f-8e00-0fe55ec003ed CAN_ATTACH_TO] 12:37 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 catalog fixtures 12:37 DEBUG [databricks.labs.ucx.mixins.fixtures] removing catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720527730377, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cxr78', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_cxr78', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720527730377, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 12:37 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 make_dbfs_data_copy fixtures 12:37 DEBUG [databricks.labs.ucx.mixins.fixtures] removing make_dbfs_data_copy fixture: dbfs:/mnt/TEST_MOUNT_NAME/a/b/vyWY 12:37 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster fixtures 12:37 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster fixture: 12:37 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures 12:37 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 12:37 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 table fixtures 12:37 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sd3kg.ucx_tlp5d', metastore_id=None, name='ucx_tlp5d', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070913'}, row_filter=None, schema_name='ucx_sd3kg', sql_path=None, storage_credential_name=None, storage_location='dbfs:/mnt/TEST_MOUNT_NAME/a/b/vyWY', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 12:38 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 schema fixtures 12:38 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sd3kg', metastore_id=None, name='ucx_sd3kg', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 12:39 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_cxr78', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_cxr78.ucx_sd3kg', metastore_id=None, name='ucx_sd3kg', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 12:39 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_si2em', metastore_id=None, name='ucx_si2em', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 12:40 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace user fixtures [gw4] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```

❌ test_migrate_managed_tables_with_acl: TimeoutError: Timed out after 0:05:00 (23m44.654s)

``` TimeoutError: Timed out after 0:05:00 [gw2] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 12:25 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sc2fl: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sc2fl 12:25 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sc2fl', metastore_id=None, name='ucx_sc2fl', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 12:25 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_sc2fl.ucx_tsbhz: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sc2fl/ucx_tsbhz 12:25 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sc2fl.ucx_tsbhz', metastore_id=None, name='ucx_tsbhz', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070913'}, row_filter=None, schema_name='ucx_sc2fl', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_sc2fl/ucx_tsbhz', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 12:26 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-0eme-ra78a4df01@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-0eme-ra78a4df01@example.com')], entitlements=[], external_id=None, groups=[], id='4753450965950800', name=Name(family_name=None, given_name='sdk-0eme-ra78a4df01@example.com'), roles=[], schemas=[, ], user_name='sdk-0eme-ra78a4df01@example.com') 12:27 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720528075151, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c0p0k', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_c0p0k', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720528075151, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 12:28 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_c0p0k.ucx_sc2fl: https://DATABRICKS_HOST/explore/data/ucx_c0p0k/ucx_sc2fl 12:28 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_c0p0k', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c0p0k.ucx_sc2fl', metastore_id=None, name='ucx_sc2fl', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 12:28 INFO [tests.integration.hive_metastore.test_migrate] dst_catalog=ucx_c0p0k, managed_table=hive_metastore.ucx_sc2fl.ucx_tsbhz 12:28 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_siuax: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_siuax 12:28 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_siuax', metastore_id=None, name='ucx_siuax', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_siuax.grants] fetching grants inventory 12:28 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_siuax.grants] crawling new batch for grants 12:28 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_siuax.tables] fetching tables inventory 12:29 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_siuax.tables] crawling new batch for tables 12:29 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sc2fl] listing tables and views 12:29 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sc2fl.ucx_tsbhz] fetching table metadata 12:30 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_siuax.tables] found 1 new records for tables 12:30 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_siuax.udfs] fetching udfs inventory 12:31 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_siuax.udfs] crawling new batch for udfs 12:31 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_sc2fl] listing udfs 12:31 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_siuax.udfs] found 0 new records for udfs 12:32 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_siuax.grants] found 58 new records for grants 12:33 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_siuax.groups] fetching groups inventory 12:33 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_siuax.groups] crawling new batch for groups 12:33 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements... 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Found 62 WorkspaceGroup 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId... 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Found 155 account groups 12:35 INFO [databricks.labs.ucx.workspace_access.groups] No group listing provided, all matching groups will be migrated 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-Io4I-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-X62l-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-wvWL-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for ucxKs6g group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-UqcL-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-ouRz-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for new_P5g0 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-yykI-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-q1ot-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for old_fxBm group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-98L5-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-F8iY-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for ucxwZNo group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-11un-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-wo2G-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for old_TRnd group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-Pmq8-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-xTct-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-Pbg1-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for new_TRnd group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-0aOK-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for new_fxBm group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for old_P5g0 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-84li-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-AWZU-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for ucx-temp-ucx_GbGMw group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-tlEi-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-4XsH-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-DqwQ-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-ZRn8-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-vh5m-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-4Tyn-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-B4E8-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-ICcE-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for new_EU04 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for old_EU04 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-7O28-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-MK8e-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-bUO6-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-2wiN-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-R4LK-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-vllg-ra78a4df01 group using name matching 12:35 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_siuax.groups] found 20 new records for groups 12:36 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_siuax.tables] fetching tables inventory 12:37 WARNING [databricks.labs.ucx.hive_metastore.migration_status] Catalog ucx_cgzek no longer exists. Skipping checking its migration status. 12:37 WARNING [databricks.labs.ucx.hive_metastore.migration_status] Catalog ucx_cpbjl no longer exists. Skipping checking its migration status. 12:37 WARNING [databricks.labs.ucx.hive_metastore.migration_status] Catalog ucx_cx4va no longer exists. Skipping checking its migration status. 12:38 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_siuax.tables] fetching tables inventory 12:39 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating managed table hive_metastore.ucx_sc2fl.ucx_tsbhz to ucx_c0p0k.ucx_sc2fl.ucx_tsbhz using SQL query: CREATE TABLE IF NOT EXISTS ucx_c0p0k.ucx_sc2fl.ucx_tsbhz DEEP CLONE hive_metastore.ucx_sc2fl.ucx_tsbhz; 12:45 ERROR [databricks.labs.blueprint.parallel] migrate tables(TableToMigrate(src=Table(catalog='hive_metastore', database='ucx_sc2fl', name='ucx_tsbhz', object_type='MANAGED', table_format='DELTA', location='dbfs:/user/hive/warehouse/ucx_sc2fl.db/ucx_tsbhz', view_text=None, upgraded_to=None, storage_properties='{}', is_partitioned=False), rule=Rule(workspace_name='workspace', catalog_name='ucx_c0p0k', src_schema='ucx_sc2fl', dst_schema='ucx_sc2fl', src_table='ucx_tsbhz', dst_table='ucx_tsbhz', recon_tolerance_percent=0, compare_rows=False)), [Grant(principal='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', action_type='OWN', catalog='hive_metastore', database='ucx_sc2fl', table='ucx_tsbhz', view=None, udf=None, any_file=False, anonymous_function=False), Grant(principal='sdk-0eme-ra78a4df01@example.com', action_type='MODIFY', catalog='hive_metastore', database='ucx_sc2fl', table='ucx_tsbhz', view=None, udf=None, any_file=False, anonymous_function=False), Grant(principal='sdk-0eme-ra78a4df01@example.com', action_type='SELECT', catalog='hive_metastore', database='ucx_sc2fl', table='ucx_tsbhz', view=None, udf=None, any_file=False, anonymous_function=False)], [], False) task failed: Timed out after 0:05:00 Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 264, in _perform raise self._make_nicer_error(response=response, **payload) from None databricks.sdk.errors.platform.ResourceExhausted: Too many requests. Please wait a moment and try again. If the issue persists, consider adjusting your request frequency or reaching out to support for assistance. The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/table_migrate.py", line 167, in _migrate_table return self._migrate_dbfs_root_table(src_table.src, src_table.rule, grants) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/table_migrate.py", line 302, in _migrate_dbfs_root_table self._backend.execute(self._sql_alter_from(src_table, rule.as_uc_table_key, self._ws.get_workspace_id())) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/__init__.py", line 667, in get_workspace_id response = self._api_client.do("GET", File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 153, in do response = retryable(self._perform)(method, File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 59, in wrapper raise TimeoutError(f'Timed out after {timeout}') from last_err TimeoutError: Timed out after 0:05:00 12:45 CRITICAL [databricks.labs.blueprint.parallel] All 'migrate tables' tasks failed!!! 12:25 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sc2fl: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sc2fl 12:25 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sc2fl', metastore_id=None, name='ucx_sc2fl', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 12:25 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_sc2fl.ucx_tsbhz: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sc2fl/ucx_tsbhz 12:25 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sc2fl.ucx_tsbhz', metastore_id=None, name='ucx_tsbhz', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070913'}, row_filter=None, schema_name='ucx_sc2fl', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_sc2fl/ucx_tsbhz', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 12:26 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace user fixture: User(active=True, display_name='sdk-0eme-ra78a4df01@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-0eme-ra78a4df01@example.com')], entitlements=[], external_id=None, groups=[], id='4753450965950800', name=Name(family_name=None, given_name='sdk-0eme-ra78a4df01@example.com'), roles=[], schemas=[, ], user_name='sdk-0eme-ra78a4df01@example.com') 12:27 DEBUG [databricks.labs.ucx.mixins.fixtures] added catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720528075151, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c0p0k', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_c0p0k', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720528075151, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 12:28 INFO [databricks.labs.ucx.mixins.fixtures] Schema ucx_c0p0k.ucx_sc2fl: https://DATABRICKS_HOST/explore/data/ucx_c0p0k/ucx_sc2fl 12:28 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_c0p0k', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c0p0k.ucx_sc2fl', metastore_id=None, name='ucx_sc2fl', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 12:28 INFO [tests.integration.hive_metastore.test_migrate] dst_catalog=ucx_c0p0k, managed_table=hive_metastore.ucx_sc2fl.ucx_tsbhz 12:28 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_siuax: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_siuax 12:28 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_siuax', metastore_id=None, name='ucx_siuax', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 WARNING [databricks.labs.ucx.assessment.secrets] Secret in config stored in plaintext. 12:28 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_siuax.grants] fetching grants inventory 12:28 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_siuax.grants] crawling new batch for grants 12:28 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_siuax.tables] fetching tables inventory 12:29 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_siuax.tables] crawling new batch for tables 12:29 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sc2fl] listing tables and views 12:29 DEBUG [databricks.labs.ucx.hive_metastore.tables] [hive_metastore.ucx_sc2fl.ucx_tsbhz] fetching table metadata 12:30 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_siuax.tables] found 1 new records for tables 12:30 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_siuax.udfs] fetching udfs inventory 12:31 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_siuax.udfs] crawling new batch for udfs 12:31 DEBUG [databricks.labs.ucx.hive_metastore.udfs] [hive_metastore.ucx_sc2fl] listing udfs 12:31 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_siuax.udfs] found 0 new records for udfs 12:32 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_siuax.grants] found 58 new records for grants 12:33 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_siuax.groups] fetching groups inventory 12:33 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_siuax.groups] crawling new batch for groups 12:33 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements... 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Found 62 WorkspaceGroup 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId... 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Found 155 account groups 12:35 INFO [databricks.labs.ucx.workspace_access.groups] No group listing provided, all matching groups will be migrated 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-Io4I-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-X62l-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-wvWL-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for ucxKs6g group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-UqcL-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-ouRz-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for new_P5g0 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-yykI-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-q1ot-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for old_fxBm group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-98L5-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-F8iY-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for ucxwZNo group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-11un-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-wo2G-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for old_TRnd group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-Pmq8-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-xTct-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-Pbg1-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for new_TRnd group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-0aOK-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for new_fxBm group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for old_P5g0 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-84li-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-AWZU-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for ucx-temp-ucx_GbGMw group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-tlEi-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-4XsH-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-DqwQ-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-ZRn8-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-vh5m-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-4Tyn-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-B4E8-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-ICcE-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for new_EU04 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for old_EU04 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-7O28-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-MK8e-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-bUO6-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-2wiN-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-R4LK-ra78a4df01 group using name matching 12:35 INFO [databricks.labs.ucx.workspace_access.groups] Couldn't find a matching account group for sdk-vllg-ra78a4df01 group using name matching 12:35 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_siuax.groups] found 20 new records for groups 12:36 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_siuax.tables] fetching tables inventory 12:37 WARNING [databricks.labs.ucx.hive_metastore.migration_status] Catalog ucx_cgzek no longer exists. Skipping checking its migration status. 12:37 WARNING [databricks.labs.ucx.hive_metastore.migration_status] Catalog ucx_cpbjl no longer exists. Skipping checking its migration status. 12:37 WARNING [databricks.labs.ucx.hive_metastore.migration_status] Catalog ucx_cx4va no longer exists. Skipping checking its migration status. 12:38 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_siuax.tables] fetching tables inventory 12:39 DEBUG [databricks.labs.ucx.hive_metastore.table_migrate] Migrating managed table hive_metastore.ucx_sc2fl.ucx_tsbhz to ucx_c0p0k.ucx_sc2fl.ucx_tsbhz using SQL query: CREATE TABLE IF NOT EXISTS ucx_c0p0k.ucx_sc2fl.ucx_tsbhz DEEP CLONE hive_metastore.ucx_sc2fl.ucx_tsbhz; 12:45 ERROR [databricks.labs.blueprint.parallel] migrate tables(TableToMigrate(src=Table(catalog='hive_metastore', database='ucx_sc2fl', name='ucx_tsbhz', object_type='MANAGED', table_format='DELTA', location='dbfs:/user/hive/warehouse/ucx_sc2fl.db/ucx_tsbhz', view_text=None, upgraded_to=None, storage_properties='{}', is_partitioned=False), rule=Rule(workspace_name='workspace', catalog_name='ucx_c0p0k', src_schema='ucx_sc2fl', dst_schema='ucx_sc2fl', src_table='ucx_tsbhz', dst_table='ucx_tsbhz', recon_tolerance_percent=0, compare_rows=False)), [Grant(principal='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', action_type='OWN', catalog='hive_metastore', database='ucx_sc2fl', table='ucx_tsbhz', view=None, udf=None, any_file=False, anonymous_function=False), Grant(principal='sdk-0eme-ra78a4df01@example.com', action_type='MODIFY', catalog='hive_metastore', database='ucx_sc2fl', table='ucx_tsbhz', view=None, udf=None, any_file=False, anonymous_function=False), Grant(principal='sdk-0eme-ra78a4df01@example.com', action_type='SELECT', catalog='hive_metastore', database='ucx_sc2fl', table='ucx_tsbhz', view=None, udf=None, any_file=False, anonymous_function=False)], [], False) task failed: Timed out after 0:05:00 Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 33, in wrapper return func(*args, **kwargs) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 264, in _perform raise self._make_nicer_error(response=response, **payload) from None databricks.sdk.errors.platform.ResourceExhausted: Too many requests. Please wait a moment and try again. If the issue persists, consider adjusting your request frequency or reaching out to support for assistance. The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/blueprint/parallel.py", line 158, in inner return func(*args, **kwargs), None File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/table_migrate.py", line 167, in _migrate_table return self._migrate_dbfs_root_table(src_table.src, src_table.rule, grants) File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/hive_metastore/table_migrate.py", line 302, in _migrate_dbfs_root_table self._backend.execute(self._sql_alter_from(src_table, rule.as_uc_table_key, self._ws.get_workspace_id())) File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/__init__.py", line 667, in get_workspace_id response = self._api_client.do("GET", File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/core.py", line 153, in do response = retryable(self._perform)(method, File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/sdk/retries.py", line 59, in wrapper raise TimeoutError(f'Timed out after {timeout}') from last_err TimeoutError: Timed out after 0:05:00 12:45 CRITICAL [databricks.labs.blueprint.parallel] All 'migrate tables' tasks failed!!! 12:45 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace user fixtures 12:45 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace user fixture: User(active=True, display_name='sdk-0eme-ra78a4df01@example.com', emails=[ComplexValue(display=None, primary=True, ref=None, type='work', value='sdk-0eme-ra78a4df01@example.com')], entitlements=[], external_id=None, groups=[], id='4753450965950800', name=Name(family_name=None, given_name='sdk-0eme-ra78a4df01@example.com'), roles=[], schemas=[, ], user_name='sdk-0eme-ra78a4df01@example.com') 12:45 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 catalog fixtures 12:45 DEBUG [databricks.labs.ucx.mixins.fixtures] removing catalog fixture: CatalogInfo(browse_only=False, catalog_type=, comment='', connection_name=None, created_at=1720528075151, created_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c0p0k', isolation_mode=, metastore_id='8952c1e3-b265-4adf-98c3-6f755e2e1453', name='ucx_c0p0k', options=None, owner='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', properties=None, provider_name=None, provisioning_info=None, securable_kind=, securable_type='CATALOG', share_name=None, storage_location=None, storage_root=None, updated_at=1720528075151, updated_by='0a330eb5-dd51-4d97-b6e4-c474356b1d5d') 12:45 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures 12:45 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 12:45 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 table fixtures 12:45 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sc2fl.ucx_tsbhz', metastore_id=None, name='ucx_tsbhz', owner=None, pipeline_id=None, properties={'RemoveAfter': '2024070913'}, row_filter=None, schema_name='ucx_sc2fl', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_sc2fl/ucx_tsbhz', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 12:46 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 3 schema fixtures 12:46 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sc2fl', metastore_id=None, name='ucx_sc2fl', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 12:47 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='ucx_c0p0k', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='ucx_c0p0k.ucx_sc2fl', metastore_id=None, name='ucx_sc2fl', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 12:47 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_siuax', metastore_id=None, name='ucx_siuax', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw2] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```

❌ test_job_task_linter_library_not_installed_cluster: TimeoutError: Timed out after 0:05:00 (6m27.389s)

``` TimeoutError: Timed out after 0:05:00 [gw0] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 12:42 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: 12:42 DEBUG [databricks.labs.ucx.mixins.fixtures] added directory fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-0sJg-ra78a4df01 12:42 DEBUG [databricks.labs.ucx.mixins.fixtures] added notebook fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-0sJg-ra78a4df01/notebook.ipynb 12:42 DEBUG [databricks.labs.ucx.mixins.fixtures] added notebook fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-LqEb 12:42 INFO [databricks.labs.ucx.mixins.fixtures] Job: https://DATABRICKS_HOST#job/339515500263572 12:42 DEBUG [databricks.labs.ucx.mixins.fixtures] added job fixture: CreateResponse(job_id=339515500263572) 12:42 INFO [databricks.labs.ucx.source_code.jobs] Discovering fZ5J entrypoint: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-0sJg-ra78a4df01/notebook.ipynb 12:42 DEBUG [databricks.labs.ucx.source_code.linters.files] Resolving unknown import: greenlet 12:42 WARNING [databricks.labs.ucx.source_code.jobs] Found job problems: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-0sJg-ra78a4df01/notebook.ipynb:1 [import-not-found] Could not locate import: greenlet [gw0] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 12:42 DEBUG [databricks.labs.ucx.mixins.fixtures] added cluster fixture: 12:42 DEBUG [databricks.labs.ucx.mixins.fixtures] added directory fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-0sJg-ra78a4df01 12:42 DEBUG [databricks.labs.ucx.mixins.fixtures] added notebook fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-0sJg-ra78a4df01/notebook.ipynb 12:42 DEBUG [databricks.labs.ucx.mixins.fixtures] added notebook fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-LqEb 12:42 INFO [databricks.labs.ucx.mixins.fixtures] Job: https://DATABRICKS_HOST#job/339515500263572 12:42 DEBUG [databricks.labs.ucx.mixins.fixtures] added job fixture: CreateResponse(job_id=339515500263572) 12:42 INFO [databricks.labs.ucx.source_code.jobs] Discovering fZ5J entrypoint: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-0sJg-ra78a4df01/notebook.ipynb 12:42 DEBUG [databricks.labs.ucx.source_code.linters.files] Resolving unknown import: greenlet 12:42 WARNING [databricks.labs.ucx.source_code.jobs] Found job problems: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-0sJg-ra78a4df01/notebook.ipynb:1 [import-not-found] Could not locate import: greenlet 12:42 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 directory fixtures 12:42 DEBUG [databricks.labs.ucx.mixins.fixtures] removing directory fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-0sJg-ra78a4df01 12:42 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 cluster fixtures 12:42 DEBUG [databricks.labs.ucx.mixins.fixtures] removing cluster fixture: 12:42 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 job fixtures 12:42 DEBUG [databricks.labs.ucx.mixins.fixtures] removing job fixture: CreateResponse(job_id=339515500263572) 12:42 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 2 notebook fixtures 12:42 DEBUG [databricks.labs.ucx.mixins.fixtures] removing notebook fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-0sJg-ra78a4df01/notebook.ipynb 12:42 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while notebook /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-0sJg-ra78a4df01/notebook.ipynb teardown: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-0sJg-ra78a4df01/notebook.ipynb) doesn't exist. 12:42 DEBUG [databricks.labs.ucx.mixins.fixtures] removing notebook fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-LqEb 12:42 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_swaqw: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_swaqw 12:42 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_swaqw', metastore_id=None, name='ucx_swaqw', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 12:48 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace user fixtures 12:48 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 account group fixtures 12:48 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures 12:48 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 12:48 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 12:48 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 schema fixtures 12:48 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_swaqw', metastore_id=None, name='ucx_swaqw', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) ```

_{Running from acceptance #4454}

databrickslabs / ucx

whitelist fugue #2068

Changes

Linked issues

Functionality

Tests