Your best companion for upgrading to Unity Catalog. UCX will guide you, the Databricks customer, through the process of upgrading your account, groups, workspaces, jobs etc. to Unity Catalog.
Other
193
stars
69
forks
source link
Test failure: `test_running_real_workflow_linter_job` #1952
❌ test_running_real_workflow_linter_job: TimeoutError: timed out after 0:20:00: (31m38.45s)
```
TimeoutError: timed out after 0:20:00:
[gw3] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
07:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added directory fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-t4Yb
07:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added notebook fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-t4Yb/notebook.ipynb
07:06 INFO [databricks.labs.ucx.mixins.fixtures] Job: https://DATABRICKS_HOST#job/1081193719786485
07:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added job fixture: CreateResponse(job_id=1081193719786485)
07:06 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_se9xo: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_se9xo
07:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_se9xo', metastore_id=None, name='ucx_se9xo', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
07:06 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.2pam/config.yml) doesn't exist.
07:06 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
07:06 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
07:06 INFO [databricks.labs.ucx.install] Fetching installations...
07:06 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
07:06 DEBUG [tests.integration.conftest] Waiting for clusters to start...
07:17 DEBUG [tests.integration.conftest] Waiting for clusters to start...
07:17 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+1320240629071728
07:17 INFO [databricks.labs.ucx.install] Creating ucx schemas...
07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter
07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
07:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
07:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental
07:18 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.2pam/README for the next steps.
07:18 DEBUG [databricks.labs.ucx.installer.workflows] starting experimental-workflow-linter job: https://DATABRICKS_HOST#job/273125314324787
07:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added directory fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-t4Yb
07:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added notebook fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-t4Yb/notebook.ipynb
07:06 INFO [databricks.labs.ucx.mixins.fixtures] Job: https://DATABRICKS_HOST#job/1081193719786485
07:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added job fixture: CreateResponse(job_id=1081193719786485)
07:06 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_se9xo: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_se9xo
07:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_se9xo', metastore_id=None, name='ucx_se9xo', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
07:06 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.2pam/config.yml) doesn't exist.
07:06 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
07:06 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
07:06 INFO [databricks.labs.ucx.install] Fetching installations...
07:06 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
07:06 DEBUG [tests.integration.conftest] Waiting for clusters to start...
07:17 DEBUG [tests.integration.conftest] Waiting for clusters to start...
07:17 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+1320240629071728
07:17 INFO [databricks.labs.ucx.install] Creating ucx schemas...
07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter
07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
07:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
07:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental
07:18 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.2pam/README for the next steps.
07:18 DEBUG [databricks.labs.ucx.installer.workflows] starting experimental-workflow-linter job: https://DATABRICKS_HOST#job/273125314324787
07:38 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 job fixtures
07:38 DEBUG [databricks.labs.ucx.mixins.fixtures] removing job fixture: CreateResponse(job_id=1081193719786485)
07:38 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 directory fixtures
07:38 DEBUG [databricks.labs.ucx.mixins.fixtures] removing directory fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-t4Yb
07:38 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 notebook fixtures
07:38 DEBUG [databricks.labs.ucx.mixins.fixtures] removing notebook fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-t4Yb/notebook.ipynb
07:38 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while notebook /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-t4Yb/notebook.ipynb teardown: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-t4Yb/notebook.ipynb) doesn't exist.
07:38 INFO [databricks.labs.ucx.install] Deleting UCX v0.27.2+1320240629071728 from https://DATABRICKS_HOST
07:38 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_se9xo
07:38 INFO [databricks.labs.ucx.install] Deleting jobs
07:38 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=562576206739489.
07:38 INFO [databricks.labs.ucx.install] Deleting experimental-workflow-linter job_id=273125314324787.
07:38 INFO [databricks.labs.ucx.install] Deleting assessment job_id=1081780995405996.
07:38 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=106273495421654.
07:38 INFO [databricks.labs.ucx.install] Deleting migrate-external-hiveserde-tables-in-place-experimental job_id=211422940656698.
07:38 INFO [databricks.labs.ucx.install] Deleting failing job_id=371306464674789.
07:38 INFO [databricks.labs.ucx.install] Deleting migrate-data-reconciliation job_id=1045066516992903.
07:38 INFO [databricks.labs.ucx.install] Deleting migrate-external-tables-ctas job_id=195479479034033.
07:38 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=1084653344650123.
07:38 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=779758060703818.
07:38 INFO [databricks.labs.ucx.install] Deleting scan-tables-in-mounts-experimental job_id=603144883747037.
07:38 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=114439341189572.
07:38 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=399576895064750.
07:38 INFO [databricks.labs.ucx.install] Deleting cluster policy
07:38 INFO [databricks.labs.ucx.install] Deleting secret scope
07:38 INFO [databricks.labs.ucx.install] UnInstalling UCX complete
07:38 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace user fixtures
07:38 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 account group fixtures
07:38 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures
07:38 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures
07:38 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures
07:38 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 schema fixtures
07:38 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_se9xo', metastore_id=None, name='ucx_se9xo', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
[gw3] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
```
❌ test_running_real_workflow_linter_job: TimeoutError: timed out after 0:20:00: (26m36.858s)
```
TimeoutError: timed out after 0:20:00:
[gw1] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
07:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added directory fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-4f0Y
07:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added notebook fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-4f0Y/notebook.ipynb
07:07 INFO [databricks.labs.ucx.mixins.fixtures] Job: https://DATABRICKS_HOST#job/844657705677439
07:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added job fixture: CreateResponse(job_id=844657705677439)
07:07 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_st3wc: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_st3wc
07:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_st3wc', metastore_id=None, name='ucx_st3wc', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
07:07 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.UWij/config.yml) doesn't exist.
07:07 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
07:07 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
07:07 INFO [databricks.labs.ucx.install] Fetching installations...
07:07 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
07:07 DEBUG [tests.integration.conftest] Waiting for clusters to start...
07:13 DEBUG [tests.integration.conftest] Waiting for clusters to start...
07:13 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+1320240701071324
07:13 INFO [databricks.labs.ucx.install] Creating ucx schemas...
07:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
07:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
07:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
07:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
07:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter
07:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
07:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
07:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
07:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental
07:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
07:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
07:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
07:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
07:13 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.UWij/README for the next steps.
07:13 DEBUG [databricks.labs.ucx.installer.workflows] starting experimental-workflow-linter job: https://DATABRICKS_HOST#job/1010564582685501
07:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added directory fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-4f0Y
07:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added notebook fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-4f0Y/notebook.ipynb
07:07 INFO [databricks.labs.ucx.mixins.fixtures] Job: https://DATABRICKS_HOST#job/844657705677439
07:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added job fixture: CreateResponse(job_id=844657705677439)
07:07 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_st3wc: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_st3wc
07:07 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_st3wc', metastore_id=None, name='ucx_st3wc', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
07:07 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.UWij/config.yml) doesn't exist.
07:07 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
07:07 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
07:07 INFO [databricks.labs.ucx.install] Fetching installations...
07:07 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
07:07 DEBUG [tests.integration.conftest] Waiting for clusters to start...
07:13 DEBUG [tests.integration.conftest] Waiting for clusters to start...
07:13 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+1320240701071324
07:13 INFO [databricks.labs.ucx.install] Creating ucx schemas...
07:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental
07:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions
07:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment
07:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental
07:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter
07:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups
07:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental
07:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation
07:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental
07:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables
07:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing
07:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups
07:13 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas
07:13 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.UWij/README for the next steps.
07:13 DEBUG [databricks.labs.ucx.installer.workflows] starting experimental-workflow-linter job: https://DATABRICKS_HOST#job/1010564582685501
07:33 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 job fixtures
07:33 DEBUG [databricks.labs.ucx.mixins.fixtures] removing job fixture: CreateResponse(job_id=844657705677439)
07:33 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 directory fixtures
07:33 DEBUG [databricks.labs.ucx.mixins.fixtures] removing directory fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-4f0Y
07:33 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 notebook fixtures
07:33 DEBUG [databricks.labs.ucx.mixins.fixtures] removing notebook fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-4f0Y/notebook.ipynb
07:33 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while notebook /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-4f0Y/notebook.ipynb teardown: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-4f0Y/notebook.ipynb) doesn't exist.
07:33 INFO [databricks.labs.ucx.install] Deleting UCX v0.27.2+1320240701071324 from https://DATABRICKS_HOST
07:33 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_st3wc
07:33 INFO [databricks.labs.ucx.install] Deleting jobs
07:33 INFO [databricks.labs.ucx.install] Deleting migrate-external-hiveserde-tables-in-place-experimental job_id=1044530977308858.
07:33 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=567769840601047.
07:33 INFO [databricks.labs.ucx.install] Deleting assessment job_id=161771901721946.
07:33 INFO [databricks.labs.ucx.install] Deleting scan-tables-in-mounts-experimental job_id=498151264603017.
07:33 INFO [databricks.labs.ucx.install] Deleting experimental-workflow-linter job_id=1010564582685501.
07:33 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=949967895701167.
07:33 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=854321480877004.
07:33 INFO [databricks.labs.ucx.install] Deleting migrate-data-reconciliation job_id=601341985782192.
07:33 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=1080857165888662.
07:33 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=344591421645274.
07:33 INFO [databricks.labs.ucx.install] Deleting failing job_id=590266137656591.
07:33 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=216489948359300.
07:33 INFO [databricks.labs.ucx.install] Deleting migrate-external-tables-ctas job_id=802410740584212.
07:33 INFO [databricks.labs.ucx.install] Deleting cluster policy
07:33 INFO [databricks.labs.ucx.install] Deleting secret scope
07:33 INFO [databricks.labs.ucx.install] UnInstalling UCX complete
07:33 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace user fixtures
07:33 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 account group fixtures
07:33 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures
07:33 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures
07:33 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures
07:33 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 schema fixtures
07:33 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_st3wc', metastore_id=None, name='ucx_st3wc', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None)
[gw1] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python
```
❌ test_running_real_workflow_linter_job: TimeoutError: timed out after 0:20:00: (31m38.45s)
``` TimeoutError: timed out after 0:20:00: [gw3] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 07:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added directory fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-t4Yb 07:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added notebook fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-t4Yb/notebook.ipynb 07:06 INFO [databricks.labs.ucx.mixins.fixtures] Job: https://DATABRICKS_HOST#job/1081193719786485 07:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added job fixture: CreateResponse(job_id=1081193719786485) 07:06 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_se9xo: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_se9xo 07:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_se9xo', metastore_id=None, name='ucx_se9xo', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:06 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.2pam/config.yml) doesn't exist. 07:06 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 07:06 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 07:06 INFO [databricks.labs.ucx.install] Fetching installations... 07:06 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 07:06 DEBUG [tests.integration.conftest] Waiting for clusters to start... 07:17 DEBUG [tests.integration.conftest] Waiting for clusters to start... 07:17 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+1320240629071728 07:17 INFO [databricks.labs.ucx.install] Creating ucx schemas... 07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 07:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 07:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 07:18 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.2pam/README for the next steps. 07:18 DEBUG [databricks.labs.ucx.installer.workflows] starting experimental-workflow-linter job: https://DATABRICKS_HOST#job/273125314324787 07:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added directory fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-t4Yb 07:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added notebook fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-t4Yb/notebook.ipynb 07:06 INFO [databricks.labs.ucx.mixins.fixtures] Job: https://DATABRICKS_HOST#job/1081193719786485 07:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added job fixture: CreateResponse(job_id=1081193719786485) 07:06 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_se9xo: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_se9xo 07:06 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_se9xo', metastore_id=None, name='ucx_se9xo', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:06 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.2pam/config.yml) doesn't exist. 07:06 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 07:06 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 07:06 INFO [databricks.labs.ucx.install] Fetching installations... 07:06 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 07:06 DEBUG [tests.integration.conftest] Waiting for clusters to start... 07:17 DEBUG [tests.integration.conftest] Waiting for clusters to start... 07:17 INFO [databricks.labs.ucx.install] Installing UCX v0.27.2+1320240629071728 07:17 INFO [databricks.labs.ucx.install] Creating ucx schemas... 07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=experimental-workflow-linter 07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-hiveserde-tables-in-place-experimental 07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=failing 07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-data-reconciliation 07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-external-tables-ctas 07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 07:17 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=scan-tables-in-mounts-experimental 07:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 07:18 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 07:18 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.2pam/README for the next steps. 07:18 DEBUG [databricks.labs.ucx.installer.workflows] starting experimental-workflow-linter job: https://DATABRICKS_HOST#job/273125314324787 07:38 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 job fixtures 07:38 DEBUG [databricks.labs.ucx.mixins.fixtures] removing job fixture: CreateResponse(job_id=1081193719786485) 07:38 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 directory fixtures 07:38 DEBUG [databricks.labs.ucx.mixins.fixtures] removing directory fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-t4Yb 07:38 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 notebook fixtures 07:38 DEBUG [databricks.labs.ucx.mixins.fixtures] removing notebook fixture: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-t4Yb/notebook.ipynb 07:38 DEBUG [databricks.labs.ucx.mixins.fixtures] ignoring error while notebook /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-t4Yb/notebook.ipynb teardown: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/sdk-t4Yb/notebook.ipynb) doesn't exist. 07:38 INFO [databricks.labs.ucx.install] Deleting UCX v0.27.2+1320240629071728 from https://DATABRICKS_HOST 07:38 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_se9xo 07:38 INFO [databricks.labs.ucx.install] Deleting jobs 07:38 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=562576206739489. 07:38 INFO [databricks.labs.ucx.install] Deleting experimental-workflow-linter job_id=273125314324787. 07:38 INFO [databricks.labs.ucx.install] Deleting assessment job_id=1081780995405996. 07:38 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=106273495421654. 07:38 INFO [databricks.labs.ucx.install] Deleting migrate-external-hiveserde-tables-in-place-experimental job_id=211422940656698. 07:38 INFO [databricks.labs.ucx.install] Deleting failing job_id=371306464674789. 07:38 INFO [databricks.labs.ucx.install] Deleting migrate-data-reconciliation job_id=1045066516992903. 07:38 INFO [databricks.labs.ucx.install] Deleting migrate-external-tables-ctas job_id=195479479034033. 07:38 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=1084653344650123. 07:38 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=779758060703818. 07:38 INFO [databricks.labs.ucx.install] Deleting scan-tables-in-mounts-experimental job_id=603144883747037. 07:38 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=114439341189572. 07:38 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=399576895064750. 07:38 INFO [databricks.labs.ucx.install] Deleting cluster policy 07:38 INFO [databricks.labs.ucx.install] Deleting secret scope 07:38 INFO [databricks.labs.ucx.install] UnInstalling UCX complete 07:38 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace user fixtures 07:38 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 account group fixtures 07:38 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 workspace group fixtures 07:38 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 07:38 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 0 table fixtures 07:38 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 schema fixtures 07:38 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_se9xo', metastore_id=None, name='ucx_se9xo', owner=None, properties=None, schema_id=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) [gw3] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```Running from nightly #106