databrickslabs / ucx

Automated migrations to Unity Catalog
Other
221 stars 77 forks source link

Test failure: `test_job_spark_python_task_linter_unhappy_path` #2845

Open github-actions[bot] opened 1 day ago

github-actions[bot] commented 1 day ago
❌ test_job_spark_python_task_linter_unhappy_path: assert 0 == 1 (9.81s) ``` assert 0 == 1 + where 0 = len([]) 05:18 INFO [databricks.sdk] Using Databricks Metadata Service authentication 05:18 INFO [databricks.sdk] Using Databricks Metadata Service authentication [gw7] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python 05:18 INFO [databricks.sdk] Using Databricks Metadata Service authentication 05:18 INFO [databricks.sdk] Using Databricks Metadata Service authentication 05:18 INFO [databricks.labs.pytester.fixtures.notebooks] Created folder: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-03LV-ra78a5529b 05:18 INFO [databricks.labs.pytester.fixtures.notebooks] Created notebook: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-03LV-ra78a5529b/notebook.py 05:18 INFO [databricks.labs.pytester.fixtures.baseline] Created dummy-1AOJ: https://DATABRICKS_HOST/compute/clusters/1005-051858-v9rm75j2 05:18 INFO [databricks.labs.pytester.fixtures.notebooks] Created notebook: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-79mv-ra78a5529b 05:18 INFO [databricks.labs.pytester.fixtures.baseline] Created dummy-oUPI: https://DATABRICKS_HOST/job/604357884143965 05:18 INFO [databricks.labs.pytester.fixtures.baseline] Created hive_metastore.dummy_sesav schema: https://DATABRICKS_HOST/#explore/data/hive_metastore/dummy_sesav 05:19 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.kJpp/config.yml) doesn't exist. 05:19 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Inventory Database stored in hive_metastore 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Catalog to store UCX artifacts in 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Log level 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Number of threads 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Backup prefix 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Choose how to map the workspace groups: [0] Match by Name [1] Apply a Prefix [2] Apply a Suffix [3] Match by External ID [4] Regex Substitution [5] Regex Matching Enter a number between 0 and 5 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Enter a prefix to add to the workspace group name 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Comma-separated list of workspace group names to migrate. If not specified, we'll use all account-level groups with matching names to workspace-level groups 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Comma-separated list of databases to migrate. If not specified, we'll use all databases in hive_metastore 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Does given workspace 414838440637730 block Internet access? 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to trigger assessment job after installation? 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Reconciliation threshold, in percentage 05:19 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: No HMS lineage collection init script exists, do you want to create one? 05:19 INFO [databricks.labs.ucx.install] Fetching installations... 05:19 INFO [databricks.labs.blueprint.parallel] finding kJpp installations 100/101, rps: 223.957/sec 05:19 INFO [databricks.labs.blueprint.parallel] finding kJpp installations 101/101, rps: 223.217/sec 05:19 INFO [databricks.labs.blueprint.parallel] Finished 'finding kJpp installations' tasks: 0% results available (0/101). Took 0:00:00.453089 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Select PRO or SERVERLESS SQL warehouse to run assessment dashboards on [0] [Create new PRO SQL warehouse] [1] DEFAULT Test Warehouse (TEST_DEFAULT_WAREHOUSE_ID, SERVERLESS, RUNNING) Enter a number between 0 and 1 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Instance pool id to be set in cluster policy for all workflow clusters 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: We have identified one or more cluster policies set up for an external metastore. Would you like to set UCX to connect to the external metastore? 05:19 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Parallelism for migrating dbfs root delta tables with deep clone 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Min workers for auto-scale job cluster for table migration 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Max workers for auto-scale job cluster for table migration 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Open config file in the browser and continue installing? https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.kJpp/config.yml 05:19 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:19 INFO [databricks.labs.blueprint.parallel] ensure clusters running 3/3, rps: 60.775/sec 05:19 INFO [databricks.labs.blueprint.parallel] Finished 'ensure clusters running' tasks: 0% results available (0/3). Took 0:00:00.049610 05:19 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:19 INFO [databricks.labs.pytester.fixtures.baseline] Created ucx_zsb6inSw41lr8TlF catalog: https://DATABRICKS_HOST/#explore/data/ucx_zsb6inSw41lr8TlF 05:19 INFO [databricks.labs.ucx.source_code.jobs] Discovering qMUm entrypoint: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-03LV-ra78a5529b/notebook.py 05:19 INFO [databricks.labs.ucx.source_code.jobs] Linting qMUm dependency: Dependency 05:18 INFO [databricks.sdk] Using Databricks Metadata Service authentication 05:18 INFO [databricks.sdk] Using Databricks Metadata Service authentication 05:18 INFO [databricks.labs.pytester.fixtures.notebooks] Created folder: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-03LV-ra78a5529b 05:18 INFO [databricks.labs.pytester.fixtures.notebooks] Created notebook: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-03LV-ra78a5529b/notebook.py 05:18 INFO [databricks.labs.pytester.fixtures.baseline] Created dummy-1AOJ: https://DATABRICKS_HOST/compute/clusters/1005-051858-v9rm75j2 05:18 INFO [databricks.labs.pytester.fixtures.notebooks] Created notebook: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-79mv-ra78a5529b 05:18 INFO [databricks.labs.pytester.fixtures.baseline] Created dummy-oUPI: https://DATABRICKS_HOST/job/604357884143965 05:18 INFO [databricks.labs.pytester.fixtures.baseline] Created hive_metastore.dummy_sesav schema: https://DATABRICKS_HOST/#explore/data/hive_metastore/dummy_sesav 05:19 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.kJpp/config.yml) doesn't exist. 05:19 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Inventory Database stored in hive_metastore 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Catalog to store UCX artifacts in 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Log level 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Number of threads 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Backup prefix 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Choose how to map the workspace groups: [0] Match by Name [1] Apply a Prefix [2] Apply a Suffix [3] Match by External ID [4] Regex Substitution [5] Regex Matching Enter a number between 0 and 5 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Enter a prefix to add to the workspace group name 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Comma-separated list of workspace group names to migrate. If not specified, we'll use all account-level groups with matching names to workspace-level groups 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Comma-separated list of databases to migrate. If not specified, we'll use all databases in hive_metastore 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Does given workspace 414838440637730 block Internet access? 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to trigger assessment job after installation? 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Reconciliation threshold, in percentage 05:19 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: No HMS lineage collection init script exists, do you want to create one? 05:19 INFO [databricks.labs.ucx.install] Fetching installations... 05:19 INFO [databricks.labs.blueprint.parallel] finding kJpp installations 100/101, rps: 223.957/sec 05:19 INFO [databricks.labs.blueprint.parallel] finding kJpp installations 101/101, rps: 223.217/sec 05:19 INFO [databricks.labs.blueprint.parallel] Finished 'finding kJpp installations' tasks: 0% results available (0/101). Took 0:00:00.453089 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Select PRO or SERVERLESS SQL warehouse to run assessment dashboards on [0] [Create new PRO SQL warehouse] [1] DEFAULT Test Warehouse (TEST_DEFAULT_WAREHOUSE_ID, SERVERLESS, RUNNING) Enter a number between 0 and 1 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Instance pool id to be set in cluster policy for all workflow clusters 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: We have identified one or more cluster policies set up for an external metastore. Would you like to set UCX to connect to the external metastore? 05:19 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Parallelism for migrating dbfs root delta tables with deep clone 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Min workers for auto-scale job cluster for table migration 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Max workers for auto-scale job cluster for table migration 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Open config file in the browser and continue installing? https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.kJpp/config.yml 05:19 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:19 INFO [databricks.labs.blueprint.parallel] ensure clusters running 3/3, rps: 60.775/sec 05:19 INFO [databricks.labs.blueprint.parallel] Finished 'ensure clusters running' tasks: 0% results available (0/3). Took 0:00:00.049610 05:19 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:19 INFO [databricks.labs.pytester.fixtures.baseline] Created ucx_zsb6inSw41lr8TlF catalog: https://DATABRICKS_HOST/#explore/data/ucx_zsb6inSw41lr8TlF 05:19 INFO [databricks.labs.ucx.source_code.jobs] Discovering qMUm entrypoint: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-03LV-ra78a5529b/notebook.py 05:19 INFO [databricks.labs.ucx.source_code.jobs] Linting qMUm dependency: Dependency 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to uninstall ucx from the workspace too, this would remove ucx project folder, dashboards, queries and jobs 05:19 INFO [databricks.labs.ucx.install] Deleting UCX v0.39.1+None20241005051905 from https://DATABRICKS_HOST 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to delete the inventory database dummy_sesav too? 05:19 INFO [databricks.labs.ucx.install] Deleting inventory database dummy_sesav 05:19 INFO [databricks.labs.lsql.deployment] Deleting hive_metastore.dummy_sesav database 05:19 INFO [databricks.labs.ucx.install] Deleting cluster policy 05:19 INFO [databricks.labs.ucx.install] Deleting secret scope 05:19 INFO [databricks.labs.ucx.install] UnInstalling UCX complete [gw7] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python ```

Running from nightly #218

github-actions[bot] commented 22 hours ago
❌ test_job_spark_python_task_linter_unhappy_path: assert 0 == 1 (10.091s) ``` assert 0 == 1 + where 0 = len([]) 05:19 INFO [databricks.sdk] Using Databricks Metadata Service authentication 05:19 INFO [databricks.sdk] Using Databricks Metadata Service authentication [gw9] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python 05:19 INFO [databricks.sdk] Using Databricks Metadata Service authentication 05:19 INFO [databricks.sdk] Using Databricks Metadata Service authentication 05:19 INFO [databricks.labs.pytester.fixtures.notebooks] Created folder: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-GbRG-ra78a552ff 05:19 INFO [databricks.labs.pytester.fixtures.notebooks] Created notebook: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-GbRG-ra78a552ff/notebook.py 05:19 INFO [databricks.labs.pytester.fixtures.baseline] Created dummy-Dr3H: https://DATABRICKS_HOST/compute/clusters/1006-051919-63ga8v9x 05:19 INFO [databricks.labs.pytester.fixtures.notebooks] Created notebook: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-hXwM-ra78a552ff 05:19 INFO [databricks.labs.pytester.fixtures.baseline] Created dummy-G2Ec: https://DATABRICKS_HOST/job/959230418810257 05:19 INFO [databricks.labs.pytester.fixtures.baseline] Created hive_metastore.dummy_szibx schema: https://DATABRICKS_HOST/#explore/data/hive_metastore/dummy_szibx 05:19 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.y9iO/config.yml) doesn't exist. 05:19 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Inventory Database stored in hive_metastore 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Catalog to store UCX artifacts in 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Log level 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Number of threads 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Backup prefix 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Choose how to map the workspace groups: [0] Match by Name [1] Apply a Prefix [2] Apply a Suffix [3] Match by External ID [4] Regex Substitution [5] Regex Matching Enter a number between 0 and 5 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Enter a prefix to add to the workspace group name 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Comma-separated list of workspace group names to migrate. If not specified, we'll use all account-level groups with matching names to workspace-level groups 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Comma-separated list of databases to migrate. If not specified, we'll use all databases in hive_metastore 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Does given workspace 414838440637730 block Internet access? 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to trigger assessment job after installation? 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Reconciliation threshold, in percentage 05:19 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: No HMS lineage collection init script exists, do you want to create one? 05:19 INFO [databricks.labs.ucx.install] Fetching installations... 05:19 INFO [databricks.labs.blueprint.parallel] finding y9iO installations 100/101, rps: 239.038/sec 05:19 INFO [databricks.labs.blueprint.parallel] finding y9iO installations 101/101, rps: 240.660/sec 05:19 INFO [databricks.labs.blueprint.parallel] Finished 'finding y9iO installations' tasks: 0% results available (0/101). Took 0:00:00.420353 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Select PRO or SERVERLESS SQL warehouse to run assessment dashboards on [0] [Create new PRO SQL warehouse] [1] DEFAULT Test Warehouse (DATABRICKS_WAREHOUSE_ID, SERVERLESS, RUNNING) Enter a number between 0 and 1 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Instance pool id to be set in cluster policy for all workflow clusters 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: We have identified one or more cluster policies set up for an external metastore. Would you like to set UCX to connect to the external metastore? 05:19 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Parallelism for migrating dbfs root delta tables with deep clone 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Min workers for auto-scale job cluster for table migration 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Max workers for auto-scale job cluster for table migration 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Open config file in the browser and continue installing? https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.y9iO/config.yml 05:19 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:19 INFO [databricks.labs.blueprint.parallel] ensure clusters running 3/3, rps: 76.480/sec 05:19 INFO [databricks.labs.blueprint.parallel] Finished 'ensure clusters running' tasks: 0% results available (0/3). Took 0:00:00.039452 05:19 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:19 INFO [databricks.labs.pytester.fixtures.baseline] Created ucx_W5b90vuYk0TZwucW catalog: https://DATABRICKS_HOST/#explore/data/ucx_W5b90vuYk0TZwucW 05:19 INFO [databricks.labs.ucx.source_code.jobs] Discovering AjL5 entrypoint: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-GbRG-ra78a552ff/notebook.py 05:19 INFO [databricks.labs.ucx.source_code.jobs] Linting AjL5 dependency: Dependency 05:19 INFO [databricks.sdk] Using Databricks Metadata Service authentication 05:19 INFO [databricks.sdk] Using Databricks Metadata Service authentication 05:19 INFO [databricks.labs.pytester.fixtures.notebooks] Created folder: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-GbRG-ra78a552ff 05:19 INFO [databricks.labs.pytester.fixtures.notebooks] Created notebook: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-GbRG-ra78a552ff/notebook.py 05:19 INFO [databricks.labs.pytester.fixtures.baseline] Created dummy-Dr3H: https://DATABRICKS_HOST/compute/clusters/1006-051919-63ga8v9x 05:19 INFO [databricks.labs.pytester.fixtures.notebooks] Created notebook: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-hXwM-ra78a552ff 05:19 INFO [databricks.labs.pytester.fixtures.baseline] Created dummy-G2Ec: https://DATABRICKS_HOST/job/959230418810257 05:19 INFO [databricks.labs.pytester.fixtures.baseline] Created hive_metastore.dummy_szibx schema: https://DATABRICKS_HOST/#explore/data/hive_metastore/dummy_szibx 05:19 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.y9iO/config.yml) doesn't exist. 05:19 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Inventory Database stored in hive_metastore 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Catalog to store UCX artifacts in 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Log level 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Number of threads 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Backup prefix 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Choose how to map the workspace groups: [0] Match by Name [1] Apply a Prefix [2] Apply a Suffix [3] Match by External ID [4] Regex Substitution [5] Regex Matching Enter a number between 0 and 5 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Enter a prefix to add to the workspace group name 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Comma-separated list of workspace group names to migrate. If not specified, we'll use all account-level groups with matching names to workspace-level groups 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Comma-separated list of databases to migrate. If not specified, we'll use all databases in hive_metastore 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Does given workspace 414838440637730 block Internet access? 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to trigger assessment job after installation? 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Reconciliation threshold, in percentage 05:19 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: No HMS lineage collection init script exists, do you want to create one? 05:19 INFO [databricks.labs.ucx.install] Fetching installations... 05:19 INFO [databricks.labs.blueprint.parallel] finding y9iO installations 100/101, rps: 239.038/sec 05:19 INFO [databricks.labs.blueprint.parallel] finding y9iO installations 101/101, rps: 240.660/sec 05:19 INFO [databricks.labs.blueprint.parallel] Finished 'finding y9iO installations' tasks: 0% results available (0/101). Took 0:00:00.420353 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Select PRO or SERVERLESS SQL warehouse to run assessment dashboards on [0] [Create new PRO SQL warehouse] [1] DEFAULT Test Warehouse (DATABRICKS_WAREHOUSE_ID, SERVERLESS, RUNNING) Enter a number between 0 and 1 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Instance pool id to be set in cluster policy for all workflow clusters 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: We have identified one or more cluster policies set up for an external metastore. Would you like to set UCX to connect to the external metastore? 05:19 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Parallelism for migrating dbfs root delta tables with deep clone 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Min workers for auto-scale job cluster for table migration 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Max workers for auto-scale job cluster for table migration 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Open config file in the browser and continue installing? https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.y9iO/config.yml 05:19 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:19 INFO [databricks.labs.blueprint.parallel] ensure clusters running 3/3, rps: 76.480/sec 05:19 INFO [databricks.labs.blueprint.parallel] Finished 'ensure clusters running' tasks: 0% results available (0/3). Took 0:00:00.039452 05:19 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:19 INFO [databricks.labs.pytester.fixtures.baseline] Created ucx_W5b90vuYk0TZwucW catalog: https://DATABRICKS_HOST/#explore/data/ucx_W5b90vuYk0TZwucW 05:19 INFO [databricks.labs.ucx.source_code.jobs] Discovering AjL5 entrypoint: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-GbRG-ra78a552ff/notebook.py 05:19 INFO [databricks.labs.ucx.source_code.jobs] Linting AjL5 dependency: Dependency 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to uninstall ucx from the workspace too, this would remove ucx project folder, dashboards, queries and jobs 05:19 INFO [databricks.labs.ucx.install] Deleting UCX v0.39.1+None20241006051927 from https://DATABRICKS_HOST 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to delete the inventory database dummy_szibx too? 05:19 INFO [databricks.labs.ucx.install] Deleting inventory database dummy_szibx 05:19 INFO [databricks.labs.lsql.deployment] Deleting hive_metastore.dummy_szibx database 05:19 INFO [databricks.labs.ucx.install] Deleting cluster policy 05:19 INFO [databricks.labs.ucx.install] Deleting secret scope 05:19 INFO [databricks.labs.ucx.install] UnInstalling UCX complete [gw9] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python ```

Running from nightly #219