❌ test_job_spark_python_task_linter_unhappy_path: assert 0 == 1 (9.81s)
```
assert 0 == 1
+ where 0 = len([])
05:18 INFO [databricks.sdk] Using Databricks Metadata Service authentication
05:18 INFO [databricks.sdk] Using Databricks Metadata Service authentication
[gw7] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python
05:18 INFO [databricks.sdk] Using Databricks Metadata Service authentication
05:18 INFO [databricks.sdk] Using Databricks Metadata Service authentication
05:18 INFO [databricks.labs.pytester.fixtures.notebooks] Created folder: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-03LV-ra78a5529b
05:18 INFO [databricks.labs.pytester.fixtures.notebooks] Created notebook: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-03LV-ra78a5529b/notebook.py
05:18 INFO [databricks.labs.pytester.fixtures.baseline] Created dummy-1AOJ: https://DATABRICKS_HOST/compute/clusters/1005-051858-v9rm75j2
05:18 INFO [databricks.labs.pytester.fixtures.notebooks] Created notebook: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-79mv-ra78a5529b
05:18 INFO [databricks.labs.pytester.fixtures.baseline] Created dummy-oUPI: https://DATABRICKS_HOST/job/604357884143965
05:18 INFO [databricks.labs.pytester.fixtures.baseline] Created hive_metastore.dummy_sesav schema: https://DATABRICKS_HOST/#explore/data/hive_metastore/dummy_sesav
05:19 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.kJpp/config.yml) doesn't exist.
05:19 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Inventory Database stored in hive_metastore
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Catalog to store UCX artifacts in
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Log level
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Number of threads
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Backup prefix
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: [1mChoose how to map the workspace groups:[0m
[1m[0][0m [36mMatch by Name[0m
[1m[1][0m [36mApply a Prefix[0m
[1m[2][0m [36mApply a Suffix[0m
[1m[3][0m [36mMatch by External ID[0m
[1m[4][0m [36mRegex Substitution[0m
[1m[5][0m [36mRegex Matching[0m
Enter a number between 0 and 5
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Enter a prefix to add to the workspace group name
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Comma-separated list of workspace group names to migrate. If not specified, we'll use all account-level groups with matching names to workspace-level groups
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Comma-separated list of databases to migrate. If not specified, we'll use all databases in hive_metastore
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Does given workspace 414838440637730 block Internet access?
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to trigger assessment job after installation?
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Reconciliation threshold, in percentage
05:19 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: No HMS lineage collection init script exists, do you want to create one?
05:19 INFO [databricks.labs.ucx.install] Fetching installations...
05:19 INFO [databricks.labs.blueprint.parallel] finding kJpp installations 100/101, rps: 223.957/sec
05:19 INFO [databricks.labs.blueprint.parallel] finding kJpp installations 101/101, rps: 223.217/sec
05:19 INFO [databricks.labs.blueprint.parallel] Finished 'finding kJpp installations' tasks: 0% results available (0/101). Took 0:00:00.453089
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: [1mSelect PRO or SERVERLESS SQL warehouse to run assessment dashboards on[0m
[1m[0][0m [36m[Create new PRO SQL warehouse][0m
[1m[1][0m [36mDEFAULT Test Warehouse (TEST_DEFAULT_WAREHOUSE_ID, SERVERLESS, RUNNING)[0m
Enter a number between 0 and 1
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Instance pool id to be set in cluster policy for all workflow clusters
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: We have identified one or more cluster policies set up for an external metastore. Would you like to set UCX to connect to the external metastore?
05:19 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Parallelism for migrating dbfs root delta tables with deep clone
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Min workers for auto-scale job cluster for table migration
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Max workers for auto-scale job cluster for table migration
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Open config file in the browser and continue installing? https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.kJpp/config.yml
05:19 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:19 INFO [databricks.labs.blueprint.parallel] ensure clusters running 3/3, rps: 60.775/sec
05:19 INFO [databricks.labs.blueprint.parallel] Finished 'ensure clusters running' tasks: 0% results available (0/3). Took 0:00:00.049610
05:19 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:19 INFO [databricks.labs.pytester.fixtures.baseline] Created ucx_zsb6inSw41lr8TlF catalog: https://DATABRICKS_HOST/#explore/data/ucx_zsb6inSw41lr8TlF
05:19 INFO [databricks.labs.ucx.source_code.jobs] Discovering qMUm entrypoint: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-03LV-ra78a5529b/notebook.py
05:19 INFO [databricks.labs.ucx.source_code.jobs] Linting qMUm dependency: Dependency
05:18 INFO [databricks.sdk] Using Databricks Metadata Service authentication
05:18 INFO [databricks.sdk] Using Databricks Metadata Service authentication
05:18 INFO [databricks.labs.pytester.fixtures.notebooks] Created folder: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-03LV-ra78a5529b
05:18 INFO [databricks.labs.pytester.fixtures.notebooks] Created notebook: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-03LV-ra78a5529b/notebook.py
05:18 INFO [databricks.labs.pytester.fixtures.baseline] Created dummy-1AOJ: https://DATABRICKS_HOST/compute/clusters/1005-051858-v9rm75j2
05:18 INFO [databricks.labs.pytester.fixtures.notebooks] Created notebook: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-79mv-ra78a5529b
05:18 INFO [databricks.labs.pytester.fixtures.baseline] Created dummy-oUPI: https://DATABRICKS_HOST/job/604357884143965
05:18 INFO [databricks.labs.pytester.fixtures.baseline] Created hive_metastore.dummy_sesav schema: https://DATABRICKS_HOST/#explore/data/hive_metastore/dummy_sesav
05:19 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.kJpp/config.yml) doesn't exist.
05:19 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Inventory Database stored in hive_metastore
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Catalog to store UCX artifacts in
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Log level
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Number of threads
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Backup prefix
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: [1mChoose how to map the workspace groups:[0m
[1m[0][0m [36mMatch by Name[0m
[1m[1][0m [36mApply a Prefix[0m
[1m[2][0m [36mApply a Suffix[0m
[1m[3][0m [36mMatch by External ID[0m
[1m[4][0m [36mRegex Substitution[0m
[1m[5][0m [36mRegex Matching[0m
Enter a number between 0 and 5
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Enter a prefix to add to the workspace group name
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Comma-separated list of workspace group names to migrate. If not specified, we'll use all account-level groups with matching names to workspace-level groups
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Comma-separated list of databases to migrate. If not specified, we'll use all databases in hive_metastore
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Does given workspace 414838440637730 block Internet access?
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to trigger assessment job after installation?
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Reconciliation threshold, in percentage
05:19 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: No HMS lineage collection init script exists, do you want to create one?
05:19 INFO [databricks.labs.ucx.install] Fetching installations...
05:19 INFO [databricks.labs.blueprint.parallel] finding kJpp installations 100/101, rps: 223.957/sec
05:19 INFO [databricks.labs.blueprint.parallel] finding kJpp installations 101/101, rps: 223.217/sec
05:19 INFO [databricks.labs.blueprint.parallel] Finished 'finding kJpp installations' tasks: 0% results available (0/101). Took 0:00:00.453089
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: [1mSelect PRO or SERVERLESS SQL warehouse to run assessment dashboards on[0m
[1m[0][0m [36m[Create new PRO SQL warehouse][0m
[1m[1][0m [36mDEFAULT Test Warehouse (TEST_DEFAULT_WAREHOUSE_ID, SERVERLESS, RUNNING)[0m
Enter a number between 0 and 1
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Instance pool id to be set in cluster policy for all workflow clusters
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: We have identified one or more cluster policies set up for an external metastore. Would you like to set UCX to connect to the external metastore?
05:19 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Parallelism for migrating dbfs root delta tables with deep clone
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Min workers for auto-scale job cluster for table migration
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Max workers for auto-scale job cluster for table migration
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Open config file in the browser and continue installing? https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.kJpp/config.yml
05:19 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:19 INFO [databricks.labs.blueprint.parallel] ensure clusters running 3/3, rps: 60.775/sec
05:19 INFO [databricks.labs.blueprint.parallel] Finished 'ensure clusters running' tasks: 0% results available (0/3). Took 0:00:00.049610
05:19 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:19 INFO [databricks.labs.pytester.fixtures.baseline] Created ucx_zsb6inSw41lr8TlF catalog: https://DATABRICKS_HOST/#explore/data/ucx_zsb6inSw41lr8TlF
05:19 INFO [databricks.labs.ucx.source_code.jobs] Discovering qMUm entrypoint: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-03LV-ra78a5529b/notebook.py
05:19 INFO [databricks.labs.ucx.source_code.jobs] Linting qMUm dependency: Dependency
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to uninstall ucx from the workspace too, this would remove ucx project folder, dashboards, queries and jobs
05:19 INFO [databricks.labs.ucx.install] Deleting UCX v0.39.1+None20241005051905 from https://DATABRICKS_HOST
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to delete the inventory database dummy_sesav too?
05:19 INFO [databricks.labs.ucx.install] Deleting inventory database dummy_sesav
05:19 INFO [databricks.labs.lsql.deployment] Deleting hive_metastore.dummy_sesav database
05:19 INFO [databricks.labs.ucx.install] Deleting cluster policy
05:19 INFO [databricks.labs.ucx.install] Deleting secret scope
05:19 INFO [databricks.labs.ucx.install] UnInstalling UCX complete
[gw7] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python
```
❌ test_job_spark_python_task_linter_unhappy_path: assert 0 == 1 (10.091s)
```
assert 0 == 1
+ where 0 = len([])
05:19 INFO [databricks.sdk] Using Databricks Metadata Service authentication
05:19 INFO [databricks.sdk] Using Databricks Metadata Service authentication
[gw9] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python
05:19 INFO [databricks.sdk] Using Databricks Metadata Service authentication
05:19 INFO [databricks.sdk] Using Databricks Metadata Service authentication
05:19 INFO [databricks.labs.pytester.fixtures.notebooks] Created folder: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-GbRG-ra78a552ff
05:19 INFO [databricks.labs.pytester.fixtures.notebooks] Created notebook: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-GbRG-ra78a552ff/notebook.py
05:19 INFO [databricks.labs.pytester.fixtures.baseline] Created dummy-Dr3H: https://DATABRICKS_HOST/compute/clusters/1006-051919-63ga8v9x
05:19 INFO [databricks.labs.pytester.fixtures.notebooks] Created notebook: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-hXwM-ra78a552ff
05:19 INFO [databricks.labs.pytester.fixtures.baseline] Created dummy-G2Ec: https://DATABRICKS_HOST/job/959230418810257
05:19 INFO [databricks.labs.pytester.fixtures.baseline] Created hive_metastore.dummy_szibx schema: https://DATABRICKS_HOST/#explore/data/hive_metastore/dummy_szibx
05:19 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.y9iO/config.yml) doesn't exist.
05:19 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Inventory Database stored in hive_metastore
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Catalog to store UCX artifacts in
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Log level
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Number of threads
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Backup prefix
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: [1mChoose how to map the workspace groups:[0m
[1m[0][0m [36mMatch by Name[0m
[1m[1][0m [36mApply a Prefix[0m
[1m[2][0m [36mApply a Suffix[0m
[1m[3][0m [36mMatch by External ID[0m
[1m[4][0m [36mRegex Substitution[0m
[1m[5][0m [36mRegex Matching[0m
Enter a number between 0 and 5
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Enter a prefix to add to the workspace group name
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Comma-separated list of workspace group names to migrate. If not specified, we'll use all account-level groups with matching names to workspace-level groups
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Comma-separated list of databases to migrate. If not specified, we'll use all databases in hive_metastore
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Does given workspace 414838440637730 block Internet access?
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to trigger assessment job after installation?
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Reconciliation threshold, in percentage
05:19 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: No HMS lineage collection init script exists, do you want to create one?
05:19 INFO [databricks.labs.ucx.install] Fetching installations...
05:19 INFO [databricks.labs.blueprint.parallel] finding y9iO installations 100/101, rps: 239.038/sec
05:19 INFO [databricks.labs.blueprint.parallel] finding y9iO installations 101/101, rps: 240.660/sec
05:19 INFO [databricks.labs.blueprint.parallel] Finished 'finding y9iO installations' tasks: 0% results available (0/101). Took 0:00:00.420353
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: [1mSelect PRO or SERVERLESS SQL warehouse to run assessment dashboards on[0m
[1m[0][0m [36m[Create new PRO SQL warehouse][0m
[1m[1][0m [36mDEFAULT Test Warehouse (DATABRICKS_WAREHOUSE_ID, SERVERLESS, RUNNING)[0m
Enter a number between 0 and 1
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Instance pool id to be set in cluster policy for all workflow clusters
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: We have identified one or more cluster policies set up for an external metastore. Would you like to set UCX to connect to the external metastore?
05:19 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Parallelism for migrating dbfs root delta tables with deep clone
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Min workers for auto-scale job cluster for table migration
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Max workers for auto-scale job cluster for table migration
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Open config file in the browser and continue installing? https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.y9iO/config.yml
05:19 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:19 INFO [databricks.labs.blueprint.parallel] ensure clusters running 3/3, rps: 76.480/sec
05:19 INFO [databricks.labs.blueprint.parallel] Finished 'ensure clusters running' tasks: 0% results available (0/3). Took 0:00:00.039452
05:19 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:19 INFO [databricks.labs.pytester.fixtures.baseline] Created ucx_W5b90vuYk0TZwucW catalog: https://DATABRICKS_HOST/#explore/data/ucx_W5b90vuYk0TZwucW
05:19 INFO [databricks.labs.ucx.source_code.jobs] Discovering AjL5 entrypoint: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-GbRG-ra78a552ff/notebook.py
05:19 INFO [databricks.labs.ucx.source_code.jobs] Linting AjL5 dependency: Dependency
05:19 INFO [databricks.sdk] Using Databricks Metadata Service authentication
05:19 INFO [databricks.sdk] Using Databricks Metadata Service authentication
05:19 INFO [databricks.labs.pytester.fixtures.notebooks] Created folder: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-GbRG-ra78a552ff
05:19 INFO [databricks.labs.pytester.fixtures.notebooks] Created notebook: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-GbRG-ra78a552ff/notebook.py
05:19 INFO [databricks.labs.pytester.fixtures.baseline] Created dummy-Dr3H: https://DATABRICKS_HOST/compute/clusters/1006-051919-63ga8v9x
05:19 INFO [databricks.labs.pytester.fixtures.notebooks] Created notebook: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-hXwM-ra78a552ff
05:19 INFO [databricks.labs.pytester.fixtures.baseline] Created dummy-G2Ec: https://DATABRICKS_HOST/job/959230418810257
05:19 INFO [databricks.labs.pytester.fixtures.baseline] Created hive_metastore.dummy_szibx schema: https://DATABRICKS_HOST/#explore/data/hive_metastore/dummy_szibx
05:19 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.y9iO/config.yml) doesn't exist.
05:19 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Inventory Database stored in hive_metastore
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Catalog to store UCX artifacts in
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Log level
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Number of threads
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Backup prefix
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: [1mChoose how to map the workspace groups:[0m
[1m[0][0m [36mMatch by Name[0m
[1m[1][0m [36mApply a Prefix[0m
[1m[2][0m [36mApply a Suffix[0m
[1m[3][0m [36mMatch by External ID[0m
[1m[4][0m [36mRegex Substitution[0m
[1m[5][0m [36mRegex Matching[0m
Enter a number between 0 and 5
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Enter a prefix to add to the workspace group name
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Comma-separated list of workspace group names to migrate. If not specified, we'll use all account-level groups with matching names to workspace-level groups
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Comma-separated list of databases to migrate. If not specified, we'll use all databases in hive_metastore
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Does given workspace 414838440637730 block Internet access?
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to trigger assessment job after installation?
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Reconciliation threshold, in percentage
05:19 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data.
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: No HMS lineage collection init script exists, do you want to create one?
05:19 INFO [databricks.labs.ucx.install] Fetching installations...
05:19 INFO [databricks.labs.blueprint.parallel] finding y9iO installations 100/101, rps: 239.038/sec
05:19 INFO [databricks.labs.blueprint.parallel] finding y9iO installations 101/101, rps: 240.660/sec
05:19 INFO [databricks.labs.blueprint.parallel] Finished 'finding y9iO installations' tasks: 0% results available (0/101). Took 0:00:00.420353
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: [1mSelect PRO or SERVERLESS SQL warehouse to run assessment dashboards on[0m
[1m[0][0m [36m[Create new PRO SQL warehouse][0m
[1m[1][0m [36mDEFAULT Test Warehouse (DATABRICKS_WAREHOUSE_ID, SERVERLESS, RUNNING)[0m
Enter a number between 0 and 1
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Instance pool id to be set in cluster policy for all workflow clusters
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: We have identified one or more cluster policies set up for an external metastore. Would you like to set UCX to connect to the external metastore?
05:19 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy.
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Parallelism for migrating dbfs root delta tables with deep clone
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Min workers for auto-scale job cluster for table migration
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Max workers for auto-scale job cluster for table migration
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Open config file in the browser and continue installing? https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.y9iO/config.yml
05:19 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:19 INFO [databricks.labs.blueprint.parallel] ensure clusters running 3/3, rps: 76.480/sec
05:19 INFO [databricks.labs.blueprint.parallel] Finished 'ensure clusters running' tasks: 0% results available (0/3). Took 0:00:00.039452
05:19 DEBUG [tests.integration.conftest] Waiting for clusters to start...
05:19 INFO [databricks.labs.pytester.fixtures.baseline] Created ucx_W5b90vuYk0TZwucW catalog: https://DATABRICKS_HOST/#explore/data/ucx_W5b90vuYk0TZwucW
05:19 INFO [databricks.labs.ucx.source_code.jobs] Discovering AjL5 entrypoint: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-GbRG-ra78a552ff/notebook.py
05:19 INFO [databricks.labs.ucx.source_code.jobs] Linting AjL5 dependency: Dependency
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to uninstall ucx from the workspace too, this would remove ucx project folder, dashboards, queries and jobs
05:19 INFO [databricks.labs.ucx.install] Deleting UCX v0.39.1+None20241006051927 from https://DATABRICKS_HOST
05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to delete the inventory database dummy_szibx too?
05:19 INFO [databricks.labs.ucx.install] Deleting inventory database dummy_szibx
05:19 INFO [databricks.labs.lsql.deployment] Deleting hive_metastore.dummy_szibx database
05:19 INFO [databricks.labs.ucx.install] Deleting cluster policy
05:19 INFO [databricks.labs.ucx.install] Deleting secret scope
05:19 INFO [databricks.labs.ucx.install] UnInstalling UCX complete
[gw9] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python
```
❌ test_job_spark_python_task_linter_unhappy_path: assert 0 == 1 (9.81s)
``` assert 0 == 1 + where 0 = len([]) 05:18 INFO [databricks.sdk] Using Databricks Metadata Service authentication 05:18 INFO [databricks.sdk] Using Databricks Metadata Service authentication [gw7] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python 05:18 INFO [databricks.sdk] Using Databricks Metadata Service authentication 05:18 INFO [databricks.sdk] Using Databricks Metadata Service authentication 05:18 INFO [databricks.labs.pytester.fixtures.notebooks] Created folder: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-03LV-ra78a5529b 05:18 INFO [databricks.labs.pytester.fixtures.notebooks] Created notebook: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-03LV-ra78a5529b/notebook.py 05:18 INFO [databricks.labs.pytester.fixtures.baseline] Created dummy-1AOJ: https://DATABRICKS_HOST/compute/clusters/1005-051858-v9rm75j2 05:18 INFO [databricks.labs.pytester.fixtures.notebooks] Created notebook: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-79mv-ra78a5529b 05:18 INFO [databricks.labs.pytester.fixtures.baseline] Created dummy-oUPI: https://DATABRICKS_HOST/job/604357884143965 05:18 INFO [databricks.labs.pytester.fixtures.baseline] Created hive_metastore.dummy_sesav schema: https://DATABRICKS_HOST/#explore/data/hive_metastore/dummy_sesav 05:19 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.kJpp/config.yml) doesn't exist. 05:19 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Inventory Database stored in hive_metastore 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Catalog to store UCX artifacts in 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Log level 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Number of threads 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Backup prefix 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: [1mChoose how to map the workspace groups:[0m [1m[0][0m [36mMatch by Name[0m [1m[1][0m [36mApply a Prefix[0m [1m[2][0m [36mApply a Suffix[0m [1m[3][0m [36mMatch by External ID[0m [1m[4][0m [36mRegex Substitution[0m [1m[5][0m [36mRegex Matching[0m Enter a number between 0 and 5 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Enter a prefix to add to the workspace group name 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Comma-separated list of workspace group names to migrate. If not specified, we'll use all account-level groups with matching names to workspace-level groups 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Comma-separated list of databases to migrate. If not specified, we'll use all databases in hive_metastore 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Does given workspace 414838440637730 block Internet access? 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to trigger assessment job after installation? 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Reconciliation threshold, in percentage 05:19 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: No HMS lineage collection init script exists, do you want to create one? 05:19 INFO [databricks.labs.ucx.install] Fetching installations... 05:19 INFO [databricks.labs.blueprint.parallel] finding kJpp installations 100/101, rps: 223.957/sec 05:19 INFO [databricks.labs.blueprint.parallel] finding kJpp installations 101/101, rps: 223.217/sec 05:19 INFO [databricks.labs.blueprint.parallel] Finished 'finding kJpp installations' tasks: 0% results available (0/101). Took 0:00:00.453089 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: [1mSelect PRO or SERVERLESS SQL warehouse to run assessment dashboards on[0m [1m[0][0m [36m[Create new PRO SQL warehouse][0m [1m[1][0m [36mDEFAULT Test Warehouse (TEST_DEFAULT_WAREHOUSE_ID, SERVERLESS, RUNNING)[0m Enter a number between 0 and 1 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Instance pool id to be set in cluster policy for all workflow clusters 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: We have identified one or more cluster policies set up for an external metastore. Would you like to set UCX to connect to the external metastore? 05:19 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Parallelism for migrating dbfs root delta tables with deep clone 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Min workers for auto-scale job cluster for table migration 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Max workers for auto-scale job cluster for table migration 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Open config file in the browser and continue installing? https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.kJpp/config.yml 05:19 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:19 INFO [databricks.labs.blueprint.parallel] ensure clusters running 3/3, rps: 60.775/sec 05:19 INFO [databricks.labs.blueprint.parallel] Finished 'ensure clusters running' tasks: 0% results available (0/3). Took 0:00:00.049610 05:19 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:19 INFO [databricks.labs.pytester.fixtures.baseline] Created ucx_zsb6inSw41lr8TlF catalog: https://DATABRICKS_HOST/#explore/data/ucx_zsb6inSw41lr8TlF 05:19 INFO [databricks.labs.ucx.source_code.jobs] Discovering qMUm entrypoint: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-03LV-ra78a5529b/notebook.py 05:19 INFO [databricks.labs.ucx.source_code.jobs] Linting qMUm dependency: Dependency 05:18 INFO [databricks.sdk] Using Databricks Metadata Service authentication 05:18 INFO [databricks.sdk] Using Databricks Metadata Service authentication 05:18 INFO [databricks.labs.pytester.fixtures.notebooks] Created folder: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-03LV-ra78a5529b 05:18 INFO [databricks.labs.pytester.fixtures.notebooks] Created notebook: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-03LV-ra78a5529b/notebook.py 05:18 INFO [databricks.labs.pytester.fixtures.baseline] Created dummy-1AOJ: https://DATABRICKS_HOST/compute/clusters/1005-051858-v9rm75j2 05:18 INFO [databricks.labs.pytester.fixtures.notebooks] Created notebook: https://DATABRICKS_HOST#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-79mv-ra78a5529b 05:18 INFO [databricks.labs.pytester.fixtures.baseline] Created dummy-oUPI: https://DATABRICKS_HOST/job/604357884143965 05:18 INFO [databricks.labs.pytester.fixtures.baseline] Created hive_metastore.dummy_sesav schema: https://DATABRICKS_HOST/#explore/data/hive_metastore/dummy_sesav 05:19 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.kJpp/config.yml) doesn't exist. 05:19 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Inventory Database stored in hive_metastore 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Catalog to store UCX artifacts in 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Log level 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Number of threads 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Backup prefix 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: [1mChoose how to map the workspace groups:[0m [1m[0][0m [36mMatch by Name[0m [1m[1][0m [36mApply a Prefix[0m [1m[2][0m [36mApply a Suffix[0m [1m[3][0m [36mMatch by External ID[0m [1m[4][0m [36mRegex Substitution[0m [1m[5][0m [36mRegex Matching[0m Enter a number between 0 and 5 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Enter a prefix to add to the workspace group name 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Comma-separated list of workspace group names to migrate. If not specified, we'll use all account-level groups with matching names to workspace-level groups 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Comma-separated list of databases to migrate. If not specified, we'll use all databases in hive_metastore 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Does given workspace 414838440637730 block Internet access? 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to trigger assessment job after installation? 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Reconciliation threshold, in percentage 05:19 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: No HMS lineage collection init script exists, do you want to create one? 05:19 INFO [databricks.labs.ucx.install] Fetching installations... 05:19 INFO [databricks.labs.blueprint.parallel] finding kJpp installations 100/101, rps: 223.957/sec 05:19 INFO [databricks.labs.blueprint.parallel] finding kJpp installations 101/101, rps: 223.217/sec 05:19 INFO [databricks.labs.blueprint.parallel] Finished 'finding kJpp installations' tasks: 0% results available (0/101). Took 0:00:00.453089 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: [1mSelect PRO or SERVERLESS SQL warehouse to run assessment dashboards on[0m [1m[0][0m [36m[Create new PRO SQL warehouse][0m [1m[1][0m [36mDEFAULT Test Warehouse (TEST_DEFAULT_WAREHOUSE_ID, SERVERLESS, RUNNING)[0m Enter a number between 0 and 1 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Instance pool id to be set in cluster policy for all workflow clusters 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: We have identified one or more cluster policies set up for an external metastore. Would you like to set UCX to connect to the external metastore? 05:19 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Parallelism for migrating dbfs root delta tables with deep clone 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Min workers for auto-scale job cluster for table migration 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Max workers for auto-scale job cluster for table migration 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Open config file in the browser and continue installing? https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.kJpp/config.yml 05:19 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:19 INFO [databricks.labs.blueprint.parallel] ensure clusters running 3/3, rps: 60.775/sec 05:19 INFO [databricks.labs.blueprint.parallel] Finished 'ensure clusters running' tasks: 0% results available (0/3). Took 0:00:00.049610 05:19 DEBUG [tests.integration.conftest] Waiting for clusters to start... 05:19 INFO [databricks.labs.pytester.fixtures.baseline] Created ucx_zsb6inSw41lr8TlF catalog: https://DATABRICKS_HOST/#explore/data/ucx_zsb6inSw41lr8TlF 05:19 INFO [databricks.labs.ucx.source_code.jobs] Discovering qMUm entrypoint: /Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/dummy-03LV-ra78a5529b/notebook.py 05:19 INFO [databricks.labs.ucx.source_code.jobs] Linting qMUm dependency: Dependency 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to uninstall ucx from the workspace too, this would remove ucx project folder, dashboards, queries and jobs 05:19 INFO [databricks.labs.ucx.install] Deleting UCX v0.39.1+None20241005051905 from https://DATABRICKS_HOST 05:19 INFO [databricks.labs.blueprint.tui] Asking prompt: Do you want to delete the inventory database dummy_sesav too? 05:19 INFO [databricks.labs.ucx.install] Deleting inventory database dummy_sesav 05:19 INFO [databricks.labs.lsql.deployment] Deleting hive_metastore.dummy_sesav database 05:19 INFO [databricks.labs.ucx.install] Deleting cluster policy 05:19 INFO [databricks.labs.ucx.install] Deleting secret scope 05:19 INFO [databricks.labs.ucx.install] UnInstalling UCX complete [gw7] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python ```Running from nightly #218