Test failure: `test_running_real_validate_groups_permissions_job`

❌ test_running_real_validate_groups_permissions_job: AttributeError: 'WorkflowsDeployment' object has no attribute 'run_workflow' (1m32.178s)

``` AttributeError: 'WorkflowsDeployment' object has no attribute 'run_workflow' [gw1] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python 07:13 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group sdk-LIhN: https://DATABRICKS_HOST#setting/accounts/groups/416372241323208 07:13 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='sdk-LIhN', entitlements=[], external_id=None, groups=[], id='416372241323208', members=[], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 07:13 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sqf64: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sqf64 07:13 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sqf64', metastore_id=None, name='ucx_sqf64', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:13 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_sqf64.ucx_t8asc: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sqf64/ucx_t8asc 07:13 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sqf64.ucx_t8asc', metastore_id=None, name='ucx_t8asc', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_sqf64', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_sqf64/ucx_t8asc', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:13 INFO [databricks.labs.ucx.mixins.fixtures] Query Created ucx_query_QtkNM: https://DATABRICKS_HOST/sql/editor/8fd5438f-885d-4891-9a51-b0f83f280edf 07:13 DEBUG [databricks.labs.ucx.mixins.fixtures] added query fixture: Query(can_edit=None, created_at='2024-04-04T07:13:13Z', data_source_id=None, description='TEST QUERY FOR UCX', id='8fd5438f-885d-4891-9a51-b0f83f280edf', is_archived=False, is_draft=False, is_favorite=False, is_safe=True, last_modified_by=User(email='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', id=481119220561874, name='labs-account-admin-identity'), last_modified_by_id=None, latest_query_data_id=None, name='ucx_query_QtkNM', options=QueryOptions(moved_to_trash_at=None, parameters=[]), parent='folders/2080761702917835', permission_tier=None, query='SELECT * FROM ucx_sqf64.ucx_t8asc', query_hash=None, run_as_role=, tags=[], updated_at='2024-04-04T07:13:13Z', user=User(email='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', id=481119220561874, name='labs-account-admin-identity'), user_id=481119220561874, visualizations=[Visualization(created_at='2024-04-04T07:13:13Z', description='', id='cc56713a-5b7d-4636-9cc8-288b4fbcd564', name='Results', options={'version': 2}, type='TABLE', updated_at='2024-04-04T07:13:13Z')]) 07:13 DEBUG [databricks.labs.ucx.mixins.fixtures] added query permissions fixture: 8fd5438f-885d-4891-9a51-b0f83f280edf [user_name 0a330eb5-dd51-4d97-b6e4-c474356b1d5d CAN_MANAGE, group_name admins CAN_MANAGE] -> [group_name sdk-LIhN CAN_EDIT] 07:13 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.ArFN/config.yml) doesn't exist. 07:13 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 07:13 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 07:13 INFO [databricks.labs.ucx.install] Fetching installations... 07:13 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 07:13 INFO [databricks.labs.ucx.install] Installing UCX v0.21.1+2720240404071318 07:13 INFO [databricks.labs.ucx.install] Creating dashboards... 07:13 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 07:13 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [ARFN] UCX Assessment (Estimates)... 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 01_0_group_migration.md because it's a text widget 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 01_0_group_migration.md because it's a text widget 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 00_0_metastore_assignment.md because it's a text widget 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 00_0_metastore_assignment.md because it's a text widget 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 02_0_data_modeling.md because it's a text widget 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 02_0_data_modeling.md because it's a text widget 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 03_0_data_migration.md because it's a text widget 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 03_0_data_migration.md because it's a text widget 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 07:13 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [ARFN] UCX Assessment (Main)... 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 10___data_summary.md because it's a text widget 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 10___data_summary.md because it's a text widget 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 15___storage_summary.md because it's a text widget 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 15___storage_summary.md because it's a text widget 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 40___last_summary.md because it's a text widget 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 40___last_summary.md because it's a text widget 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 20___compute_summary.md because it's a text widget 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 20___compute_summary.md because it's a text widget 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 00___assessment_overview.md because it's a text widget 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 00___assessment_overview.md because it's a text widget 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 05___findings_summary.md because it's a text widget 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 05___findings_summary.md because it's a text widget 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 30_0_job_summary.md because it's a text widget 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 30_0_job_summary.md because it's a text widget 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 07:13 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [ARFN] UCX Assessment (Azure)... 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 07:13 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [ARFN] UCX Assessment (Interactive)... 07:14 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 00_0_interactive.md because it's a text widget 07:14 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 00_0_interactive.md because it's a text widget 07:14 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 02_0_cluster_summary.md because it's a text widget 07:14 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 02_0_cluster_summary.md because it's a text widget 07:14 DEBUG [databricks.labs.ucx.installer.workflows] Creating jobs from tasks in main 07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 07:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 07:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=099-destroy-schema 07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 07:14 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.ArFN/README for the next steps. 07:14 DEBUG [databricks.labs.ucx.workspace_access.manager] Crawling permissions 07:14 INFO [databricks.labs.ucx.workspace_access.manager] Starting to crawl permissions. Total tasks: 1003 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES deb7e6d4-9fee-4406-8353-81175f40fc22 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 5a7a9dbb-7ecc-44dd-899a-6c607e42a701 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES fec3caf7-9422-4478-9c73-73cdb89c7254 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 5e9cc236-94be-46f9-b024-f23c6808baac 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 032e9c49-7d7f-439b-89d9-a6e4414c5b12 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 9170e676-a4fc-4054-b1e8-12c8d76900ae 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES d511ab71-7afb-4b97-9559-273e9d7b431c 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 73341447-9631-4988-9528-57faf2e7f163 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES ac1b6f9b-0874-4108-8387-6ba69d3ff22f 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 8bfa3072-c5c7-4467-b0cf-a2091db4cd7c 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 87eaed0f-51cd-4797-9934-25e3bc331e38 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 0042ed56-2066-428d-ae79-cd421da55683 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES dade8f79-d936-471f-93f1-10f90290fb3e 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 42930939-4653-48d2-8032-9125d27839ae 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES d642a3c8-99cc-448e-9aa6-aec8d0500b43 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES c0a65e16-a058-455d-9bc3-d76b0c38cec3 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES f2c415e2-5b69-49bd-b815-d7e9028ba6b9 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES bc583f7d-b8ad-4d5b-9a5a-95bd6c7487fa 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES ab2bb26b-53a6-4ec9-9469-1a2302cc076c 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES b78cfab1-c5af-49f0-a584-39df74a756f7 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES eea197ea-659e-4432-8854-f268b212a445 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 1a854f7a-6949-407e-8d24-6cee3f17b198 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 65beece7-5275-4e51-a00b-01e6e4ed38a3 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES c99f1780-6559-4e6d-9c44-1e95f888d72c 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 1e126be1-f265-4ad9-8fcf-c867710916a1 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 34631189-4247-4d5b-9636-66388d3df1bb 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 72352c52-0f2f-4ed3-938d-c344db0606bf 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES dc5605f2-bdb4-447e-850e-d11025522a78 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES ca19b20a-7359-4865-9c4a-c050e30fb71b 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES fd818da7-e055-463e-846f-a4b407e64578 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES b5cd5cb5-f0b3-482f-8ecd-7ef586a78750 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES f00ecb39-1b0b-4d5f-8ab0-9bb4de479444 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 4d7e4ece-5e87-411b-8bdf-9c53da6e6840 07:14 INFO [databricks.labs.ucx.workspace_access.manager] Total crawled permissions: 970 07:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_Sucqg.permissions] found 970 new records for permissions 07:14 INFO [databricks.labs.ucx.workspace_access.manager] Successfully saved the items to inventory table 07:14 INFO [databricks.labs.ucx.workspace_access.manager] Saved 970 to hive_metastore.ucx_Sucqg.permissions 07:13 INFO [databricks.labs.ucx.mixins.fixtures] Workspace group sdk-LIhN: https://DATABRICKS_HOST#setting/accounts/groups/416372241323208 07:13 DEBUG [databricks.labs.ucx.mixins.fixtures] added workspace group fixture: Group(display_name='sdk-LIhN', entitlements=[], external_id=None, groups=[], id='416372241323208', members=[], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 07:13 INFO [databricks.labs.ucx.mixins.fixtures] Schema hive_metastore.ucx_sqf64: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sqf64 07:13 DEBUG [databricks.labs.ucx.mixins.fixtures] added schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sqf64', metastore_id=None, name='ucx_sqf64', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:13 INFO [databricks.labs.ucx.mixins.fixtures] Table hive_metastore.ucx_sqf64.ucx_t8asc: https://DATABRICKS_HOST/explore/data/hive_metastore/ucx_sqf64/ucx_t8asc 07:13 DEBUG [databricks.labs.ucx.mixins.fixtures] added table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sqf64.ucx_t8asc', metastore_id=None, name='ucx_t8asc', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_sqf64', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_sqf64/ucx_t8asc', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:13 INFO [databricks.labs.ucx.mixins.fixtures] Query Created ucx_query_QtkNM: https://DATABRICKS_HOST/sql/editor/8fd5438f-885d-4891-9a51-b0f83f280edf 07:13 DEBUG [databricks.labs.ucx.mixins.fixtures] added query fixture: Query(can_edit=None, created_at='2024-04-04T07:13:13Z', data_source_id=None, description='TEST QUERY FOR UCX', id='8fd5438f-885d-4891-9a51-b0f83f280edf', is_archived=False, is_draft=False, is_favorite=False, is_safe=True, last_modified_by=User(email='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', id=481119220561874, name='labs-account-admin-identity'), last_modified_by_id=None, latest_query_data_id=None, name='ucx_query_QtkNM', options=QueryOptions(moved_to_trash_at=None, parameters=[]), parent='folders/2080761702917835', permission_tier=None, query='SELECT * FROM ucx_sqf64.ucx_t8asc', query_hash=None, run_as_role=, tags=[], updated_at='2024-04-04T07:13:13Z', user=User(email='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', id=481119220561874, name='labs-account-admin-identity'), user_id=481119220561874, visualizations=[Visualization(created_at='2024-04-04T07:13:13Z', description='', id='cc56713a-5b7d-4636-9cc8-288b4fbcd564', name='Results', options={'version': 2}, type='TABLE', updated_at='2024-04-04T07:13:13Z')]) 07:13 DEBUG [databricks.labs.ucx.mixins.fixtures] added query permissions fixture: 8fd5438f-885d-4891-9a51-b0f83f280edf [user_name 0a330eb5-dd51-4d97-b6e4-c474356b1d5d CAN_MANAGE, group_name admins CAN_MANAGE] -> [group_name sdk-LIhN CAN_EDIT] 07:13 DEBUG [databricks.labs.ucx.install] Cannot find previous installation: Path (/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.ArFN/config.yml) doesn't exist. 07:13 INFO [databricks.labs.ucx.install] Please answer a couple of questions to configure Unity Catalog migration 07:13 INFO [databricks.labs.ucx.installer.hms_lineage] HMS Lineage feature creates one system table named system.hms_to_uc_migration.table_access and helps in your migration process from HMS to UC by allowing you to programmatically query HMS lineage data. 07:13 INFO [databricks.labs.ucx.install] Fetching installations... 07:13 INFO [databricks.labs.ucx.installer.policy] Creating UCX cluster policy. 07:13 INFO [databricks.labs.ucx.install] Installing UCX v0.21.1+2720240404071318 07:13 INFO [databricks.labs.ucx.install] Creating dashboards... 07:13 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/views... 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Reading step folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment... 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/estimates... 07:13 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [ARFN] UCX Assessment (Estimates)... 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 01_0_group_migration.md because it's a text widget 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 01_0_group_migration.md because it's a text widget 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 00_0_metastore_assignment.md because it's a text widget 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 00_0_metastore_assignment.md because it's a text widget 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 02_0_data_modeling.md because it's a text widget 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 02_0_data_modeling.md because it's a text widget 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 03_0_data_migration.md because it's a text widget 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 03_0_data_migration.md because it's a text widget 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/main... 07:13 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [ARFN] UCX Assessment (Main)... 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 10___data_summary.md because it's a text widget 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 10___data_summary.md because it's a text widget 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 15___storage_summary.md because it's a text widget 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 15___storage_summary.md because it's a text widget 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 40___last_summary.md because it's a text widget 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 40___last_summary.md because it's a text widget 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 20___compute_summary.md because it's a text widget 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 20___compute_summary.md because it's a text widget 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 00___assessment_overview.md because it's a text widget 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 00___assessment_overview.md because it's a text widget 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 05___findings_summary.md because it's a text widget 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 05___findings_summary.md because it's a text widget 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 30_0_job_summary.md because it's a text widget 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 30_0_job_summary.md because it's a text widget 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/CLOUD_ENV... 07:13 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [ARFN] UCX Assessment (Azure)... 07:13 DEBUG [databricks.labs.ucx.framework.dashboards] Reading dashboard folder /home/runner/work/ucx/ucx/src/databricks/labs/ucx/queries/assessment/interactive... 07:13 INFO [databricks.labs.ucx.framework.dashboards] Creating dashboard [ARFN] UCX Assessment (Interactive)... 07:14 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 00_0_interactive.md because it's a text widget 07:14 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 00_0_interactive.md because it's a text widget 07:14 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping query 02_0_cluster_summary.md because it's a text widget 07:14 DEBUG [databricks.labs.ucx.framework.dashboards] Skipping viz 02_0_cluster_summary.md because it's a text widget 07:14 DEBUG [databricks.labs.ucx.installer.workflows] Creating jobs from tasks in main 07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups-experimental 07:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 07:14 INFO [databricks.labs.ucx.installer.mixins] Fetching warehouse_id from a config 07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=assessment 07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=validate-groups-permissions 07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables 07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=099-destroy-schema 07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-tables-in-mounts-experimental 07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=migrate-groups 07:14 INFO [databricks.labs.ucx.installer.workflows] Creating new job configuration for step=remove-workspace-local-backup-groups 07:14 INFO [databricks.labs.ucx.install] Installation completed successfully! Please refer to the https://DATABRICKS_HOST/#workspace/Users/0a330eb5-dd51-4d97-b6e4-c474356b1d5d/.ArFN/README for the next steps. 07:14 DEBUG [databricks.labs.ucx.workspace_access.manager] Crawling permissions 07:14 INFO [databricks.labs.ucx.workspace_access.manager] Starting to crawl permissions. Total tasks: 1003 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES deb7e6d4-9fee-4406-8353-81175f40fc22 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 5a7a9dbb-7ecc-44dd-899a-6c607e42a701 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES fec3caf7-9422-4478-9c73-73cdb89c7254 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 5e9cc236-94be-46f9-b024-f23c6808baac 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 032e9c49-7d7f-439b-89d9-a6e4414c5b12 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 9170e676-a4fc-4054-b1e8-12c8d76900ae 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES d511ab71-7afb-4b97-9559-273e9d7b431c 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 73341447-9631-4988-9528-57faf2e7f163 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES ac1b6f9b-0874-4108-8387-6ba69d3ff22f 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 8bfa3072-c5c7-4467-b0cf-a2091db4cd7c 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 87eaed0f-51cd-4797-9934-25e3bc331e38 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 0042ed56-2066-428d-ae79-cd421da55683 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES dade8f79-d936-471f-93f1-10f90290fb3e 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 42930939-4653-48d2-8032-9125d27839ae 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES d642a3c8-99cc-448e-9aa6-aec8d0500b43 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES c0a65e16-a058-455d-9bc3-d76b0c38cec3 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES f2c415e2-5b69-49bd-b815-d7e9028ba6b9 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES bc583f7d-b8ad-4d5b-9a5a-95bd6c7487fa 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES ab2bb26b-53a6-4ec9-9469-1a2302cc076c 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES b78cfab1-c5af-49f0-a584-39df74a756f7 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES eea197ea-659e-4432-8854-f268b212a445 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 1a854f7a-6949-407e-8d24-6cee3f17b198 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 65beece7-5275-4e51-a00b-01e6e4ed38a3 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES c99f1780-6559-4e6d-9c44-1e95f888d72c 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 1e126be1-f265-4ad9-8fcf-c867710916a1 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 34631189-4247-4d5b-9636-66388d3df1bb 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 72352c52-0f2f-4ed3-938d-c344db0606bf 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES dc5605f2-bdb4-447e-850e-d11025522a78 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES ca19b20a-7359-4865-9c4a-c050e30fb71b 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES fd818da7-e055-463e-846f-a4b407e64578 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES b5cd5cb5-f0b3-482f-8ecd-7ef586a78750 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES f00ecb39-1b0b-4d5f-8ab0-9bb4de479444 07:14 WARNING [databricks.labs.ucx.workspace_access.redash] removed on backend: ObjectTypePlural.QUERIES 4d7e4ece-5e87-411b-8bdf-9c53da6e6840 07:14 INFO [databricks.labs.ucx.workspace_access.manager] Total crawled permissions: 970 07:14 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.ucx_Sucqg.permissions] found 970 new records for permissions 07:14 INFO [databricks.labs.ucx.workspace_access.manager] Successfully saved the items to inventory table 07:14 INFO [databricks.labs.ucx.workspace_access.manager] Saved 970 to hive_metastore.ucx_Sucqg.permissions 07:14 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 query permissions fixtures 07:14 DEBUG [databricks.labs.ucx.mixins.fixtures] removing query permissions fixture: 8fd5438f-885d-4891-9a51-b0f83f280edf [user_name 0a330eb5-dd51-4d97-b6e4-c474356b1d5d CAN_MANAGE, group_name admins CAN_MANAGE] -> [group_name sdk-LIhN CAN_EDIT] 07:14 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 query fixtures 07:14 DEBUG [databricks.labs.ucx.mixins.fixtures] removing query fixture: Query(can_edit=None, created_at='2024-04-04T07:13:13Z', data_source_id=None, description='TEST QUERY FOR UCX', id='8fd5438f-885d-4891-9a51-b0f83f280edf', is_archived=False, is_draft=False, is_favorite=False, is_safe=True, last_modified_by=User(email='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', id=481119220561874, name='labs-account-admin-identity'), last_modified_by_id=None, latest_query_data_id=None, name='ucx_query_QtkNM', options=QueryOptions(moved_to_trash_at=None, parameters=[]), parent='folders/2080761702917835', permission_tier=None, query='SELECT * FROM ucx_sqf64.ucx_t8asc', query_hash=None, run_as_role=, tags=[], updated_at='2024-04-04T07:13:13Z', user=User(email='0a330eb5-dd51-4d97-b6e4-c474356b1d5d', id=481119220561874, name='labs-account-admin-identity'), user_id=481119220561874, visualizations=[Visualization(created_at='2024-04-04T07:13:13Z', description='', id='cc56713a-5b7d-4636-9cc8-288b4fbcd564', name='Results', options={'version': 2}, type='TABLE', updated_at='2024-04-04T07:13:13Z')]) 07:14 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 table fixtures 07:14 DEBUG [databricks.labs.ucx.mixins.fixtures] removing table fixture: TableInfo(access_point=None, browse_only=None, catalog_name='hive_metastore', columns=None, comment=None, created_at=None, created_by=None, data_access_configuration_id=None, data_source_format=, deleted_at=None, delta_runtime_properties_kvpairs=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, encryption_details=None, full_name='hive_metastore.ucx_sqf64.ucx_t8asc', metastore_id=None, name='ucx_t8asc', owner=None, pipeline_id=None, properties=None, row_filter=None, schema_name='ucx_sqf64', sql_path=None, storage_credential_name=None, storage_location='dbfs:/user/hive/warehouse/ucx_sqf64/ucx_t8asc', table_constraints=None, table_id=None, table_type=, updated_at=None, updated_by=None, view_definition=None, view_dependencies=None) 07:14 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 schema fixtures 07:14 DEBUG [databricks.labs.ucx.mixins.fixtures] removing schema fixture: SchemaInfo(browse_only=None, catalog_name='hive_metastore', catalog_type=None, comment=None, created_at=None, created_by=None, effective_predictive_optimization_flag=None, enable_predictive_optimization=None, full_name='hive_metastore.ucx_sqf64', metastore_id=None, name='ucx_sqf64', owner=None, properties=None, storage_location=None, storage_root=None, updated_at=None, updated_by=None) 07:14 DEBUG [databricks.labs.ucx.mixins.fixtures] clearing 1 workspace group fixtures 07:14 DEBUG [databricks.labs.ucx.mixins.fixtures] removing workspace group fixture: Group(display_name='sdk-LIhN', entitlements=[], external_id=None, groups=[], id='416372241323208', members=[], meta=ResourceMeta(resource_type='WorkspaceGroup'), roles=[], schemas=[]) 07:14 INFO [databricks.labs.ucx.install] Deleting UCX v0.21.1+2720240404071437 from https://DATABRICKS_HOST 07:14 INFO [databricks.labs.ucx.install] Deleting inventory database ucx_Sucqg 07:14 INFO [databricks.labs.ucx.install] Deleting jobs 07:14 INFO [databricks.labs.ucx.install] Deleting migrate-groups-experimental job_id=572254520125435. 07:14 INFO [databricks.labs.ucx.install] Deleting assessment job_id=802233250386189. 07:14 INFO [databricks.labs.ucx.install] Deleting validate-groups-permissions job_id=1014375068723343. 07:14 INFO [databricks.labs.ucx.install] Deleting migrate-tables job_id=405016109212080. 07:14 INFO [databricks.labs.ucx.install] Deleting 099-destroy-schema job_id=977666146705825. 07:14 INFO [databricks.labs.ucx.install] Deleting migrate-tables-in-mounts-experimental job_id=431791413293262. 07:14 INFO [databricks.labs.ucx.install] Deleting migrate-groups job_id=597836058225637. 07:14 INFO [databricks.labs.ucx.install] Deleting remove-workspace-local-backup-groups job_id=282686432522251. 07:14 INFO [databricks.labs.ucx.install] Deleting cluster policy 07:14 INFO [databricks.labs.ucx.install] Deleting secret scope 07:14 INFO [databricks.labs.ucx.install] UnInstalling UCX complete [gw1] linux -- Python 3.10.14 /home/runner/work/ucx/ucx/.venv/bin/python ```

_{Running from nightly #14}

databrickslabs / ucx

Test failure: `test_running_real_validate_groups_permissions_job` #1261