Create a dashboard with a counter from a single query

[JCZuurmond]

Start with dashboard as code as part of #106.

[github-actions[bot]]

This PR breaks backwards compatibility for databrickslabs/ucx downstream. See build logs for more details.

_{Running from downstreams #58}

[github-actions[bot]]

❌ 23/25 passed, 2 failed, 2 skipped, 43m56s total

❌ test_load_dashboard: databricks.sdk.errors.platform.ResourceDoesNotExist: Path (/Workspace/Users/serge.smertin@databricks.com/Trivial Dashboard.lvdash.json) doesn't exist. (273ms)

``` databricks.sdk.errors.platform.ResourceDoesNotExist: Path (/Workspace/Users/serge.smertin@databricks.com/Trivial Dashboard.lvdash.json) doesn't exist. 10:13 DEBUG [databricks.sdk] Loaded from environment 10:13 DEBUG [databricks.sdk] Ignoring pat auth, because metadata-service is preferred 10:13 DEBUG [databricks.sdk] Ignoring basic auth, because metadata-service is preferred 10:13 DEBUG [databricks.sdk] Attempting to configure auth: metadata-service 10:13 INFO [databricks.sdk] Using Databricks Metadata Service authentication [gw5] linux -- Python 3.10.14 /home/runner/work/lsql/lsql/.venv/bin/python 10:13 DEBUG [databricks.sdk] Loaded from environment 10:13 DEBUG [databricks.sdk] Ignoring pat auth, because metadata-service is preferred 10:13 DEBUG [databricks.sdk] Ignoring basic auth, because metadata-service is preferred 10:13 DEBUG [databricks.sdk] Attempting to configure auth: metadata-service 10:13 INFO [databricks.sdk] Using Databricks Metadata Service authentication 10:13 DEBUG [databricks.sdk] GET /api/2.0/workspace/export?path=/Workspace/Users/serge.smertin@databricks.com/Trivial+Dashboard.lvdash.json&direct_download=true&format=SOURCE < 404 Not Found < { < "error_code": "RESOURCE_DOES_NOT_EXIST", < "message": "Path (/Workspace/Users/serge.smertin@databricks.com/Trivial Dashboard.lvdash.json) doesn't exist... (1 more bytes)" < } 10:13 DEBUG [databricks.sdk] Loaded from environment 10:13 DEBUG [databricks.sdk] Ignoring pat auth, because metadata-service is preferred 10:13 DEBUG [databricks.sdk] Ignoring basic auth, because metadata-service is preferred 10:13 DEBUG [databricks.sdk] Attempting to configure auth: metadata-service 10:13 INFO [databricks.sdk] Using Databricks Metadata Service authentication 10:13 DEBUG [databricks.sdk] GET /api/2.0/workspace/export?path=/Workspace/Users/serge.smertin@databricks.com/Trivial+Dashboard.lvdash.json&direct_download=true&format=SOURCE < 404 Not Found < { < "error_code": "RESOURCE_DOES_NOT_EXIST", < "message": "Path (/Workspace/Users/serge.smertin@databricks.com/Trivial Dashboard.lvdash.json) doesn't exist... (1 more bytes)" < } [gw5] linux -- Python 3.10.14 /home/runner/work/lsql/lsql/.venv/bin/python ```

❌ test_runtime_backend_errors_handled[\nfrom databricks.labs.lsql.backends import RuntimeBackend\nfrom databricks.sdk.errors import NotFound\nbackend = RuntimeBackend()\ntry:\n query_response = backend.fetch("SELECT * FROM TEST_SCHEMA.__RANDOM__")\n return "FAILED"\nexcept NotFound as e:\n return "PASSED"\n]: databricks.sdk.errors.platform.InternalError: TimeoutException: Timed out after 15 seconds (2m27.562s)

``` databricks.sdk.errors.platform.InternalError: TimeoutException: Timed out after 15 seconds 10:13 DEBUG [databricks.sdk] Loaded from environment 10:13 DEBUG [databricks.sdk] Ignoring pat auth, because metadata-service is preferred 10:13 DEBUG [databricks.sdk] Ignoring basic auth, because metadata-service is preferred 10:13 DEBUG [databricks.sdk] Attempting to configure auth: metadata-service 10:13 INFO [databricks.sdk] Using Databricks Metadata Service authentication [gw1] linux -- Python 3.10.14 /home/runner/work/lsql/lsql/.venv/bin/python 10:13 DEBUG [databricks.sdk] Loaded from environment 10:13 DEBUG [databricks.sdk] Ignoring pat auth, because metadata-service is preferred 10:13 DEBUG [databricks.sdk] Ignoring basic auth, because metadata-service is preferred 10:13 DEBUG [databricks.sdk] Attempting to configure auth: metadata-service 10:13 INFO [databricks.sdk] Using Databricks Metadata Service authentication 10:13 DEBUG [databricks.sdk] GET /api/2.0/preview/scim/v2/Me < 200 OK < { < "active": true, < "displayName": "labs-runtime-identity", < "emails": [ < { < "primary": true, < "type": "work", < "value": "**REDACTED**" < } < ], < "externalId": "d0f9bd2c-5651-45fd-b648-12a3fc6375c4", < "groups": [ < { < "$ref": "Groups/300667344111082", < "display": "labs.scope.runtime", < "type": "direct", < "value": "**REDACTED**" < } < ], < "id": "4643477475987733", < "name": { < "givenName": "labs-runtime-identity" < }, < "schemas": [ < "urn:ietf:params:scim:schemas:core:2.0:User", < "... (1 additional elements)" < ], < "userName": "4106dc97-a963-48f0-a079-a578238959a6" < } 10:13 DEBUG [databricks.labs.blueprint.wheels] Building wheel for /tmp/tmpd5vzlf35/working-copy in /tmp/tmpd5vzlf35 10:13 DEBUG [databricks.labs.blueprint.installation] Uploading: /Users/4106dc97-a963-48f0-a079-a578238959a6/.6LyP/wheels/databricks_labs_lsql-0.4.4+4020240528101325-py3-none-any.whl 10:13 DEBUG [databricks.sdk] POST /api/2.0/workspace/import > [raw stream] < 404 Not Found < { < "error_code": "RESOURCE_DOES_NOT_EXIST", < "message": "The parent folder (/Users/4106dc97-a963-48f0-a079-a578238959a6/.6LyP/wheels) does not exist." < } 10:13 DEBUG [databricks.labs.blueprint.installation] Creating missing folders: /Users/4106dc97-a963-48f0-a079-a578238959a6/.6LyP/wheels 10:13 DEBUG [databricks.sdk] POST /api/2.0/workspace/mkdirs > { > "path": "/Users/4106dc97-a963-48f0-a079-a578238959a6/.6LyP/wheels" > } < 200 OK < {} 10:13 DEBUG [databricks.sdk] POST /api/2.0/workspace/import > [raw stream] < 200 OK < { < "object_id": 1587262273135519 < } 10:13 DEBUG [databricks.labs.blueprint.installation] Converting Version into JSON format 10:13 DEBUG [databricks.labs.blueprint.installation] Uploading: /Users/4106dc97-a963-48f0-a079-a578238959a6/.6LyP/version.json 10:13 DEBUG [databricks.sdk] POST /api/2.0/workspace/import > [raw stream] < 200 OK < { < "object_id": 1587262273135520 < } 10:13 DEBUG [databricks.sdk] GET /api/2.0/clusters/get?cluster_id=DATABRICKS_CLUSTER_ID < 200 OK < { < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": { < "availability": "SPOT_WITH_FALLBACK_AZURE", < "first_on_demand": 2147483647, < "spot_bid_max_price": -1.0 < }, < "cluster_id": "DATABRICKS_CLUSTER_ID", < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "cluster_source": "UI", < "creator_user_name": "serge.smertin@databricks.com", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "TEST_SCHEMA_tags": { < "Budget": "opex.sales.labs", < "ClusterId": "DATABRICKS_CLUSTER_ID", < "ClusterName": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "Creator": "serge.smertin@databricks.com", < "DatabricksInstanceGroupId": "-6693343645136663331", < "DatabricksInstancePoolCreatorId": "4183391249163402", < "DatabricksInstancePoolId": "TEST_INSTANCE_POOL_ID", < "Owner": "labs-oss@databricks.com", < "Vendor": "Databricks" < }, < "disk_spec": {}, < "driver_healthy": true, < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "driver_instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "driver_node_type_id": "Standard_D4s_v3", < "effective_spark_version": "15.1.x-scala2.12", < "enable_elastic_disk": true, < "enable_local_disk_encryption": false, < "init_scripts_safe_mode": false, < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "last_activity_time": 1716883502251, < "last_restarted_time": 1716883443623, < "last_state_loss_time": 1716883443596, < "node_type_id": "Standard_D4s_v3", < "num_workers": 0, < "pinned_by_user_name": "4183391249163402", < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_context_id": 4400610348853321013, < "spark_version": "15.1.x-scala2.12", < "spec": { < "apply_policy_TEST_SCHEMA_values": false, < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": {}, < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "num_workers": 0, < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_version": "15.1.x-scala2.12" < }, < "start_time": 1711404481769, < "state": "TERMINATED", < "state_message": "Inactive cluster terminated (inactive for 60 minutes).", < "terminated_time": 1716887212274, < "termination_reason": { < "code": "INACTIVITY", < "parameters": { < "inactivity_duration_min": "60" < }, < "type": "SUCCESS" < } < } 10:13 DEBUG [databricks.sdk] POST /api/2.0/clusters/start > { > "cluster_id": "DATABRICKS_CLUSTER_ID" > } < 200 OK < {} 10:13 DEBUG [databricks.sdk] GET /api/2.0/clusters/get?cluster_id=DATABRICKS_CLUSTER_ID < 200 OK < { < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": { < "availability": "SPOT_WITH_FALLBACK_AZURE", < "first_on_demand": 2147483647, < "spot_bid_max_price": -1.0 < }, < "cluster_id": "DATABRICKS_CLUSTER_ID", < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "cluster_source": "UI", < "creator_user_name": "serge.smertin@databricks.com", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "TEST_SCHEMA_tags": { < "Budget": "opex.sales.labs", < "ClusterId": "DATABRICKS_CLUSTER_ID", < "ClusterName": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "Creator": "serge.smertin@databricks.com", < "DatabricksInstanceGroupId": "-6693343645136663331", < "DatabricksInstancePoolCreatorId": "4183391249163402", < "DatabricksInstancePoolId": "TEST_INSTANCE_POOL_ID", < "Owner": "labs-oss@databricks.com", < "Vendor": "Databricks" < }, < "disk_spec": {}, < "driver_healthy": true, < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "driver_instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "driver_node_type_id": "Standard_D4s_v3", < "effective_spark_version": "15.1.x-scala2.12", < "enable_elastic_disk": true, < "enable_local_disk_encryption": false, < "init_scripts_safe_mode": false, < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "last_activity_time": 1716883502251, < "last_restarted_time": 1716891208085, < "last_state_loss_time": 1716883443596, < "node_type_id": "Standard_D4s_v3", < "num_workers": 0, < "pinned_by_user_name": "4183391249163402", < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_context_id": 4400610348853321013, < "spark_version": "15.1.x-scala2.12", < "spec": { < "apply_policy_TEST_SCHEMA_values": false, < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": {}, < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "num_workers": 0, < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_version": "15.1.x-scala2.12" < }, < "start_time": 1711404481769, < "state": "PENDING", < "state_message": "" < } 10:13 DEBUG [databricks.sdk] cluster_id=DATABRICKS_CLUSTER_ID: (State.PENDING) (sleeping ~1s) 10:13 DEBUG [databricks.sdk] GET /api/2.0/clusters/get?cluster_id=DATABRICKS_CLUSTER_ID < 200 OK < { < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": { < "availability": "SPOT_WITH_FALLBACK_AZURE", < "first_on_demand": 2147483647, < "spot_bid_max_price": -1.0 < }, < "cluster_id": "DATABRICKS_CLUSTER_ID", < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "cluster_source": "UI", < "creator_user_name": "serge.smertin@databricks.com", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "TEST_SCHEMA_tags": { < "Budget": "opex.sales.labs", < "ClusterId": "DATABRICKS_CLUSTER_ID", < "ClusterName": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "Creator": "serge.smertin@databricks.com", < "DatabricksInstanceGroupId": "-6693343645136663331", < "DatabricksInstancePoolCreatorId": "4183391249163402", < "DatabricksInstancePoolId": "TEST_INSTANCE_POOL_ID", < "Owner": "labs-oss@databricks.com", < "Vendor": "Databricks" < }, < "disk_spec": {}, < "driver_healthy": true, < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "driver_instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "driver_node_type_id": "Standard_D4s_v3", < "effective_spark_version": "15.1.x-scala2.12", < "enable_elastic_disk": true, < "enable_local_disk_encryption": false, < "init_scripts_safe_mode": false, < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "last_activity_time": 1716883502251, < "last_restarted_time": 1716891208085, < "last_state_loss_time": 1716883443596, < "node_type_id": "Standard_D4s_v3", < "num_workers": 0, < "pinned_by_user_name": "4183391249163402", < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_context_id": 4400610348853321013, < "spark_version": "15.1.x-scala2.12", < "spec": { < "apply_policy_TEST_SCHEMA_values": false, < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": {}, < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "num_workers": 0, < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_version": "15.1.x-scala2.12" < }, < "start_time": 1711404481769, < "state": "PENDING", < "state_message": "Setting up 1 nodes." < } 10:13 DEBUG [databricks.sdk] cluster_id=DATABRICKS_CLUSTER_ID: (State.PENDING) Setting up 1 nodes. (sleeping ~2s) 10:13 DEBUG [databricks.sdk] GET /api/2.0/clusters/get?cluster_id=DATABRICKS_CLUSTER_ID < 200 OK < { < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": { < "availability": "SPOT_WITH_FALLBACK_AZURE", < "first_on_demand": 2147483647, < "spot_bid_max_price": -1.0 < }, < "cluster_id": "DATABRICKS_CLUSTER_ID", < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "cluster_source": "UI", < "creator_user_name": "serge.smertin@databricks.com", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "TEST_SCHEMA_tags": { < "Budget": "opex.sales.labs", < "ClusterId": "DATABRICKS_CLUSTER_ID", < "ClusterName": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "Creator": "serge.smertin@databricks.com", < "DatabricksInstanceGroupId": "-6693343645136663331", < "DatabricksInstancePoolCreatorId": "4183391249163402", < "DatabricksInstancePoolId": "TEST_INSTANCE_POOL_ID", < "Owner": "labs-oss@databricks.com", < "Vendor": "Databricks" < }, < "disk_spec": {}, < "driver_healthy": true, < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "driver_instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "driver_node_type_id": "Standard_D4s_v3", < "effective_spark_version": "15.1.x-scala2.12", < "enable_elastic_disk": true, < "enable_local_disk_encryption": false, < "init_scripts_safe_mode": false, < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "last_activity_time": 1716883502251, < "last_restarted_time": 1716891208085, < "last_state_loss_time": 1716883443596, < "node_type_id": "Standard_D4s_v3", < "num_workers": 0, < "pinned_by_user_name": "4183391249163402", < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_context_id": 4400610348853321013, < "spark_version": "15.1.x-scala2.12", < "spec": { < "apply_policy_TEST_SCHEMA_values": false, < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": {}, < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "num_workers": 0, < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_version": "15.1.x-scala2.12" < }, < "start_time": 1711404481769, < "state": "PENDING", < "state_message": "Setting up 1 nodes." < } 10:13 DEBUG [databricks.sdk] cluster_id=DATABRICKS_CLUSTER_ID: (State.PENDING) Setting up 1 nodes. (sleeping ~3s) 10:13 DEBUG [databricks.sdk] GET /api/2.0/clusters/get?cluster_id=DATABRICKS_CLUSTER_ID < 200 OK < { < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": { < "availability": "SPOT_WITH_FALLBACK_AZURE", < "first_on_demand": 2147483647, < "spot_bid_max_price": -1.0 < }, < "cluster_id": "DATABRICKS_CLUSTER_ID", < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "cluster_source": "UI", < "creator_user_name": "serge.smertin@databricks.com", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "TEST_SCHEMA_tags": { < "Budget": "opex.sales.labs", < "ClusterId": "DATABRICKS_CLUSTER_ID", < "ClusterName": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "Creator": "serge.smertin@databricks.com", < "DatabricksInstanceGroupId": "-6693343645136663331", < "DatabricksInstancePoolCreatorId": "4183391249163402", < "DatabricksInstancePoolId": "TEST_INSTANCE_POOL_ID", < "Owner": "labs-oss@databricks.com", < "Vendor": "Databricks" < }, < "disk_spec": {}, < "driver_healthy": true, < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "driver_instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "driver_node_type_id": "Standard_D4s_v3", < "effective_spark_version": "15.1.x-scala2.12", < "enable_elastic_disk": true, < "enable_local_disk_encryption": false, < "init_scripts_safe_mode": false, < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "last_activity_time": 1716883502251, < "last_restarted_time": 1716891208085, < "last_state_loss_time": 1716883443596, < "node_type_id": "Standard_D4s_v3", < "num_workers": 0, < "pinned_by_user_name": "4183391249163402", < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_context_id": 4400610348853321013, < "spark_version": "15.1.x-scala2.12", < "spec": { < "apply_policy_TEST_SCHEMA_values": false, < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": {}, < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "num_workers": 0, < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_version": "15.1.x-scala2.12" < }, < "start_time": 1711404481769, < "state": "PENDING", < "state_message": "Setting up 1 nodes." < } 10:13 DEBUG [databricks.sdk] cluster_id=DATABRICKS_CLUSTER_ID: (State.PENDING) Setting up 1 nodes. (sleeping ~4s) 10:13 DEBUG [databricks.sdk] GET /api/2.0/clusters/get?cluster_id=DATABRICKS_CLUSTER_ID < 200 OK < { < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": { < "availability": "SPOT_WITH_FALLBACK_AZURE", < "first_on_demand": 2147483647, < "spot_bid_max_price": -1.0 < }, < "cluster_id": "DATABRICKS_CLUSTER_ID", < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "cluster_source": "UI", < "creator_user_name": "serge.smertin@databricks.com", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "TEST_SCHEMA_tags": { < "Budget": "opex.sales.labs", < "ClusterId": "DATABRICKS_CLUSTER_ID", < "ClusterName": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "Creator": "serge.smertin@databricks.com", < "DatabricksInstanceGroupId": "-6693343645136663331", < "DatabricksInstancePoolCreatorId": "4183391249163402", < "DatabricksInstancePoolId": "TEST_INSTANCE_POOL_ID", < "Owner": "labs-oss@databricks.com", < "Vendor": "Databricks" < }, < "disk_spec": {}, < "driver_healthy": true, < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "driver_instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "driver_node_type_id": "Standard_D4s_v3", < "effective_spark_version": "15.1.x-scala2.12", < "enable_elastic_disk": true, < "enable_local_disk_encryption": false, < "init_scripts_safe_mode": false, < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "last_activity_time": 1716883502251, < "last_restarted_time": 1716891208085, < "last_state_loss_time": 1716883443596, < "node_type_id": "Standard_D4s_v3", < "num_workers": 0, < "pinned_by_user_name": "4183391249163402", < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_context_id": 4400610348853321013, < "spark_version": "15.1.x-scala2.12", < "spec": { < "apply_policy_TEST_SCHEMA_values": false, < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": {}, < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "num_workers": 0, < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_version": "15.1.x-scala2.12" < }, < "start_time": 1711404481769, < "state": "PENDING", < "state_message": "Starting Spark" < } 10:13 DEBUG [databricks.sdk] cluster_id=DATABRICKS_CLUSTER_ID: (State.PENDING) Starting Spark (sleeping ~5s) 10:13 DEBUG [databricks.sdk] GET /api/2.0/clusters/get?cluster_id=DATABRICKS_CLUSTER_ID < 200 OK < { < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": { < "availability": "SPOT_WITH_FALLBACK_AZURE", < "first_on_demand": 2147483647, < "spot_bid_max_price": -1.0 < }, < "cluster_id": "DATABRICKS_CLUSTER_ID", < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "cluster_source": "UI", < "creator_user_name": "serge.smertin@databricks.com", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "TEST_SCHEMA_tags": { < "Budget": "opex.sales.labs", < "ClusterId": "DATABRICKS_CLUSTER_ID", < "ClusterName": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "Creator": "serge.smertin@databricks.com", < "DatabricksInstanceGroupId": "-6693343645136663331", < "DatabricksInstancePoolCreatorId": "4183391249163402", < "DatabricksInstancePoolId": "TEST_INSTANCE_POOL_ID", < "Owner": "labs-oss@databricks.com", < "Vendor": "Databricks" < }, < "disk_spec": {}, < "driver_healthy": true, < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "driver_instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "driver_node_type_id": "Standard_D4s_v3", < "effective_spark_version": "15.1.x-scala2.12", < "enable_elastic_disk": true, < "enable_local_disk_encryption": false, < "init_scripts_safe_mode": false, < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "last_activity_time": 1716883502251, < "last_restarted_time": 1716891208085, < "last_state_loss_time": 1716883443596, < "node_type_id": "Standard_D4s_v3", < "num_workers": 0, < "pinned_by_user_name": "4183391249163402", < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_context_id": 4400610348853321013, < "spark_version": "15.1.x-scala2.12", < "spec": { < "apply_policy_TEST_SCHEMA_values": false, < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": {}, < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "num_workers": 0, < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_version": "15.1.x-scala2.12" < }, < "start_time": 1711404481769, < "state": "PENDING", < "state_message": "Starting Spark" < } 10:13 DEBUG [databricks.sdk] cluster_id=DATABRICKS_CLUSTER_ID: (State.PENDING) Starting Spark (sleeping ~6s) 10:13 DEBUG [databricks.sdk] GET /api/2.0/clusters/get?cluster_id=DATABRICKS_CLUSTER_ID < 200 OK < { < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": { < "availability": "SPOT_WITH_FALLBACK_AZURE", < "first_on_demand": 2147483647, < "spot_bid_max_price": -1.0 < }, < "cluster_id": "DATABRICKS_CLUSTER_ID", < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "cluster_source": "UI", < "creator_user_name": "serge.smertin@databricks.com", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "TEST_SCHEMA_tags": { < "Budget": "opex.sales.labs", < "ClusterId": "DATABRICKS_CLUSTER_ID", < "ClusterName": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "Creator": "serge.smertin@databricks.com", < "DatabricksInstanceGroupId": "-6693343645136663331", < "DatabricksInstancePoolCreatorId": "4183391249163402", < "DatabricksInstancePoolId": "TEST_INSTANCE_POOL_ID", < "Owner": "labs-oss@databricks.com", < "Vendor": "Databricks" < }, < "disk_spec": {}, < "driver_healthy": true, < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "driver_instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "driver_node_type_id": "Standard_D4s_v3", < "effective_spark_version": "15.1.x-scala2.12", < "enable_elastic_disk": true, < "enable_local_disk_encryption": false, < "init_scripts_safe_mode": false, < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "last_activity_time": 1716883502251, < "last_restarted_time": 1716891208085, < "last_state_loss_time": 1716883443596, < "node_type_id": "Standard_D4s_v3", < "num_workers": 0, < "pinned_by_user_name": "4183391249163402", < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_context_id": 4400610348853321013, < "spark_version": "15.1.x-scala2.12", < "spec": { < "apply_policy_TEST_SCHEMA_values": false, < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": {}, < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "num_workers": 0, < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_version": "15.1.x-scala2.12" < }, < "start_time": 1711404481769, < "state": "PENDING", < "state_message": "Starting Spark" < } 10:13 DEBUG [databricks.sdk] cluster_id=DATABRICKS_CLUSTER_ID: (State.PENDING) Starting Spark (sleeping ~7s) 10:13 DEBUG [databricks.sdk] GET /api/2.0/clusters/get?cluster_id=DATABRICKS_CLUSTER_ID < 200 OK < { < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": { < "availability": "SPOT_WITH_FALLBACK_AZURE", < "first_on_demand": 2147483647, < "spot_bid_max_price": -1.0 < }, < "cluster_id": "DATABRICKS_CLUSTER_ID", < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "cluster_source": "UI", < "creator_user_name": "serge.smertin@databricks.com", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "TEST_SCHEMA_tags": { < "Budget": "opex.sales.labs", < "ClusterId": "DATABRICKS_CLUSTER_ID", < "ClusterName": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "Creator": "serge.smertin@databricks.com", < "DatabricksInstanceGroupId": "-6693343645136663331", < "DatabricksInstancePoolCreatorId": "4183391249163402", < "DatabricksInstancePoolId": "TEST_INSTANCE_POOL_ID", < "Owner": "labs-oss@databricks.com", < "Vendor": "Databricks" < }, < "disk_spec": {}, < "driver_healthy": true, < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "driver_instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "driver_node_type_id": "Standard_D4s_v3", < "effective_spark_version": "15.1.x-scala2.12", < "enable_elastic_disk": true, < "enable_local_disk_encryption": false, < "init_scripts_safe_mode": false, < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "last_activity_time": 1716883502251, < "last_restarted_time": 1716891208085, < "last_state_loss_time": 1716883443596, < "node_type_id": "Standard_D4s_v3", < "num_workers": 0, < "pinned_by_user_name": "4183391249163402", < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_context_id": 4400610348853321013, < "spark_version": "15.1.x-scala2.12", < "spec": { < "apply_policy_TEST_SCHEMA_values": false, < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": {}, < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "num_workers": 0, < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_version": "15.1.x-scala2.12" < }, < "start_time": 1711404481769, < "state": "PENDING", < "state_message": "Starting Spark" < } 10:13 DEBUG [databricks.sdk] cluster_id=DATABRICKS_CLUSTER_ID: (State.PENDING) Starting Spark (sleeping ~8s) 10:14 DEBUG [databricks.sdk] GET /api/2.0/clusters/get?cluster_id=DATABRICKS_CLUSTER_ID < 200 OK < { < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": { < "availability": "SPOT_WITH_FALLBACK_AZURE", < "first_on_demand": 2147483647, < "spot_bid_max_price": -1.0 < }, < "cluster_id": "DATABRICKS_CLUSTER_ID", < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "cluster_source": "UI", < "creator_user_name": "serge.smertin@databricks.com", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "TEST_SCHEMA_tags": { < "Budget": "opex.sales.labs", < "ClusterId": "DATABRICKS_CLUSTER_ID", < "ClusterName": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "Creator": "serge.smertin@databricks.com", < "DatabricksInstanceGroupId": "-6693343645136663331", < "DatabricksInstancePoolCreatorId": "4183391249163402", < "DatabricksInstancePoolId": "TEST_INSTANCE_POOL_ID", < "Owner": "labs-oss@databricks.com", < "Vendor": "Databricks" < }, < "disk_spec": {}, < "driver_healthy": true, < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "driver_instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "driver_node_type_id": "Standard_D4s_v3", < "effective_spark_version": "15.1.x-scala2.12", < "enable_elastic_disk": true, < "enable_local_disk_encryption": false, < "init_scripts_safe_mode": false, < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "last_activity_time": 1716883502251, < "last_restarted_time": 1716891208085, < "last_state_loss_time": 1716883443596, < "node_type_id": "Standard_D4s_v3", < "num_workers": 0, < "pinned_by_user_name": "4183391249163402", < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_context_id": 4400610348853321013, < "spark_version": "15.1.x-scala2.12", < "spec": { < "apply_policy_TEST_SCHEMA_values": false, < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": {}, < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "num_workers": 0, < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_version": "15.1.x-scala2.12" < }, < "start_time": 1711404481769, < "state": "PENDING", < "state_message": "Starting Spark" < } 10:14 DEBUG [databricks.sdk] cluster_id=DATABRICKS_CLUSTER_ID: (State.PENDING) Starting Spark (sleeping ~9s) 10:14 DEBUG [databricks.sdk] GET /api/2.0/clusters/get?cluster_id=DATABRICKS_CLUSTER_ID < 200 OK < { < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": { < "availability": "SPOT_WITH_FALLBACK_AZURE", < "first_on_demand": 2147483647, < "spot_bid_max_price": -1.0 < }, < "cluster_id": "DATABRICKS_CLUSTER_ID", < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "cluster_source": "UI", < "creator_user_name": "serge.smertin@databricks.com", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "TEST_SCHEMA_tags": { < "Budget": "opex.sales.labs", < "ClusterId": "DATABRICKS_CLUSTER_ID", < "ClusterName": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "Creator": "serge.smertin@databricks.com", < "DatabricksInstanceGroupId": "-6693343645136663331", < "DatabricksInstancePoolCreatorId": "4183391249163402", < "DatabricksInstancePoolId": "TEST_INSTANCE_POOL_ID", < "Owner": "labs-oss@databricks.com", < "Vendor": "Databricks" < }, < "disk_spec": {}, < "driver_healthy": true, < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "driver_instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "driver_node_type_id": "Standard_D4s_v3", < "effective_spark_version": "15.1.x-scala2.12", < "enable_elastic_disk": true, < "enable_local_disk_encryption": false, < "init_scripts_safe_mode": false, < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "last_activity_time": 1716883502251, < "last_restarted_time": 1716891208085, < "last_state_loss_time": 1716883443596, < "node_type_id": "Standard_D4s_v3", < "num_workers": 0, < "pinned_by_user_name": "4183391249163402", < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_context_id": 4400610348853321013, < "spark_version": "15.1.x-scala2.12", < "spec": { < "apply_policy_TEST_SCHEMA_values": false, < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": {}, < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "num_workers": 0, < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_version": "15.1.x-scala2.12" < }, < "start_time": 1711404481769, < "state": "PENDING", < "state_message": "Starting Spark" < } 10:14 DEBUG [databricks.sdk] cluster_id=DATABRICKS_CLUSTER_ID: (State.PENDING) Starting Spark (sleeping ~10s) 10:14 DEBUG [databricks.sdk] GET /api/2.0/clusters/get?cluster_id=DATABRICKS_CLUSTER_ID < 200 OK < { < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": { < "availability": "SPOT_WITH_FALLBACK_AZURE", < "first_on_demand": 2147483647, < "spot_bid_max_price": -1.0 < }, < "cluster_id": "DATABRICKS_CLUSTER_ID", < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "cluster_source": "UI", < "creator_user_name": "serge.smertin@databricks.com", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "TEST_SCHEMA_tags": { < "Budget": "opex.sales.labs", < "ClusterId": "DATABRICKS_CLUSTER_ID", < "ClusterName": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "Creator": "serge.smertin@databricks.com", < "DatabricksInstanceGroupId": "-6693343645136663331", < "DatabricksInstancePoolCreatorId": "4183391249163402", < "DatabricksInstancePoolId": "TEST_INSTANCE_POOL_ID", < "Owner": "labs-oss@databricks.com", < "Vendor": "Databricks" < }, < "disk_spec": {}, < "driver_healthy": true, < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "driver_instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "driver_node_type_id": "Standard_D4s_v3", < "effective_spark_version": "15.1.x-scala2.12", < "enable_elastic_disk": true, < "enable_local_disk_encryption": false, < "init_scripts_safe_mode": false, < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "last_activity_time": 1716883502251, < "last_restarted_time": 1716891208085, < "last_state_loss_time": 1716883443596, < "node_type_id": "Standard_D4s_v3", < "num_workers": 0, < "pinned_by_user_name": "4183391249163402", < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_context_id": 4400610348853321013, < "spark_version": "15.1.x-scala2.12", < "spec": { < "apply_policy_TEST_SCHEMA_values": false, < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": {}, < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "num_workers": 0, < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_version": "15.1.x-scala2.12" < }, < "start_time": 1711404481769, < "state": "PENDING", < "state_message": "Starting Spark" < } 10:14 DEBUG [databricks.sdk] cluster_id=DATABRICKS_CLUSTER_ID: (State.PENDING) Starting Spark (sleeping ~10s) 10:14 DEBUG [databricks.sdk] GET /api/2.0/clusters/get?cluster_id=DATABRICKS_CLUSTER_ID < 200 OK < { < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": { < "availability": "SPOT_WITH_FALLBACK_AZURE", < "first_on_demand": 2147483647, < "spot_bid_max_price": -1.0 < }, < "cluster_id": "DATABRICKS_CLUSTER_ID", < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "cluster_source": "UI", < "creator_user_name": "serge.smertin@databricks.com", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "TEST_SCHEMA_tags": { < "Budget": "opex.sales.labs", < "ClusterId": "DATABRICKS_CLUSTER_ID", < "ClusterName": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "Creator": "serge.smertin@databricks.com", < "DatabricksInstanceGroupId": "-6693343645136663331", < "DatabricksInstancePoolCreatorId": "4183391249163402", < "DatabricksInstancePoolId": "TEST_INSTANCE_POOL_ID", < "Owner": "labs-oss@databricks.com", < "Vendor": "Databricks" < }, < "disk_spec": {}, < "driver_healthy": true, < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "driver_instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "driver_node_type_id": "Standard_D4s_v3", < "effective_spark_version": "15.1.x-scala2.12", < "enable_elastic_disk": true, < "enable_local_disk_encryption": false, < "init_scripts_safe_mode": false, < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "last_activity_time": 1716883502251, < "last_restarted_time": 1716891208085, < "last_state_loss_time": 1716883443596, < "node_type_id": "Standard_D4s_v3", < "num_workers": 0, < "pinned_by_user_name": "4183391249163402", < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_context_id": 4400610348853321013, < "spark_version": "15.1.x-scala2.12", < "spec": { < "apply_policy_TEST_SCHEMA_values": false, < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": {}, < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "num_workers": 0, < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_version": "15.1.x-scala2.12" < }, < "start_time": 1711404481769, < "state": "PENDING", < "state_message": "Starting Spark" < } 10:14 DEBUG [databricks.sdk] cluster_id=DATABRICKS_CLUSTER_ID: (State.PENDING) Starting Spark (sleeping ~10s) 10:14 DEBUG [databricks.sdk] GET /api/2.0/clusters/get?cluster_id=DATABRICKS_CLUSTER_ID < 200 OK < { < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": { < "availability": "SPOT_WITH_FALLBACK_AZURE", < "first_on_demand": 2147483647, < "spot_bid_max_price": -1.0 < }, < "cluster_id": "DATABRICKS_CLUSTER_ID", < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "cluster_source": "UI", < "creator_user_name": "serge.smertin@databricks.com", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "TEST_SCHEMA_tags": { < "Budget": "opex.sales.labs", < "ClusterId": "DATABRICKS_CLUSTER_ID", < "ClusterName": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "Creator": "serge.smertin@databricks.com", < "DatabricksInstanceGroupId": "-6693343645136663331", < "DatabricksInstancePoolCreatorId": "4183391249163402", < "DatabricksInstancePoolId": "TEST_INSTANCE_POOL_ID", < "Owner": "labs-oss@databricks.com", < "Vendor": "Databricks" < }, < "disk_spec": {}, < "driver_healthy": true, < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "driver_instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "driver_node_type_id": "Standard_D4s_v3", < "effective_spark_version": "15.1.x-scala2.12", < "enable_elastic_disk": true, < "enable_local_disk_encryption": false, < "init_scripts_safe_mode": false, < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "last_activity_time": 1716883502251, < "last_restarted_time": 1716891208085, < "last_state_loss_time": 1716883443596, < "node_type_id": "Standard_D4s_v3", < "num_workers": 0, < "pinned_by_user_name": "4183391249163402", < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_context_id": 4400610348853321013, < "spark_version": "15.1.x-scala2.12", < "spec": { < "apply_policy_TEST_SCHEMA_values": false, < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": {}, < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "num_workers": 0, < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_version": "15.1.x-scala2.12" < }, < "start_time": 1711404481769, < "state": "PENDING", < "state_message": "Starting Spark" < } 10:14 DEBUG [databricks.sdk] cluster_id=DATABRICKS_CLUSTER_ID: (State.PENDING) Starting Spark (sleeping ~10s) 10:14 DEBUG [databricks.sdk] GET /api/2.0/clusters/get?cluster_id=DATABRICKS_CLUSTER_ID < 200 OK < { < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": { < "availability": "SPOT_WITH_FALLBACK_AZURE", < "first_on_demand": 2147483647, < "spot_bid_max_price": -1.0 < }, < "cluster_id": "DATABRICKS_CLUSTER_ID", < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "cluster_source": "UI", < "creator_user_name": "serge.smertin@databricks.com", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "TEST_SCHEMA_tags": { < "Budget": "opex.sales.labs", < "ClusterId": "DATABRICKS_CLUSTER_ID", < "ClusterName": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "Creator": "serge.smertin@databricks.com", < "DatabricksInstanceGroupId": "-6693343645136663331", < "DatabricksInstancePoolCreatorId": "4183391249163402", < "DatabricksInstancePoolId": "TEST_INSTANCE_POOL_ID", < "Owner": "labs-oss@databricks.com", < "Vendor": "Databricks" < }, < "disk_spec": {}, < "driver_healthy": true, < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "driver_instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "driver_node_type_id": "Standard_D4s_v3", < "effective_spark_version": "15.1.x-scala2.12", < "enable_elastic_disk": true, < "enable_local_disk_encryption": false, < "init_scripts_safe_mode": false, < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "last_activity_time": 1716883502251, < "last_restarted_time": 1716891208085, < "last_state_loss_time": 1716883443596, < "node_type_id": "Standard_D4s_v3", < "num_workers": 0, < "pinned_by_user_name": "4183391249163402", < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_context_id": 4400610348853321013, < "spark_version": "15.1.x-scala2.12", < "spec": { < "apply_policy_TEST_SCHEMA_values": false, < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": {}, < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "num_workers": 0, < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_version": "15.1.x-scala2.12" < }, < "start_time": 1711404481769, < "state": "PENDING", < "state_message": "Starting Spark" < } 10:14 DEBUG [databricks.sdk] cluster_id=DATABRICKS_CLUSTER_ID: (State.PENDING) Starting Spark (sleeping ~10s) 10:15 DEBUG [databricks.sdk] GET /api/2.0/clusters/get?cluster_id=DATABRICKS_CLUSTER_ID < 200 OK < { < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": { < "availability": "SPOT_WITH_FALLBACK_AZURE", < "first_on_demand": 2147483647, < "spot_bid_max_price": -1.0 < }, < "cluster_id": "DATABRICKS_CLUSTER_ID", < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "cluster_source": "UI", < "creator_user_name": "serge.smertin@databricks.com", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "TEST_SCHEMA_tags": { < "Budget": "opex.sales.labs", < "ClusterId": "DATABRICKS_CLUSTER_ID", < "ClusterName": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "Creator": "serge.smertin@databricks.com", < "DatabricksInstanceGroupId": "-6693343645136663331", < "DatabricksInstancePoolCreatorId": "4183391249163402", < "DatabricksInstancePoolId": "TEST_INSTANCE_POOL_ID", < "Owner": "labs-oss@databricks.com", < "Vendor": "Databricks" < }, < "disk_spec": {}, < "driver_healthy": true, < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "driver_instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "driver_node_type_id": "Standard_D4s_v3", < "effective_spark_version": "15.1.x-scala2.12", < "enable_elastic_disk": true, < "enable_local_disk_encryption": false, < "init_scripts_safe_mode": false, < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "last_activity_time": 1716883502251, < "last_restarted_time": 1716891208085, < "last_state_loss_time": 1716883443596, < "node_type_id": "Standard_D4s_v3", < "num_workers": 0, < "pinned_by_user_name": "4183391249163402", < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_context_id": 4400610348853321013, < "spark_version": "15.1.x-scala2.12", < "spec": { < "apply_policy_TEST_SCHEMA_values": false, < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": {}, < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "num_workers": 0, < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_version": "15.1.x-scala2.12" < }, < "start_time": 1711404481769, < "state": "PENDING", < "state_message": "Starting Spark" < } 10:15 DEBUG [databricks.sdk] cluster_id=DATABRICKS_CLUSTER_ID: (State.PENDING) Starting Spark (sleeping ~10s) 10:15 DEBUG [databricks.sdk] GET /api/2.0/clusters/get?cluster_id=DATABRICKS_CLUSTER_ID < 200 OK < { < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": { < "availability": "SPOT_WITH_FALLBACK_AZURE", < "first_on_demand": 2147483647, < "spot_bid_max_price": -1.0 < }, < "cluster_id": "DATABRICKS_CLUSTER_ID", < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "cluster_source": "UI", < "creator_user_name": "serge.smertin@databricks.com", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "TEST_SCHEMA_tags": { < "Budget": "opex.sales.labs", < "ClusterId": "DATABRICKS_CLUSTER_ID", < "ClusterName": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "Creator": "serge.smertin@databricks.com", < "DatabricksInstanceGroupId": "-6693343645136663331", < "DatabricksInstancePoolCreatorId": "4183391249163402", < "DatabricksInstancePoolId": "TEST_INSTANCE_POOL_ID", < "Owner": "labs-oss@databricks.com", < "Vendor": "Databricks" < }, < "disk_spec": {}, < "driver_healthy": true, < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "driver_instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "driver_node_type_id": "Standard_D4s_v3", < "effective_spark_version": "15.1.x-scala2.12", < "enable_elastic_disk": true, < "enable_local_disk_encryption": false, < "init_scripts_safe_mode": false, < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "last_activity_time": 1716883502251, < "last_restarted_time": 1716891208085, < "last_state_loss_time": 1716883443596, < "node_type_id": "Standard_D4s_v3", < "num_workers": 0, < "pinned_by_user_name": "4183391249163402", < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_context_id": 4400610348853321013, < "spark_version": "15.1.x-scala2.12", < "spec": { < "apply_policy_TEST_SCHEMA_values": false, < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": {}, < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "num_workers": 0, < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_version": "15.1.x-scala2.12" < }, < "start_time": 1711404481769, < "state": "PENDING", < "state_message": "Starting Spark" < } 10:15 DEBUG [databricks.sdk] cluster_id=DATABRICKS_CLUSTER_ID: (State.PENDING) Starting Spark (sleeping ~10s) 10:15 DEBUG [databricks.sdk] GET /api/2.0/clusters/get?cluster_id=DATABRICKS_CLUSTER_ID < 200 OK < { < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": { < "availability": "SPOT_WITH_FALLBACK_AZURE", < "first_on_demand": 2147483647, < "spot_bid_max_price": -1.0 < }, < "cluster_cores": 4.0, < "cluster_id": "DATABRICKS_CLUSTER_ID", < "cluster_memory_mb": 16384, < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "cluster_source": "UI", < "creator_user_name": "serge.smertin@databricks.com", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "TEST_SCHEMA_tags": { < "Budget": "opex.sales.labs", < "ClusterId": "DATABRICKS_CLUSTER_ID", < "ClusterName": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "Creator": "serge.smertin@databricks.com", < "DatabricksInstanceGroupId": "-6693343645136663331", < "DatabricksInstancePoolCreatorId": "4183391249163402", < "DatabricksInstancePoolId": "TEST_INSTANCE_POOL_ID", < "Owner": "labs-oss@databricks.com", < "Vendor": "Databricks" < }, < "disk_spec": {}, < "driver": { < "host_private_ip": "10.139.0.24", < "instance_id": "b6017c12c43c4d4ab5b3d75f7fc47ba8", < "node_attributes": { < "is_spot": false < }, < "node_id": "1b98a38027e445f0bec75e311139e27d", < "private_ip": "10.139.64.24", < "public_dns": "104.209.214.243", < "start_timestamp": 1716891209167 < }, < "driver_healthy": true, < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "driver_instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "driver_node_type_id": "Standard_D4s_v3", < "effective_spark_version": "15.1.x-scala2.12", < "enable_elastic_disk": true, < "enable_local_disk_encryption": false, < "init_scripts_safe_mode": false, < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "jdbc_port": 10000, < "last_activity_time": 1716891255121, < "last_restarted_time": 1716891327021, < "last_state_loss_time": 1716891326993, < "node_type_id": "Standard_D4s_v3", < "num_workers": 0, < "pinned_by_user_name": "4183391249163402", < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_context_id": 8158553792863290987, < "spark_version": "15.1.x-scala2.12", < "spec": { < "apply_policy_TEST_SCHEMA_values": false, < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": {}, < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "num_workers": 0, < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_version": "15.1.x-scala2.12" < }, < "start_time": 1711404481769, < "state": "RUNNING", < "state_message": "" < } 10:15 DEBUG [databricks.sdk] POST /api/1.2/contexts/create > { > "clusterId": "DATABRICKS_CLUSTER_ID", > "language": "python" > } < 200 OK < { < "id": "4842173042326205715" < } 10:15 DEBUG [databricks.sdk] GET /api/1.2/contexts/status?clusterId=DATABRICKS_CLUSTER_ID&contextId=4842173042326205715 < 200 OK < { < "id": "4842173042326205715", < "status": "Pending" < } 10:15 DEBUG [databricks.sdk] cluster_id=DATABRICKS_CLUSTER_ID, context_id=4842173042326205715: (ContextStatus.PENDING) current status: ContextStatus.PENDING (sleeping ~1s) 10:15 DEBUG [databricks.sdk] GET /api/1.2/contexts/status?clusterId=DATABRICKS_CLUSTER_ID&contextId=4842173042326205715 < 500 Internal Server Error < { < "error": "ClusterNotReadyException: Cluster DATABRICKS_CLUSTER_ID not currently ready for driver client (cu... (20 more bytes)" < } 10:15 DEBUG [databricks.sdk.retries] Retrying: matched ClusterNotReadyException (sleeping ~1s) 10:15 DEBUG [databricks.sdk] GET /api/1.2/contexts/status?clusterId=DATABRICKS_CLUSTER_ID&contextId=4842173042326205715 < 500 Internal Server Error < { < "error": "TimeoutException: Timed out after 15 seconds" < } 10:13 DEBUG [databricks.sdk] Loaded from environment 10:13 DEBUG [databricks.sdk] Ignoring pat auth, because metadata-service is preferred 10:13 DEBUG [databricks.sdk] Ignoring basic auth, because metadata-service is preferred 10:13 DEBUG [databricks.sdk] Attempting to configure auth: metadata-service 10:13 INFO [databricks.sdk] Using Databricks Metadata Service authentication 10:13 DEBUG [databricks.sdk] GET /api/2.0/preview/scim/v2/Me < 200 OK < { < "active": true, < "displayName": "labs-runtime-identity", < "emails": [ < { < "primary": true, < "type": "work", < "value": "**REDACTED**" < } < ], < "externalId": "d0f9bd2c-5651-45fd-b648-12a3fc6375c4", < "groups": [ < { < "$ref": "Groups/300667344111082", < "display": "labs.scope.runtime", < "type": "direct", < "value": "**REDACTED**" < } < ], < "id": "4643477475987733", < "name": { < "givenName": "labs-runtime-identity" < }, < "schemas": [ < "urn:ietf:params:scim:schemas:core:2.0:User", < "... (1 additional elements)" < ], < "userName": "4106dc97-a963-48f0-a079-a578238959a6" < } 10:13 DEBUG [databricks.labs.blueprint.wheels] Building wheel for /tmp/tmpd5vzlf35/working-copy in /tmp/tmpd5vzlf35 10:13 DEBUG [databricks.labs.blueprint.installation] Uploading: /Users/4106dc97-a963-48f0-a079-a578238959a6/.6LyP/wheels/databricks_labs_lsql-0.4.4+4020240528101325-py3-none-any.whl 10:13 DEBUG [databricks.sdk] POST /api/2.0/workspace/import > [raw stream] < 404 Not Found < { < "error_code": "RESOURCE_DOES_NOT_EXIST", < "message": "The parent folder (/Users/4106dc97-a963-48f0-a079-a578238959a6/.6LyP/wheels) does not exist." < } 10:13 DEBUG [databricks.labs.blueprint.installation] Creating missing folders: /Users/4106dc97-a963-48f0-a079-a578238959a6/.6LyP/wheels 10:13 DEBUG [databricks.sdk] POST /api/2.0/workspace/mkdirs > { > "path": "/Users/4106dc97-a963-48f0-a079-a578238959a6/.6LyP/wheels" > } < 200 OK < {} 10:13 DEBUG [databricks.sdk] POST /api/2.0/workspace/import > [raw stream] < 200 OK < { < "object_id": 1587262273135519 < } 10:13 DEBUG [databricks.labs.blueprint.installation] Converting Version into JSON format 10:13 DEBUG [databricks.labs.blueprint.installation] Uploading: /Users/4106dc97-a963-48f0-a079-a578238959a6/.6LyP/version.json 10:13 DEBUG [databricks.sdk] POST /api/2.0/workspace/import > [raw stream] < 200 OK < { < "object_id": 1587262273135520 < } 10:13 DEBUG [databricks.sdk] GET /api/2.0/clusters/get?cluster_id=DATABRICKS_CLUSTER_ID < 200 OK < { < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": { < "availability": "SPOT_WITH_FALLBACK_AZURE", < "first_on_demand": 2147483647, < "spot_bid_max_price": -1.0 < }, < "cluster_id": "DATABRICKS_CLUSTER_ID", < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "cluster_source": "UI", < "creator_user_name": "serge.smertin@databricks.com", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "TEST_SCHEMA_tags": { < "Budget": "opex.sales.labs", < "ClusterId": "DATABRICKS_CLUSTER_ID", < "ClusterName": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "Creator": "serge.smertin@databricks.com", < "DatabricksInstanceGroupId": "-6693343645136663331", < "DatabricksInstancePoolCreatorId": "4183391249163402", < "DatabricksInstancePoolId": "TEST_INSTANCE_POOL_ID", < "Owner": "labs-oss@databricks.com", < "Vendor": "Databricks" < }, < "disk_spec": {}, < "driver_healthy": true, < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "driver_instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "driver_node_type_id": "Standard_D4s_v3", < "effective_spark_version": "15.1.x-scala2.12", < "enable_elastic_disk": true, < "enable_local_disk_encryption": false, < "init_scripts_safe_mode": false, < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "last_activity_time": 1716883502251, < "last_restarted_time": 1716883443623, < "last_state_loss_time": 1716883443596, < "node_type_id": "Standard_D4s_v3", < "num_workers": 0, < "pinned_by_user_name": "4183391249163402", < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_context_id": 4400610348853321013, < "spark_version": "15.1.x-scala2.12", < "spec": { < "apply_policy_TEST_SCHEMA_values": false, < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": {}, < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "num_workers": 0, < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_version": "15.1.x-scala2.12" < }, < "start_time": 1711404481769, < "state": "TERMINATED", < "state_message": "Inactive cluster terminated (inactive for 60 minutes).", < "terminated_time": 1716887212274, < "termination_reason": { < "code": "INACTIVITY", < "parameters": { < "inactivity_duration_min": "60" < }, < "type": "SUCCESS" < } < } 10:13 DEBUG [databricks.sdk] POST /api/2.0/clusters/start > { > "cluster_id": "DATABRICKS_CLUSTER_ID" > } < 200 OK < {} 10:13 DEBUG [databricks.sdk] GET /api/2.0/clusters/get?cluster_id=DATABRICKS_CLUSTER_ID < 200 OK < { < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": { < "availability": "SPOT_WITH_FALLBACK_AZURE", < "first_on_demand": 2147483647, < "spot_bid_max_price": -1.0 < }, < "cluster_id": "DATABRICKS_CLUSTER_ID", < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "cluster_source": "UI", < "creator_user_name": "serge.smertin@databricks.com", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "TEST_SCHEMA_tags": { < "Budget": "opex.sales.labs", < "ClusterId": "DATABRICKS_CLUSTER_ID", < "ClusterName": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "Creator": "serge.smertin@databricks.com", < "DatabricksInstanceGroupId": "-6693343645136663331", < "DatabricksInstancePoolCreatorId": "4183391249163402", < "DatabricksInstancePoolId": "TEST_INSTANCE_POOL_ID", < "Owner": "labs-oss@databricks.com", < "Vendor": "Databricks" < }, < "disk_spec": {}, < "driver_healthy": true, < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "driver_instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "driver_node_type_id": "Standard_D4s_v3", < "effective_spark_version": "15.1.x-scala2.12", < "enable_elastic_disk": true, < "enable_local_disk_encryption": false, < "init_scripts_safe_mode": false, < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "last_activity_time": 1716883502251, < "last_restarted_time": 1716891208085, < "last_state_loss_time": 1716883443596, < "node_type_id": "Standard_D4s_v3", < "num_workers": 0, < "pinned_by_user_name": "4183391249163402", < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_context_id": 4400610348853321013, < "spark_version": "15.1.x-scala2.12", < "spec": { < "apply_policy_TEST_SCHEMA_values": false, < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": {}, < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "num_workers": 0, < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_version": "15.1.x-scala2.12" < }, < "start_time": 1711404481769, < "state": "PENDING", < "state_message": "" < } 10:13 DEBUG [databricks.sdk] cluster_id=DATABRICKS_CLUSTER_ID: (State.PENDING) (sleeping ~1s) 10:13 DEBUG [databricks.sdk] GET /api/2.0/clusters/get?cluster_id=DATABRICKS_CLUSTER_ID < 200 OK < { < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": { < "availability": "SPOT_WITH_FALLBACK_AZURE", < "first_on_demand": 2147483647, < "spot_bid_max_price": -1.0 < }, < "cluster_id": "DATABRICKS_CLUSTER_ID", < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "cluster_source": "UI", < "creator_user_name": "serge.smertin@databricks.com", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "TEST_SCHEMA_tags": { < "Budget": "opex.sales.labs", < "ClusterId": "DATABRICKS_CLUSTER_ID", < "ClusterName": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "Creator": "serge.smertin@databricks.com", < "DatabricksInstanceGroupId": "-6693343645136663331", < "DatabricksInstancePoolCreatorId": "4183391249163402", < "DatabricksInstancePoolId": "TEST_INSTANCE_POOL_ID", < "Owner": "labs-oss@databricks.com", < "Vendor": "Databricks" < }, < "disk_spec": {}, < "driver_healthy": true, < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "driver_instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "driver_node_type_id": "Standard_D4s_v3", < "effective_spark_version": "15.1.x-scala2.12", < "enable_elastic_disk": true, < "enable_local_disk_encryption": false, < "init_scripts_safe_mode": false, < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "last_activity_time": 1716883502251, < "last_restarted_time": 1716891208085, < "last_state_loss_time": 1716883443596, < "node_type_id": "Standard_D4s_v3", < "num_workers": 0, < "pinned_by_user_name": "4183391249163402", < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_context_id": 4400610348853321013, < "spark_version": "15.1.x-scala2.12", < "spec": { < "apply_policy_TEST_SCHEMA_values": false, < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": {}, < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "num_workers": 0, < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_version": "15.1.x-scala2.12" < }, < "start_time": 1711404481769, < "state": "PENDING", < "state_message": "Setting up 1 nodes." < } 10:13 DEBUG [databricks.sdk] cluster_id=DATABRICKS_CLUSTER_ID: (State.PENDING) Setting up 1 nodes. (sleeping ~2s) 10:13 DEBUG [databricks.sdk] GET /api/2.0/clusters/get?cluster_id=DATABRICKS_CLUSTER_ID < 200 OK < { < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": { < "availability": "SPOT_WITH_FALLBACK_AZURE", < "first_on_demand": 2147483647, < "spot_bid_max_price": -1.0 < }, < "cluster_id": "DATABRICKS_CLUSTER_ID", < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "cluster_source": "UI", < "creator_user_name": "serge.smertin@databricks.com", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "TEST_SCHEMA_tags": { < "Budget": "opex.sales.labs", < "ClusterId": "DATABRICKS_CLUSTER_ID", < "ClusterName": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "Creator": "serge.smertin@databricks.com", < "DatabricksInstanceGroupId": "-6693343645136663331", < "DatabricksInstancePoolCreatorId": "4183391249163402", < "DatabricksInstancePoolId": "TEST_INSTANCE_POOL_ID", < "Owner": "labs-oss@databricks.com", < "Vendor": "Databricks" < }, < "disk_spec": {}, < "driver_healthy": true, < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "driver_instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "driver_node_type_id": "Standard_D4s_v3", < "effective_spark_version": "15.1.x-scala2.12", < "enable_elastic_disk": true, < "enable_local_disk_encryption": false, < "init_scripts_safe_mode": false, < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "last_activity_time": 1716883502251, < "last_restarted_time": 1716891208085, < "last_state_loss_time": 1716883443596, < "node_type_id": "Standard_D4s_v3", < "num_workers": 0, < "pinned_by_user_name": "4183391249163402", < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_context_id": 4400610348853321013, < "spark_version": "15.1.x-scala2.12", < "spec": { < "apply_policy_TEST_SCHEMA_values": false, < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": {}, < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "num_workers": 0, < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_version": "15.1.x-scala2.12" < }, < "start_time": 1711404481769, < "state": "PENDING", < "state_message": "Setting up 1 nodes." < } 10:13 DEBUG [databricks.sdk] cluster_id=DATABRICKS_CLUSTER_ID: (State.PENDING) Setting up 1 nodes. (sleeping ~3s) 10:13 DEBUG [databricks.sdk] GET /api/2.0/clusters/get?cluster_id=DATABRICKS_CLUSTER_ID < 200 OK < { < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": { < "availability": "SPOT_WITH_FALLBACK_AZURE", < "first_on_demand": 2147483647, < "spot_bid_max_price": -1.0 < }, < "cluster_id": "DATABRICKS_CLUSTER_ID", < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "cluster_source": "UI", < "creator_user_name": "serge.smertin@databricks.com", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "TEST_SCHEMA_tags": { < "Budget": "opex.sales.labs", < "ClusterId": "DATABRICKS_CLUSTER_ID", < "ClusterName": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "Creator": "serge.smertin@databricks.com", < "DatabricksInstanceGroupId": "-6693343645136663331", < "DatabricksInstancePoolCreatorId": "4183391249163402", < "DatabricksInstancePoolId": "TEST_INSTANCE_POOL_ID", < "Owner": "labs-oss@databricks.com", < "Vendor": "Databricks" < }, < "disk_spec": {}, < "driver_healthy": true, < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "driver_instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "driver_node_type_id": "Standard_D4s_v3", < "effective_spark_version": "15.1.x-scala2.12", < "enable_elastic_disk": true, < "enable_local_disk_encryption": false, < "init_scripts_safe_mode": false, < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "last_activity_time": 1716883502251, < "last_restarted_time": 1716891208085, < "last_state_loss_time": 1716883443596, < "node_type_id": "Standard_D4s_v3", < "num_workers": 0, < "pinned_by_user_name": "4183391249163402", < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_context_id": 4400610348853321013, < "spark_version": "15.1.x-scala2.12", < "spec": { < "apply_policy_TEST_SCHEMA_values": false, < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": {}, < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "num_workers": 0, < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_version": "15.1.x-scala2.12" < }, < "start_time": 1711404481769, < "state": "PENDING", < "state_message": "Setting up 1 nodes." < } 10:13 DEBUG [databricks.sdk] cluster_id=DATABRICKS_CLUSTER_ID: (State.PENDING) Setting up 1 nodes. (sleeping ~4s) 10:13 DEBUG [databricks.sdk] GET /api/2.0/clusters/get?cluster_id=DATABRICKS_CLUSTER_ID < 200 OK < { < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": { < "availability": "SPOT_WITH_FALLBACK_AZURE", < "first_on_demand": 2147483647, < "spot_bid_max_price": -1.0 < }, < "cluster_id": "DATABRICKS_CLUSTER_ID", < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "cluster_source": "UI", < "creator_user_name": "serge.smertin@databricks.com", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "TEST_SCHEMA_tags": { < "Budget": "opex.sales.labs", < "ClusterId": "DATABRICKS_CLUSTER_ID", < "ClusterName": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "Creator": "serge.smertin@databricks.com", < "DatabricksInstanceGroupId": "-6693343645136663331", < "DatabricksInstancePoolCreatorId": "4183391249163402", < "DatabricksInstancePoolId": "TEST_INSTANCE_POOL_ID", < "Owner": "labs-oss@databricks.com", < "Vendor": "Databricks" < }, < "disk_spec": {}, < "driver_healthy": true, < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "driver_instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "driver_node_type_id": "Standard_D4s_v3", < "effective_spark_version": "15.1.x-scala2.12", < "enable_elastic_disk": true, < "enable_local_disk_encryption": false, < "init_scripts_safe_mode": false, < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "last_activity_time": 1716883502251, < "last_restarted_time": 1716891208085, < "last_state_loss_time": 1716883443596, < "node_type_id": "Standard_D4s_v3", < "num_workers": 0, < "pinned_by_user_name": "4183391249163402", < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_context_id": 4400610348853321013, < "spark_version": "15.1.x-scala2.12", < "spec": { < "apply_policy_TEST_SCHEMA_values": false, < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": {}, < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "num_workers": 0, < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_version": "15.1.x-scala2.12" < }, < "start_time": 1711404481769, < "state": "PENDING", < "state_message": "Starting Spark" < } 10:13 DEBUG [databricks.sdk] cluster_id=DATABRICKS_CLUSTER_ID: (State.PENDING) Starting Spark (sleeping ~5s) 10:13 DEBUG [databricks.sdk] GET /api/2.0/clusters/get?cluster_id=DATABRICKS_CLUSTER_ID < 200 OK < { < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": { < "availability": "SPOT_WITH_FALLBACK_AZURE", < "first_on_demand": 2147483647, < "spot_bid_max_price": -1.0 < }, < "cluster_id": "DATABRICKS_CLUSTER_ID", < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "cluster_source": "UI", < "creator_user_name": "serge.smertin@databricks.com", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "TEST_SCHEMA_tags": { < "Budget": "opex.sales.labs", < "ClusterId": "DATABRICKS_CLUSTER_ID", < "ClusterName": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "Creator": "serge.smertin@databricks.com", < "DatabricksInstanceGroupId": "-6693343645136663331", < "DatabricksInstancePoolCreatorId": "4183391249163402", < "DatabricksInstancePoolId": "TEST_INSTANCE_POOL_ID", < "Owner": "labs-oss@databricks.com", < "Vendor": "Databricks" < }, < "disk_spec": {}, < "driver_healthy": true, < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "driver_instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "driver_node_type_id": "Standard_D4s_v3", < "effective_spark_version": "15.1.x-scala2.12", < "enable_elastic_disk": true, < "enable_local_disk_encryption": false, < "init_scripts_safe_mode": false, < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "last_activity_time": 1716883502251, < "last_restarted_time": 1716891208085, < "last_state_loss_time": 1716883443596, < "node_type_id": "Standard_D4s_v3", < "num_workers": 0, < "pinned_by_user_name": "4183391249163402", < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_context_id": 4400610348853321013, < "spark_version": "15.1.x-scala2.12", < "spec": { < "apply_policy_TEST_SCHEMA_values": false, < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": {}, < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "num_workers": 0, < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_version": "15.1.x-scala2.12" < }, < "start_time": 1711404481769, < "state": "PENDING", < "state_message": "Starting Spark" < } 10:13 DEBUG [databricks.sdk] cluster_id=DATABRICKS_CLUSTER_ID: (State.PENDING) Starting Spark (sleeping ~6s) 10:13 DEBUG [databricks.sdk] GET /api/2.0/clusters/get?cluster_id=DATABRICKS_CLUSTER_ID < 200 OK < { < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": { < "availability": "SPOT_WITH_FALLBACK_AZURE", < "first_on_demand": 2147483647, < "spot_bid_max_price": -1.0 < }, < "cluster_id": "DATABRICKS_CLUSTER_ID", < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "cluster_source": "UI", < "creator_user_name": "serge.smertin@databricks.com", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "TEST_SCHEMA_tags": { < "Budget": "opex.sales.labs", < "ClusterId": "DATABRICKS_CLUSTER_ID", < "ClusterName": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "Creator": "serge.smertin@databricks.com", < "DatabricksInstanceGroupId": "-6693343645136663331", < "DatabricksInstancePoolCreatorId": "4183391249163402", < "DatabricksInstancePoolId": "TEST_INSTANCE_POOL_ID", < "Owner": "labs-oss@databricks.com", < "Vendor": "Databricks" < }, < "disk_spec": {}, < "driver_healthy": true, < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "driver_instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "driver_node_type_id": "Standard_D4s_v3", < "effective_spark_version": "15.1.x-scala2.12", < "enable_elastic_disk": true, < "enable_local_disk_encryption": false, < "init_scripts_safe_mode": false, < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "last_activity_time": 1716883502251, < "last_restarted_time": 1716891208085, < "last_state_loss_time": 1716883443596, < "node_type_id": "Standard_D4s_v3", < "num_workers": 0, < "pinned_by_user_name": "4183391249163402", < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_context_id": 4400610348853321013, < "spark_version": "15.1.x-scala2.12", < "spec": { < "apply_policy_TEST_SCHEMA_values": false, < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": {}, < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "num_workers": 0, < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_version": "15.1.x-scala2.12" < }, < "start_time": 1711404481769, < "state": "PENDING", < "state_message": "Starting Spark" < } 10:13 DEBUG [databricks.sdk] cluster_id=DATABRICKS_CLUSTER_ID: (State.PENDING) Starting Spark (sleeping ~7s) 10:13 DEBUG [databricks.sdk] GET /api/2.0/clusters/get?cluster_id=DATABRICKS_CLUSTER_ID < 200 OK < { < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": { < "availability": "SPOT_WITH_FALLBACK_AZURE", < "first_on_demand": 2147483647, < "spot_bid_max_price": -1.0 < }, < "cluster_id": "DATABRICKS_CLUSTER_ID", < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "cluster_source": "UI", < "creator_user_name": "serge.smertin@databricks.com", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "TEST_SCHEMA_tags": { < "Budget": "opex.sales.labs", < "ClusterId": "DATABRICKS_CLUSTER_ID", < "ClusterName": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "Creator": "serge.smertin@databricks.com", < "DatabricksInstanceGroupId": "-6693343645136663331", < "DatabricksInstancePoolCreatorId": "4183391249163402", < "DatabricksInstancePoolId": "TEST_INSTANCE_POOL_ID", < "Owner": "labs-oss@databricks.com", < "Vendor": "Databricks" < }, < "disk_spec": {}, < "driver_healthy": true, < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "driver_instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "driver_node_type_id": "Standard_D4s_v3", < "effective_spark_version": "15.1.x-scala2.12", < "enable_elastic_disk": true, < "enable_local_disk_encryption": false, < "init_scripts_safe_mode": false, < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "last_activity_time": 1716883502251, < "last_restarted_time": 1716891208085, < "last_state_loss_time": 1716883443596, < "node_type_id": "Standard_D4s_v3", < "num_workers": 0, < "pinned_by_user_name": "4183391249163402", < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_context_id": 4400610348853321013, < "spark_version": "15.1.x-scala2.12", < "spec": { < "apply_policy_TEST_SCHEMA_values": false, < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": {}, < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "num_workers": 0, < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_version": "15.1.x-scala2.12" < }, < "start_time": 1711404481769, < "state": "PENDING", < "state_message": "Starting Spark" < } 10:13 DEBUG [databricks.sdk] cluster_id=DATABRICKS_CLUSTER_ID: (State.PENDING) Starting Spark (sleeping ~8s) 10:14 DEBUG [databricks.sdk] GET /api/2.0/clusters/get?cluster_id=DATABRICKS_CLUSTER_ID < 200 OK < { < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": { < "availability": "SPOT_WITH_FALLBACK_AZURE", < "first_on_demand": 2147483647, < "spot_bid_max_price": -1.0 < }, < "cluster_id": "DATABRICKS_CLUSTER_ID", < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "cluster_source": "UI", < "creator_user_name": "serge.smertin@databricks.com", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "TEST_SCHEMA_tags": { < "Budget": "opex.sales.labs", < "ClusterId": "DATABRICKS_CLUSTER_ID", < "ClusterName": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "Creator": "serge.smertin@databricks.com", < "DatabricksInstanceGroupId": "-6693343645136663331", < "DatabricksInstancePoolCreatorId": "4183391249163402", < "DatabricksInstancePoolId": "TEST_INSTANCE_POOL_ID", < "Owner": "labs-oss@databricks.com", < "Vendor": "Databricks" < }, < "disk_spec": {}, < "driver_healthy": true, < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "driver_instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "driver_node_type_id": "Standard_D4s_v3", < "effective_spark_version": "15.1.x-scala2.12", < "enable_elastic_disk": true, < "enable_local_disk_encryption": false, < "init_scripts_safe_mode": false, < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "last_activity_time": 1716883502251, < "last_restarted_time": 1716891208085, < "last_state_loss_time": 1716883443596, < "node_type_id": "Standard_D4s_v3", < "num_workers": 0, < "pinned_by_user_name": "4183391249163402", < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_context_id": 4400610348853321013, < "spark_version": "15.1.x-scala2.12", < "spec": { < "apply_policy_TEST_SCHEMA_values": false, < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": {}, < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "num_workers": 0, < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_version": "15.1.x-scala2.12" < }, < "start_time": 1711404481769, < "state": "PENDING", < "state_message": "Starting Spark" < } 10:14 DEBUG [databricks.sdk] cluster_id=DATABRICKS_CLUSTER_ID: (State.PENDING) Starting Spark (sleeping ~9s) 10:14 DEBUG [databricks.sdk] GET /api/2.0/clusters/get?cluster_id=DATABRICKS_CLUSTER_ID < 200 OK < { < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": { < "availability": "SPOT_WITH_FALLBACK_AZURE", < "first_on_demand": 2147483647, < "spot_bid_max_price": -1.0 < }, < "cluster_id": "DATABRICKS_CLUSTER_ID", < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "cluster_source": "UI", < "creator_user_name": "serge.smertin@databricks.com", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "TEST_SCHEMA_tags": { < "Budget": "opex.sales.labs", < "ClusterId": "DATABRICKS_CLUSTER_ID", < "ClusterName": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "Creator": "serge.smertin@databricks.com", < "DatabricksInstanceGroupId": "-6693343645136663331", < "DatabricksInstancePoolCreatorId": "4183391249163402", < "DatabricksInstancePoolId": "TEST_INSTANCE_POOL_ID", < "Owner": "labs-oss@databricks.com", < "Vendor": "Databricks" < }, < "disk_spec": {}, < "driver_healthy": true, < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "driver_instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "driver_node_type_id": "Standard_D4s_v3", < "effective_spark_version": "15.1.x-scala2.12", < "enable_elastic_disk": true, < "enable_local_disk_encryption": false, < "init_scripts_safe_mode": false, < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "last_activity_time": 1716883502251, < "last_restarted_time": 1716891208085, < "last_state_loss_time": 1716883443596, < "node_type_id": "Standard_D4s_v3", < "num_workers": 0, < "pinned_by_user_name": "4183391249163402", < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_context_id": 4400610348853321013, < "spark_version": "15.1.x-scala2.12", < "spec": { < "apply_policy_TEST_SCHEMA_values": false, < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": {}, < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "num_workers": 0, < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_version": "15.1.x-scala2.12" < }, < "start_time": 1711404481769, < "state": "PENDING", < "state_message": "Starting Spark" < } 10:14 DEBUG [databricks.sdk] cluster_id=DATABRICKS_CLUSTER_ID: (State.PENDING) Starting Spark (sleeping ~10s) 10:14 DEBUG [databricks.sdk] GET /api/2.0/clusters/get?cluster_id=DATABRICKS_CLUSTER_ID < 200 OK < { < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": { < "availability": "SPOT_WITH_FALLBACK_AZURE", < "first_on_demand": 2147483647, < "spot_bid_max_price": -1.0 < }, < "cluster_id": "DATABRICKS_CLUSTER_ID", < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "cluster_source": "UI", < "creator_user_name": "serge.smertin@databricks.com", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "TEST_SCHEMA_tags": { < "Budget": "opex.sales.labs", < "ClusterId": "DATABRICKS_CLUSTER_ID", < "ClusterName": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "Creator": "serge.smertin@databricks.com", < "DatabricksInstanceGroupId": "-6693343645136663331", < "DatabricksInstancePoolCreatorId": "4183391249163402", < "DatabricksInstancePoolId": "TEST_INSTANCE_POOL_ID", < "Owner": "labs-oss@databricks.com", < "Vendor": "Databricks" < }, < "disk_spec": {}, < "driver_healthy": true, < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "driver_instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "driver_node_type_id": "Standard_D4s_v3", < "effective_spark_version": "15.1.x-scala2.12", < "enable_elastic_disk": true, < "enable_local_disk_encryption": false, < "init_scripts_safe_mode": false, < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "last_activity_time": 1716883502251, < "last_restarted_time": 1716891208085, < "last_state_loss_time": 1716883443596, < "node_type_id": "Standard_D4s_v3", < "num_workers": 0, < "pinned_by_user_name": "4183391249163402", < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_context_id": 4400610348853321013, < "spark_version": "15.1.x-scala2.12", < "spec": { < "apply_policy_TEST_SCHEMA_values": false, < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": {}, < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "num_workers": 0, < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_version": "15.1.x-scala2.12" < }, < "start_time": 1711404481769, < "state": "PENDING", < "state_message": "Starting Spark" < } 10:14 DEBUG [databricks.sdk] cluster_id=DATABRICKS_CLUSTER_ID: (State.PENDING) Starting Spark (sleeping ~10s) 10:14 DEBUG [databricks.sdk] GET /api/2.0/clusters/get?cluster_id=DATABRICKS_CLUSTER_ID < 200 OK < { < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": { < "availability": "SPOT_WITH_FALLBACK_AZURE", < "first_on_demand": 2147483647, < "spot_bid_max_price": -1.0 < }, < "cluster_id": "DATABRICKS_CLUSTER_ID", < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "cluster_source": "UI", < "creator_user_name": "serge.smertin@databricks.com", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "TEST_SCHEMA_tags": { < "Budget": "opex.sales.labs", < "ClusterId": "DATABRICKS_CLUSTER_ID", < "ClusterName": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "Creator": "serge.smertin@databricks.com", < "DatabricksInstanceGroupId": "-6693343645136663331", < "DatabricksInstancePoolCreatorId": "4183391249163402", < "DatabricksInstancePoolId": "TEST_INSTANCE_POOL_ID", < "Owner": "labs-oss@databricks.com", < "Vendor": "Databricks" < }, < "disk_spec": {}, < "driver_healthy": true, < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "driver_instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "driver_node_type_id": "Standard_D4s_v3", < "effective_spark_version": "15.1.x-scala2.12", < "enable_elastic_disk": true, < "enable_local_disk_encryption": false, < "init_scripts_safe_mode": false, < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "last_activity_time": 1716883502251, < "last_restarted_time": 1716891208085, < "last_state_loss_time": 1716883443596, < "node_type_id": "Standard_D4s_v3", < "num_workers": 0, < "pinned_by_user_name": "4183391249163402", < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_context_id": 4400610348853321013, < "spark_version": "15.1.x-scala2.12", < "spec": { < "apply_policy_TEST_SCHEMA_values": false, < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": {}, < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "num_workers": 0, < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_version": "15.1.x-scala2.12" < }, < "start_time": 1711404481769, < "state": "PENDING", < "state_message": "Starting Spark" < } 10:14 DEBUG [databricks.sdk] cluster_id=DATABRICKS_CLUSTER_ID: (State.PENDING) Starting Spark (sleeping ~10s) 10:14 DEBUG [databricks.sdk] GET /api/2.0/clusters/get?cluster_id=DATABRICKS_CLUSTER_ID < 200 OK < { < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": { < "availability": "SPOT_WITH_FALLBACK_AZURE", < "first_on_demand": 2147483647, < "spot_bid_max_price": -1.0 < }, < "cluster_id": "DATABRICKS_CLUSTER_ID", < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "cluster_source": "UI", < "creator_user_name": "serge.smertin@databricks.com", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "TEST_SCHEMA_tags": { < "Budget": "opex.sales.labs", < "ClusterId": "DATABRICKS_CLUSTER_ID", < "ClusterName": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "Creator": "serge.smertin@databricks.com", < "DatabricksInstanceGroupId": "-6693343645136663331", < "DatabricksInstancePoolCreatorId": "4183391249163402", < "DatabricksInstancePoolId": "TEST_INSTANCE_POOL_ID", < "Owner": "labs-oss@databricks.com", < "Vendor": "Databricks" < }, < "disk_spec": {}, < "driver_healthy": true, < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "driver_instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "driver_node_type_id": "Standard_D4s_v3", < "effective_spark_version": "15.1.x-scala2.12", < "enable_elastic_disk": true, < "enable_local_disk_encryption": false, < "init_scripts_safe_mode": false, < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "last_activity_time": 1716883502251, < "last_restarted_time": 1716891208085, < "last_state_loss_time": 1716883443596, < "node_type_id": "Standard_D4s_v3", < "num_workers": 0, < "pinned_by_user_name": "4183391249163402", < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_context_id": 4400610348853321013, < "spark_version": "15.1.x-scala2.12", < "spec": { < "apply_policy_TEST_SCHEMA_values": false, < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": {}, < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "num_workers": 0, < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_version": "15.1.x-scala2.12" < }, < "start_time": 1711404481769, < "state": "PENDING", < "state_message": "Starting Spark" < } 10:14 DEBUG [databricks.sdk] cluster_id=DATABRICKS_CLUSTER_ID: (State.PENDING) Starting Spark (sleeping ~10s) 10:14 DEBUG [databricks.sdk] GET /api/2.0/clusters/get?cluster_id=DATABRICKS_CLUSTER_ID < 200 OK < { < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": { < "availability": "SPOT_WITH_FALLBACK_AZURE", < "first_on_demand": 2147483647, < "spot_bid_max_price": -1.0 < }, < "cluster_id": "DATABRICKS_CLUSTER_ID", < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "cluster_source": "UI", < "creator_user_name": "serge.smertin@databricks.com", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "TEST_SCHEMA_tags": { < "Budget": "opex.sales.labs", < "ClusterId": "DATABRICKS_CLUSTER_ID", < "ClusterName": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "Creator": "serge.smertin@databricks.com", < "DatabricksInstanceGroupId": "-6693343645136663331", < "DatabricksInstancePoolCreatorId": "4183391249163402", < "DatabricksInstancePoolId": "TEST_INSTANCE_POOL_ID", < "Owner": "labs-oss@databricks.com", < "Vendor": "Databricks" < }, < "disk_spec": {}, < "driver_healthy": true, < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "driver_instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "driver_node_type_id": "Standard_D4s_v3", < "effective_spark_version": "15.1.x-scala2.12", < "enable_elastic_disk": true, < "enable_local_disk_encryption": false, < "init_scripts_safe_mode": false, < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "last_activity_time": 1716883502251, < "last_restarted_time": 1716891208085, < "last_state_loss_time": 1716883443596, < "node_type_id": "Standard_D4s_v3", < "num_workers": 0, < "pinned_by_user_name": "4183391249163402", < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_context_id": 4400610348853321013, < "spark_version": "15.1.x-scala2.12", < "spec": { < "apply_policy_TEST_SCHEMA_values": false, < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": {}, < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "num_workers": 0, < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_version": "15.1.x-scala2.12" < }, < "start_time": 1711404481769, < "state": "PENDING", < "state_message": "Starting Spark" < } 10:14 DEBUG [databricks.sdk] cluster_id=DATABRICKS_CLUSTER_ID: (State.PENDING) Starting Spark (sleeping ~10s) 10:15 DEBUG [databricks.sdk] GET /api/2.0/clusters/get?cluster_id=DATABRICKS_CLUSTER_ID < 200 OK < { < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": { < "availability": "SPOT_WITH_FALLBACK_AZURE", < "first_on_demand": 2147483647, < "spot_bid_max_price": -1.0 < }, < "cluster_id": "DATABRICKS_CLUSTER_ID", < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "cluster_source": "UI", < "creator_user_name": "serge.smertin@databricks.com", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "TEST_SCHEMA_tags": { < "Budget": "opex.sales.labs", < "ClusterId": "DATABRICKS_CLUSTER_ID", < "ClusterName": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "Creator": "serge.smertin@databricks.com", < "DatabricksInstanceGroupId": "-6693343645136663331", < "DatabricksInstancePoolCreatorId": "4183391249163402", < "DatabricksInstancePoolId": "TEST_INSTANCE_POOL_ID", < "Owner": "labs-oss@databricks.com", < "Vendor": "Databricks" < }, < "disk_spec": {}, < "driver_healthy": true, < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "driver_instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "driver_node_type_id": "Standard_D4s_v3", < "effective_spark_version": "15.1.x-scala2.12", < "enable_elastic_disk": true, < "enable_local_disk_encryption": false, < "init_scripts_safe_mode": false, < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "last_activity_time": 1716883502251, < "last_restarted_time": 1716891208085, < "last_state_loss_time": 1716883443596, < "node_type_id": "Standard_D4s_v3", < "num_workers": 0, < "pinned_by_user_name": "4183391249163402", < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_context_id": 4400610348853321013, < "spark_version": "15.1.x-scala2.12", < "spec": { < "apply_policy_TEST_SCHEMA_values": false, < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": {}, < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "num_workers": 0, < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_version": "15.1.x-scala2.12" < }, < "start_time": 1711404481769, < "state": "PENDING", < "state_message": "Starting Spark" < } 10:15 DEBUG [databricks.sdk] cluster_id=DATABRICKS_CLUSTER_ID: (State.PENDING) Starting Spark (sleeping ~10s) 10:15 DEBUG [databricks.sdk] GET /api/2.0/clusters/get?cluster_id=DATABRICKS_CLUSTER_ID < 200 OK < { < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": { < "availability": "SPOT_WITH_FALLBACK_AZURE", < "first_on_demand": 2147483647, < "spot_bid_max_price": -1.0 < }, < "cluster_id": "DATABRICKS_CLUSTER_ID", < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "cluster_source": "UI", < "creator_user_name": "serge.smertin@databricks.com", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "TEST_SCHEMA_tags": { < "Budget": "opex.sales.labs", < "ClusterId": "DATABRICKS_CLUSTER_ID", < "ClusterName": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "Creator": "serge.smertin@databricks.com", < "DatabricksInstanceGroupId": "-6693343645136663331", < "DatabricksInstancePoolCreatorId": "4183391249163402", < "DatabricksInstancePoolId": "TEST_INSTANCE_POOL_ID", < "Owner": "labs-oss@databricks.com", < "Vendor": "Databricks" < }, < "disk_spec": {}, < "driver_healthy": true, < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "driver_instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "driver_node_type_id": "Standard_D4s_v3", < "effective_spark_version": "15.1.x-scala2.12", < "enable_elastic_disk": true, < "enable_local_disk_encryption": false, < "init_scripts_safe_mode": false, < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "last_activity_time": 1716883502251, < "last_restarted_time": 1716891208085, < "last_state_loss_time": 1716883443596, < "node_type_id": "Standard_D4s_v3", < "num_workers": 0, < "pinned_by_user_name": "4183391249163402", < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_context_id": 4400610348853321013, < "spark_version": "15.1.x-scala2.12", < "spec": { < "apply_policy_TEST_SCHEMA_values": false, < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": {}, < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "num_workers": 0, < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_version": "15.1.x-scala2.12" < }, < "start_time": 1711404481769, < "state": "PENDING", < "state_message": "Starting Spark" < } 10:15 DEBUG [databricks.sdk] cluster_id=DATABRICKS_CLUSTER_ID: (State.PENDING) Starting Spark (sleeping ~10s) 10:15 DEBUG [databricks.sdk] GET /api/2.0/clusters/get?cluster_id=DATABRICKS_CLUSTER_ID < 200 OK < { < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": { < "availability": "SPOT_WITH_FALLBACK_AZURE", < "first_on_demand": 2147483647, < "spot_bid_max_price": -1.0 < }, < "cluster_cores": 4.0, < "cluster_id": "DATABRICKS_CLUSTER_ID", < "cluster_memory_mb": 16384, < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "cluster_source": "UI", < "creator_user_name": "serge.smertin@databricks.com", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "TEST_SCHEMA_tags": { < "Budget": "opex.sales.labs", < "ClusterId": "DATABRICKS_CLUSTER_ID", < "ClusterName": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "Creator": "serge.smertin@databricks.com", < "DatabricksInstanceGroupId": "-6693343645136663331", < "DatabricksInstancePoolCreatorId": "4183391249163402", < "DatabricksInstancePoolId": "TEST_INSTANCE_POOL_ID", < "Owner": "labs-oss@databricks.com", < "Vendor": "Databricks" < }, < "disk_spec": {}, < "driver": { < "host_private_ip": "10.139.0.24", < "instance_id": "b6017c12c43c4d4ab5b3d75f7fc47ba8", < "node_attributes": { < "is_spot": false < }, < "node_id": "1b98a38027e445f0bec75e311139e27d", < "private_ip": "10.139.64.24", < "public_dns": "104.209.214.243", < "start_timestamp": 1716891209167 < }, < "driver_healthy": true, < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "driver_instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "driver_node_type_id": "Standard_D4s_v3", < "effective_spark_version": "15.1.x-scala2.12", < "enable_elastic_disk": true, < "enable_local_disk_encryption": false, < "init_scripts_safe_mode": false, < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_source": { < "instance_pool_id": "TEST_INSTANCE_POOL_ID" < }, < "jdbc_port": 10000, < "last_activity_time": 1716891255121, < "last_restarted_time": 1716891327021, < "last_state_loss_time": 1716891326993, < "node_type_id": "Standard_D4s_v3", < "num_workers": 0, < "pinned_by_user_name": "4183391249163402", < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_context_id": 8158553792863290987, < "spark_version": "15.1.x-scala2.12", < "spec": { < "apply_policy_TEST_SCHEMA_values": false, < "autotermination_minutes": 60, < "CLOUD_ENV_attributes": {}, < "cluster_name": "Scoped MSI Cluster: runtime (Single Node, Single User)", < "custom_tags": { < "ResourceClass": "SingleNode" < }, < "data_security_mode": "SINGLE_USER", < "driver_instance_pool_id": "TEST_INSTANCE_POOL_ID", < "instance_pool_id": "TEST_INSTANCE_POOL_ID", < "num_workers": 0, < "single_user_name": "4106dc97-a963-48f0-a079-a578238959a6", < "spark_conf": { < "spark.databricks.cluster.profile": "singleNode", < "spark.master": "local[*]" < }, < "spark_version": "15.1.x-scala2.12" < }, < "start_time": 1711404481769, < "state": "RUNNING", < "state_message": "" < } 10:15 DEBUG [databricks.sdk] POST /api/1.2/contexts/create > { > "clusterId": "DATABRICKS_CLUSTER_ID", > "language": "python" > } < 200 OK < { < "id": "4842173042326205715" < } 10:15 DEBUG [databricks.sdk] GET /api/1.2/contexts/status?clusterId=DATABRICKS_CLUSTER_ID&contextId=4842173042326205715 < 200 OK < { < "id": "4842173042326205715", < "status": "Pending" < } 10:15 DEBUG [databricks.sdk] cluster_id=DATABRICKS_CLUSTER_ID, context_id=4842173042326205715: (ContextStatus.PENDING) current status: ContextStatus.PENDING (sleeping ~1s) 10:15 DEBUG [databricks.sdk] GET /api/1.2/contexts/status?clusterId=DATABRICKS_CLUSTER_ID&contextId=4842173042326205715 < 500 Internal Server Error < { < "error": "ClusterNotReadyException: Cluster DATABRICKS_CLUSTER_ID not currently ready for driver client (cu... (20 more bytes)" < } 10:15 DEBUG [databricks.sdk.retries] Retrying: matched ClusterNotReadyException (sleeping ~1s) 10:15 DEBUG [databricks.sdk] GET /api/1.2/contexts/status?clusterId=DATABRICKS_CLUSTER_ID&contextId=4842173042326205715 < 500 Internal Server Error < { < "error": "TimeoutException: Timed out after 15 seconds" < } [gw1] linux -- Python 3.10.14 /home/runner/work/lsql/lsql/.venv/bin/python ```

_{Running from acceptance #87}