Open gercograndia opened 7 months ago
We are also seeing this on provider version 1.51.0 with a different invalid character in the error and a different HTTP error code:
[2024-09-15T20:26:54.951Z] databricks_workspace_conf.databricks_workspace_config[0]: Refreshing state... [id=_]
...
[2024-09-15T20:27:00.116Z] │ Error: cannot read workspace conf: unexpected error handling request: invalid character 'U' looking for beginning of value. This is likely a bug in the Databricks SDK for Go or the underlying REST API. Please report this issue with the following debugging information to the SDK issue tracker at https://github.com/databricks/databricks-sdk-go/issues. Request log:
[2024-09-15T20:27:00.117Z] │ ```
[2024-09-15T20:27:00.117Z] │ GET /api/2.0/workspace-conf?keys=enableIpAccessLists
[2024-09-15T20:27:00.117Z] │ > * Host:
[2024-09-15T20:27:00.117Z] │ > * Accept: application/json
[2024-09-15T20:27:00.117Z] │ > * Authorization: REDACTED
[2024-09-15T20:27:00.117Z] │ > * Traceparent: 00-58c04a939ee49142132d3033e5183b28-1db21ad4a04dfbd5-01
[2024-09-15T20:27:00.117Z] │ > * User-Agent: databricks-tf-provider/1.51.0 databricks-sdk-go/0.45.0 go/1.22.6 os/linux terraform/1.4.7 resource/workspace_conf auth/azure-cli cicd/jenkins
[2024-09-15T20:27:00.117Z] │ > * X-Databricks-Azure-Sp-Management-Token: [REDACTED]
[2024-09-15T20:27:00.117Z] │ < HTTP/2.0 403 Forbidden
[2024-09-15T20:27:00.117Z] │ < * Content-Length: 20
[2024-09-15T20:27:00.118Z] │ < * Content-Type: text/html; charset=utf-8
[2024-09-15T20:27:00.118Z] │ < * Date: Sun, 15 Sep 2024 20:26:56 GMT
[2024-09-15T20:27:00.118Z] │ < * Server: databricks
[2024-09-15T20:27:00.118Z] │ < * X-Request-Id: 5afe391c-a90c-90e4-91b5-5d5d41d38dbe
[2024-09-15T20:27:00.118Z] │ < User not authorized.
[2024-09-15T20:27:00.118Z] │ ```
[2024-09-15T20:27:00.118Z] │
[2024-09-15T20:27:00.118Z] │ with databricks_workspace_conf.databricks_workspace_config[0],
[2024-09-15T20:27:00.118Z] │ on databricks.tf line 115, in resource "databricks_workspace_conf" "databricks_workspace_config":
[2024-09-15T20:27:00.118Z] │ 115: resource "databricks_workspace_conf" "databricks_workspace_config" {
Out configuration for the resource is:
resource "databricks_workspace_conf" "databricks_workspace_config" {
count = local.create_databricks_workspace ? 1 : 0
custom_config = {
"enableIpAccessLists" : true
}
depends_on = [azurerm_databricks_workspace.databricks_workspace]
}
HI,
I also have something similar problem, I am using a service principal, attached to the Github Action.
Run databricks bundle validate -t test
Error: unexpected error handling request: invalid character 'U' looking for beginning of value. This is likely a bug in the Databricks SDK for Go or the underlying REST API. Please report this issue with the following debugging information to the SDK issue tracker at https://github.com/databricks/databricks-sdk-go/issues. Request log:
GET /api/2.0/preview/scim/v2/Me
- Host:
- Accept: application/json
- Authorization: REDACTED
- Traceparent: 00-3cb5fdb33c989569133b98cfaba78c12-83f82cfc189b399a-01
- User-Agent: cli/0.221.0 databricks-sdk-go/0.42.0 go/1.21.10 os/linux cmd/bundle_validate auth/azure-client-secret cicd/github
- X-Databricks-Azure-Sp-Management-Token: ** < HTTP/2.0 403 Forbidden < Content-Length: 20 < Content-Type: text/html; charset=utf-8 < Date: Fri, 18 Oct 2024 11:50:48 GMT < Server: databricks < X-Request-Id: 940220c3-7195-4928-bee8-29f1c14e8b20 < User not authorized.
Error: Process completed with exit code 1.
Description When using the terraform databricks provider (version 1.39.0) we have quite regularly but not always this error popping up when planning or applying code. We have upgraded our databricks provider recently so I guess it is introduced in one of these later versions.
Seems related to issue #883 .
Reproduction Just using the
databricks_workspace_conf
resourceExpected behavior No error
Is it a regression? It is a new issue to us, so my take is that this is indeed a regression.
Other Information
Debug Logs Turning on the debug logs is a bit difficult when you don't know when the issue appears. But this is the already pretty verbose error message that you get:
│ Error: cannot read workspace conf: unexpected error handling request: invalid character 'S' looking for beginning of value. This is likely a bug in the Databricks SDK for Go or the underlying REST API. Please report this issue with the following debugging information to the SDK issue tracker at https://github.com/databricks/databricks-sdk-go/issues. Request log: │
│ GET /api/2.0/workspace-conf?keys=enableDbfsFileBrowser,enableDcs,enforceWorkspaceViewAcls,enableIpAccessLists,enableResultsDownloading,enableUploadDataUis,enableWebTerminal,enableExportNotebook,storeInteractiveNotebookResultsInCustomerAccount,enforceClusterViewAcls,enableJobViewAcls │ > * Host: │ > * Accept: application/json │ > * Authorization: REDACTED │ > * User-Agent: databricks-tf-provider/1.39.0 databricks-sdk-go/0.37.0 go/1.21.8 os/darwin terraform/1.5.7 resource/workspace_conf auth/azure-cli │ > * X-Databricks-Azure-Sp-Management-Token: eyJ0eXAiOiJKV1QiLCJhbGc... (1086 more bytes) │ > * X-Databricks-Azure-Workspace-Resource-Id: /subscriptions/xxxxxx/resourceGroups/xxxxxxxx/providers/Microsoft.Databricks/workspaces/xxxxxx │ < HTTP/2.0 400 Bad Request │ < * Content-Type: application/json │ < * Date: Wed, 17 Apr 2024 13:36:52 GMT │ < * Server: databricks │ < * Strict-Transport-Security: max-age=31536000; includeSubDomains; preload │ < * Vary: Accept-Encoding │ < * X-Content-Type-Options: nosniff │ < * X-Databricks-Org-Id: 67013894097440 │ < Status: 400 │ < Description: Decoder failure │ < │
│ │ with module.dbx_ws_conf[0].databricks_workspace_conf.this, │ on ../../core/databricks/modules/workspace-config/main.tf line 3, in resource "databricks_workspace_conf" "this": │ 3: resource "databricks_workspace_conf" "this" {