search

wandb / terraform-google-dagster

17 stars 1 forks source link

[cluster]: Error: googleapi: Error 400: Generic::not_found: account cannot be found. #18

Closed gofford closed 9 months ago

gofford commented 9 months ago

Hey 👋. This looks like a super useful module so thanks for developing it. I'm a keen believer that wheels shouldn't be reinvented so I am trying to use this module as part of a POC of Dagster on GCP.

As a starting point I am deploying the example-app as-is into my project -- no changes other than the default variables. It mostly works, but I am hitting problems with the cluster. Relevant outputs are below.

My terraform.tfvars:

project_id = "my-redacted-project"
region = "europe-west2"
zone = "europe-west2-a"
namespace = "dagster"
DEBUG Excerpt

> 2024-01-15T16:35:35.834Z [INFO] provider.terraform-provider-google_v4.84.0_x5: Authenticating using DefaultClient...: tf_provider_addr=registry.terraform.io/hashicorp/google tf_rpc=ConfigureProvider @caller=github.com/hashicorp/terraform-provider-google/google/fwtransport/framework_config.go:1701 @module=google tf_mux_provider=*proto5server.Server tf_req_id=352bc560-016d-d500-05d3-5b44699018ae timestamp=2024-01-15T16:35:35.834Z > 2024-01-15T16:35:35.834Z [INFO] provider.terraform-provider-google_v4.84.0_x5: -- Scopes: [https://www.googleapis.com/auth/cloud-platform https://www.googleapis.com/auth/userinfo.email]: tf_req_id=352bc560-016d-d500-05d3-5b44699018ae @caller=github.com/hashicorp/terraform-provider-google/google/fwtransport/framework_config.go:1702 @module=google tf_mux_provider=*proto5server.Server tf_provider_addr=registry.terraform.io/hashicorp/google tf_rpc=ConfigureProvider timestamp=2024-01-15T16:35:35.834Z > 2024-01-15T16:35:35.834Z [INFO] provider.terraform-provider-google_v4.84.0_x5: Authenticating using DefaultClient...: @module=google tf_provider_addr=registry.terraform.io/hashicorp/google @caller=github.com/hashicorp/terraform-provider-google/google/fwtransport/framework_config.go:1701 tf_mux_provider=*proto5server.Server tf_req_id=352bc560-016d-d500-05d3-5b44699018ae tf_rpc=ConfigureProvider timestamp=2024-01-15T16:35:35.834Z > 2024-01-15T16:35:35.834Z [INFO] provider.terraform-provider-google_v4.84.0_x5: -- Scopes: [https://www.googleapis.com/auth/cloud-platform https://www.googleapis.com/auth/userinfo.email]: @module=google tf_provider_addr=registry.terraform.io/hashicorp/google tf_req_id=352bc560-016d-d500-05d3-5b44699018ae @caller=github.com/hashicorp/terraform-provider-google/google/fwtransport/framework_config.go:1702 tf_mux_provider=*proto5server.Server tf_rpc=ConfigureProvider timestamp=2024-01-15T16:35:35.834Z > 2024-01-15T16:35:35.834Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:35 [DEBUG] Waiting for state to become: [success] > 2024-01-15T16:35:36.020Z [INFO] provider.terraform-provider-google_v4.84.0_x5: Terraform is using this identity: redacted@myemail.com: tf_req_id=352bc560-016d-d500-05d3-5b44699018ae tf_rpc=ConfigureProvider @module=google tf_mux_provider=*proto5server.Server tf_provider_addr=registry.terraform.io/hashicorp/google @caller=github.com/hashicorp/terraform-provider-google/google/fwtransport/framework_config.go:1575 timestamp=2024-01-15T16:35:36.020Z > 2024-01-15T16:35:36.020Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: Called provider defined Provider Configure: @module=sdk.framework tf_provider_addr=registry.terraform.io/hashicorp/google tf_req_id=352bc560-016d-d500-05d3-5b44699018ae @caller=github.com/hashicorp/terraform-plugin-framework@v1.1.1/internal/fwserver/server_configureprovider.go:20 tf_mux_provider=*proto5server.Server tf_rpc=ConfigureProvider timestamp=2024-01-15T16:35:36.020Z > 2024-01-15T16:35:36.022Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [INFO] Authenticating using DefaultClient... > 2024-01-15T16:35:36.022Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [INFO] -- Scopes: [https://www.googleapis.com/auth/cloud-platform https://www.googleapis.com/auth/userinfo.email] > 2024-01-15T16:35:36.022Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [INFO] Authenticating using DefaultClient... > 2024-01-15T16:35:36.022Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [INFO] -- Scopes: [https://www.googleapis.com/auth/cloud-platform https://www.googleapis.com/auth/userinfo.email] > 2024-01-15T16:35:36.022Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [DEBUG] Waiting for state to become: [success] > 2024-01-15T16:35:36.112Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [INFO] Terraform is using this identity: redacted@myemail.com > 2024-01-15T16:35:36.112Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [DEBUG] parent context canceled, cleaning up batcher batches > 2024-01-15T16:35:36.112Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [DEBUG] parent context canceled, cleaning up batcher batches > 2024-01-15T16:35:36.112Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [DEBUG] Stopping batcher "Service Usage" > 2024-01-15T16:35:36.113Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [DEBUG] Stopping batcher "IAM" > 2024-01-15T16:35:36.144Z [WARN] Provider "registry.terraform.io/hashicorp/google" produced an invalid plan for module.dagster_infra.module.cluster.google_container_cluster.default, but we are tolerating it because it is using the legacy plugin SDK. > The following problems may be the cause of any confusing errors from downstream operations: > - .enable_legacy_abac: planned value cty.False for a non-computed attribute > - .enable_binary_authorization: planned value cty.False for a non-computed attribute > - .enable_kubernetes_alpha: planned value cty.False for a non-computed attribute > - .enable_shielded_nodes: planned value cty.True for a non-computed attribute > - .enable_l4_ilb_subsetting: planned value cty.False for a non-computed attribute > - .confidential_nodes: attribute representing nested block must not be unknown itself; set nested attribute values to unknown instead > - .ip_allocation_policy[0].stack_type: planned value cty.StringVal("IPV4") for a non-computed attribute > - .ip_allocation_policy[0].pod_cidr_overprovision_config: attribute representing nested block must not be unknown itself; set nested attribute values to unknown instead > - .database_encryption: attribute representing nested block must not be unknown itself; set nested attribute values to unknown instead > - .gateway_api_config: attribute representing nested block must not be unknown itself; set nested attribute values to unknown instead > - .logging_config: attribute representing nested block must not be unknown itself; set nested attribute values to unknown instead > - .mesh_certificates: attribute representing nested block must not be unknown itself; set nested attribute values to unknown instead > - .monitoring_config: attribute representing nested block must not be unknown itself; set nested attribute values to unknown instead > - .node_pool: attribute representing nested block must not be unknown itself; set nested attribute values to unknown instead > - .notification_config: attribute representing nested block must not be unknown itself; set nested attribute values to unknown instead > - .service_external_ips_config: attribute representing nested block must not be unknown itself; set nested attribute values to unknown instead > - .vertical_pod_autoscaling: attribute representing nested block must not be unknown itself; set nested attribute values to unknown instead > - .addons_config: attribute representing nested block must not be unknown itself; set nested attribute values to unknown instead > - .cluster_autoscaling: attribute representing nested block must not be unknown itself; set nested attribute values to unknown instead > - .node_config: attribute representing nested block must not be unknown itself; set nested attribute values to unknown instead > - .security_posture_config: attribute representing nested block must not be unknown itself; set nested attribute values to unknown instead > - .cost_management_config: attribute representing nested block must not be unknown itself; set nested attribute values to unknown instead > - .default_snat_status: attribute representing nested block must not be unknown itself; set nested attribute values to unknown instead > - .master_authorized_networks_config: attribute representing nested block must not be unknown itself; set nested attribute values to unknown instead > - .node_pool_auto_config: attribute representing nested block must not be unknown itself; set nested attribute values to unknown instead > - .node_pool_defaults: attribute representing nested block must not be unknown itself; set nested attribute values to unknown instead > module.dagster_infra.module.cluster.google_container_cluster.default: Creating... > 2024-01-15T16:35:36.145Z [INFO] Starting apply for module.dagster_infra.module.cluster.google_container_cluster.default > 2024-01-15T16:35:36.145Z [DEBUG] module.dagster_infra.module.cluster.google_container_cluster.default: applying the planned Create change > 2024-01-15T16:35:36.149Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [DEBUG] setting computed for "logging_config" from ComputedKeys > 2024-01-15T16:35:36.149Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [DEBUG] setting computed for "vertical_pod_autoscaling" from ComputedKeys > 2024-01-15T16:35:36.149Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [DEBUG] setting computed for "monitoring_config" from ComputedKeys > 2024-01-15T16:35:36.149Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [DEBUG] setting computed for "cost_management_config" from ComputedKeys > 2024-01-15T16:35:36.149Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [DEBUG] setting computed for "security_posture_config" from ComputedKeys > 2024-01-15T16:35:36.149Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [DEBUG] setting computed for "notification_config" from ComputedKeys > 2024-01-15T16:35:36.149Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [DEBUG] setting computed for "mesh_certificates" from ComputedKeys > 2024-01-15T16:35:36.149Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [DEBUG] setting computed for "master_authorized_networks_config" from ComputedKeys > 2024-01-15T16:35:36.149Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [DEBUG] setting computed for "default_snat_status" from ComputedKeys > 2024-01-15T16:35:36.149Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [DEBUG] setting computed for "cluster_autoscaling" from ComputedKeys > 2024-01-15T16:35:36.149Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [DEBUG] setting computed for "gateway_api_config" from ComputedKeys > 2024-01-15T16:35:36.149Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [DEBUG] setting computed for "service_external_ips_config" from ComputedKeys > 2024-01-15T16:35:36.149Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [DEBUG] setting computed for "node_pool_defaults" from ComputedKeys > 2024-01-15T16:35:36.149Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [DEBUG] setting computed for "node_pool" from ComputedKeys > 2024-01-15T16:35:36.149Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [DEBUG] setting computed for "node_locations" from ComputedKeys > 2024-01-15T16:35:36.149Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [DEBUG] setting computed for "database_encryption" from ComputedKeys > 2024-01-15T16:35:36.149Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [DEBUG] setting computed for "node_config" from ComputedKeys > 2024-01-15T16:35:36.149Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [DEBUG] setting computed for "confidential_nodes" from ComputedKeys > 2024-01-15T16:35:36.150Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [DEBUG] setting computed for "node_pool_auto_config" from ComputedKeys > 2024-01-15T16:35:36.150Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [DEBUG] setting computed for "ip_allocation_policy.0.pod_cidr_overprovision_config" from ComputedKeys > 2024-01-15T16:35:36.150Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [DEBUG] setting computed for "ip_allocation_policy.0.pod_cidr_overprovision_config" from ComputedKeys > 2024-01-15T16:35:36.150Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [DEBUG] setting computed for "addons_config" from ComputedKeys > 2024-01-15T16:35:36.150Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [INFO] Instantiating GKE client for path https://container.googleapis.com/ > 2024-01-15T16:35:36.150Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [DEBUG] Retry Transport: starting RoundTrip retry loop > 2024-01-15T16:35:36.150Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [DEBUG] Retry Transport: request attempt 0 > 2024-01-15T16:35:36.150Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [DEBUG] Google API Request Details: > 2024-01-15T16:35:36.150Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: ---[ REQUEST ]--------------------------------------- > 2024-01-15T16:35:36.150Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: GET /v1/projects/my-redacted-project/locations/europe-west2-a/clusters/dagster-cluster?alt=json&prettyPrint=false HTTP/1.1 > 2024-01-15T16:35:36.150Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: Host: container.googleapis.com > 2024-01-15T16:35:36.150Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: User-Agent: google-api-go-client/0.5 Terraform/1.5.3 (+https://www.terraform.io) Terraform-Plugin-SDK/2.10.1 terraform-provider-google/4.84.0 > 2024-01-15T16:35:36.150Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: X-Goog-Api-Client: gl-go/1.19.9 gdcl/0.139.0 > 2024-01-15T16:35:36.150Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: Accept-Encoding: gzip > 2024-01-15T16:35:36.150Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: > 2024-01-15T16:35:36.150Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: > 2024-01-15T16:35:36.150Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: ----------------------------------------------------- > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [DEBUG] Google API Response Details: > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: ---[ RESPONSE ]-------------------------------------- > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: HTTP/2.0 404 Not Found > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000 > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: Cache-Control: private > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: Content-Type: application/json; charset=UTF-8 > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: Date: Mon, 15 Jan 2024 16:35:36 GMT > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: Server: ESF > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: Vary: Origin > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: Vary: X-Origin > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: Vary: Referer > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: X-Content-Type-Options: nosniff > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: X-Frame-Options: SAMEORIGIN > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: X-Xss-Protection: 0 > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: { > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "error": { > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "code": 404, > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "message": "Not found: projects/my-redacted-project/zones/europe-west2-a/clusters/dagster-cluster.", > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "errors": [ > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: { > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "message": "Not found: projects/my-redacted-project/zones/europe-west2-a/clusters/dagster-cluster.", > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "domain": "global", > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "reason": "notFound" > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: } > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: ], > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "status": "NOT_FOUND", > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "details": [ > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: { > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "@type": "type.googleapis.com/google.rpc.RequestInfo", > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "requestId": "0xb3fa99c6560be58f" > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: } > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: ] > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: } > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: } > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: ----------------------------------------------------- > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [DEBUG] Retry Transport: Stopping retries, last request failed with non-retryable error: googleapi: got HTTP response code 404 with body: HTTP/2.0 404 Not Found > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000 > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: Cache-Control: private > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: Content-Type: application/json; charset=UTF-8 > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: Date: Mon, 15 Jan 2024 16:35:36 GMT > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: Server: ESF > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: Vary: Origin > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: Vary: X-Origin > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: Vary: Referer > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: X-Content-Type-Options: nosniff > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: X-Frame-Options: SAMEORIGIN > 2024-01-15T16:35:36.379Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: X-Xss-Protection: 0 > 2024-01-15T16:35:36.380Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: > 2024-01-15T16:35:36.380Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: { > 2024-01-15T16:35:36.380Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "error": { > 2024-01-15T16:35:36.380Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "code": 404, > 2024-01-15T16:35:36.380Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "message": "Not found: projects/my-redacted-project/zones/europe-west2-a/clusters/dagster-cluster.", > 2024-01-15T16:35:36.380Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "errors": [ > 2024-01-15T16:35:36.380Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: { > 2024-01-15T16:35:36.380Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "message": "Not found: projects/my-redacted-project/zones/europe-west2-a/clusters/dagster-cluster.", > 2024-01-15T16:35:36.380Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "domain": "global", > 2024-01-15T16:35:36.380Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "reason": "notFound" > 2024-01-15T16:35:36.380Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: } > 2024-01-15T16:35:36.380Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: ], > 2024-01-15T16:35:36.380Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "status": "NOT_FOUND", > 2024-01-15T16:35:36.380Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "details": [ > 2024-01-15T16:35:36.380Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: { > 2024-01-15T16:35:36.380Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "@type": "type.googleapis.com/google.rpc.RequestInfo", > 2024-01-15T16:35:36.380Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "requestId": "0xb3fa99c6560be58f" > 2024-01-15T16:35:36.380Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: } > 2024-01-15T16:35:36.380Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: ] > 2024-01-15T16:35:36.380Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: } > 2024-01-15T16:35:36.380Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: } > 2024-01-15T16:35:36.380Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [DEBUG] Retry Transport: Returning after 1 attempts > 2024-01-15T16:35:36.380Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [DEBUG] Locking "google-container-cluster/my-redacted-project/europe-west2-a/dagster-cluster" > 2024-01-15T16:35:36.380Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [DEBUG] Locked "google-container-cluster/my-redacted-project/europe-west2-a/dagster-cluster" > 2024-01-15T16:35:36.380Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [DEBUG] Waiting for state to become: [success] > 2024-01-15T16:35:36.380Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [INFO] Instantiating GKE client for path https://container.googleapis.com/ > 2024-01-15T16:35:36.381Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [DEBUG] Retry Transport: starting RoundTrip retry loop > 2024-01-15T16:35:36.381Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [DEBUG] Retry Transport: request attempt 0 > 2024-01-15T16:35:36.381Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [DEBUG] Google API Request Details: > 2024-01-15T16:35:36.381Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: ---[ REQUEST ]--------------------------------------- > 2024-01-15T16:35:36.381Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: POST /v1/projects/my-redacted-project/locations/europe-west2-a/clusters?alt=json&prettyPrint=false HTTP/1.1 > 2024-01-15T16:35:36.381Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: Host: container.googleapis.com > 2024-01-15T16:35:36.381Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: User-Agent: google-api-go-client/0.5 Terraform/1.5.3 (+https://www.terraform.io) Terraform-Plugin-SDK/2.10.1 terraform-provider-google/4.84.0 > 2024-01-15T16:35:36.381Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: Content-Length: 1272 > 2024-01-15T16:35:36.381Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: Content-Type: application/json > 2024-01-15T16:35:36.381Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: X-Goog-Api-Client: gl-go/1.19.9 gdcl/0.139.0 > 2024-01-15T16:35:36.381Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: Accept-Encoding: gzip > 2024-01-15T16:35:36.381Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: > 2024-01-15T16:35:36.381Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: { > 2024-01-15T16:35:36.381Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "cluster": { > 2024-01-15T16:35:36.381Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "authenticatorGroupsConfig": { > 2024-01-15T16:35:36.381Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "enabled": true, > 2024-01-15T16:35:36.381Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "securityGroup": "gke-security-groups@example.com" > 2024-01-15T16:35:36.381Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: }, > 2024-01-15T16:35:36.381Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "autopilot": { > 2024-01-15T16:35:36.381Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "enabled": false > 2024-01-15T16:35:36.381Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: }, > 2024-01-15T16:35:36.381Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "autoscaling": { > 2024-01-15T16:35:36.381Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "enableNodeAutoprovisioning": false > 2024-01-15T16:35:36.381Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: }, > 2024-01-15T16:35:36.381Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "binaryAuthorization": { > 2024-01-15T16:35:36.381Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "enabled": false > 2024-01-15T16:35:36.381Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: }, > 2024-01-15T16:35:36.381Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "initialNodeCount": 1, > 2024-01-15T16:35:36.381Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "ipAllocationPolicy": { > 2024-01-15T16:35:36.381Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "clusterIpv4CidrBlock": "/14", > 2024-01-15T16:35:36.382Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "servicesIpv4CidrBlock": "/19", > 2024-01-15T16:35:36.382Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "stackType": "IPV4", > 2024-01-15T16:35:36.382Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "useIpAliases": true > 2024-01-15T16:35:36.382Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: }, > 2024-01-15T16:35:36.382Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "legacyAbac": { > 2024-01-15T16:35:36.382Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "enabled": false > 2024-01-15T16:35:36.382Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: }, > 2024-01-15T16:35:36.382Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "maintenancePolicy": { > 2024-01-15T16:35:36.382Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "window": {} > 2024-01-15T16:35:36.382Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: }, > 2024-01-15T16:35:36.382Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "masterAuth": { > 2024-01-15T16:35:36.382Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "clientCertificateConfig": {} > 2024-01-15T16:35:36.382Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: }, > 2024-01-15T16:35:36.382Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "masterAuthorizedNetworksConfig": {}, > 2024-01-15T16:35:36.382Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "name": "dagster-cluster", > 2024-01-15T16:35:36.382Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "network": "projects/my-redacted-project/global/networks/dagster-vpc", > 2024-01-15T16:35:36.382Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "networkConfig": {}, > 2024-01-15T16:35:36.382Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "networkPolicy": {}, > 2024-01-15T16:35:36.382Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "nodeConfig": { > 2024-01-15T16:35:36.382Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "oauthScopes": [ > 2024-01-15T16:35:36.382Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "https://www.googleapis.com/auth/devstorage.read_only", > 2024-01-15T16:35:36.382Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "https://www.googleapis.com/auth/logging.write", > 2024-01-15T16:35:36.382Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "https://www.googleapis.com/auth/monitoring", > 2024-01-15T16:35:36.382Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "https://www.googleapis.com/auth/service.management.readonly", > 2024-01-15T16:35:36.382Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "https://www.googleapis.com/auth/servicecontrol", > 2024-01-15T16:35:36.382Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "https://www.googleapis.com/auth/trace.append" > 2024-01-15T16:35:36.382Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: ] > 2024-01-15T16:35:36.382Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: }, > 2024-01-15T16:35:36.382Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "notificationConfig": { > 2024-01-15T16:35:36.382Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "pubsub": {} > 2024-01-15T16:35:36.382Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: }, > 2024-01-15T16:35:36.382Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "releaseChannel": { > 2024-01-15T16:35:36.382Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "channel": "STABLE" > 2024-01-15T16:35:36.382Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: }, > 2024-01-15T16:35:36.382Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "shieldedNodes": { > 2024-01-15T16:35:36.382Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "enabled": true > 2024-01-15T16:35:36.382Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: }, > 2024-01-15T16:35:36.382Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "subnetwork": "projects/my-redacted-project/regions/europe-west2/subnetworks/dagster-subnet", > 2024-01-15T16:35:36.382Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "workloadIdentityConfig": { > 2024-01-15T16:35:36.382Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "workloadPool": "my-redacted-project.svc.id.goog" > 2024-01-15T16:35:36.382Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: } > 2024-01-15T16:35:36.382Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: } > 2024-01-15T16:35:36.382Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: } > 2024-01-15T16:35:36.382Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: > 2024-01-15T16:35:36.382Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: ----------------------------------------------------- > 2024-01-15T16:35:36.588Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [DEBUG] Google API Response Details: > 2024-01-15T16:35:36.588Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: ---[ RESPONSE ]-------------------------------------- > 2024-01-15T16:35:36.588Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: HTTP/2.0 400 Bad Request > 2024-01-15T16:35:36.588Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000 > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: Cache-Control: private > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: Content-Type: application/json; charset=UTF-8 > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: Date: Mon, 15 Jan 2024 16:35:36 GMT > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: Server: ESF > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: Vary: Origin > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: Vary: X-Origin > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: Vary: Referer > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: X-Content-Type-Options: nosniff > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: X-Frame-Options: SAMEORIGIN > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: X-Xss-Protection: 0 > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: { > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "error": { > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "code": 400, > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "message": "Generic::not_found: account cannot be found.", > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "errors": [ > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: { > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "message": "Generic::not_found: account cannot be found.", > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "domain": "global", > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "reason": "badRequest" > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: } > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: ], > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "status": "INVALID_ARGUMENT", > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "details": [ > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: { > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "@type": "type.googleapis.com/google.rpc.RequestInfo", > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "requestId": "0xcae837e2891e1117" > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: } > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: ] > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: } > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: } > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: ----------------------------------------------------- > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [DEBUG] Retry Transport: Stopping retries, last request failed with non-retryable error: googleapi: got HTTP response code 400 with body: HTTP/2.0 400 Bad Request > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000 > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: Cache-Control: private > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: Content-Type: application/json; charset=UTF-8 > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: Date: Mon, 15 Jan 2024 16:35:36 GMT > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: Server: ESF > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: Vary: Origin > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: Vary: X-Origin > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: Vary: Referer > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: X-Content-Type-Options: nosniff > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: X-Frame-Options: SAMEORIGIN > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: X-Xss-Protection: 0 > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: { > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "error": { > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "code": 400, > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "message": "Generic::not_found: account cannot be found.", > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "errors": [ > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: { > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "message": "Generic::not_found: account cannot be found.", > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "domain": "global", > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "reason": "badRequest" > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: } > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: ], > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "status": "INVALID_ARGUMENT", > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "details": [ > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: { > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "@type": "type.googleapis.com/google.rpc.RequestInfo", > 2024-01-15T16:35:36.589Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: "requestId": "0xcae837e2891e1117" > 2024-01-15T16:35:36.590Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: } > 2024-01-15T16:35:36.590Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: ] > 2024-01-15T16:35:36.590Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: } > 2024-01-15T16:35:36.590Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: } > 2024-01-15T16:35:36.590Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [DEBUG] Retry Transport: Returning after 1 attempts > 2024-01-15T16:35:36.590Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [DEBUG] Unlocking "google-container-cluster/my-redacted-project/europe-west2-a/dagster-cluster" > 2024-01-15T16:35:36.590Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [DEBUG] Unlocked "google-container-cluster/my-redacted-project/europe-west2-a/dagster-cluster" > 2024-01-15T16:35:36.590Z [ERROR] provider.terraform-provider-google_v4.84.0_x5: Response contains error diagnostic: tf_provider_addr=registry.terraform.io/hashicorp/google @caller=github.com/hashicorp/terraform-plugin-go@v0.14.3/tfprotov5/internal/diag/diagnostics.go:55 diagnostic_summary="googleapi: Error 400: Generic::not_found: account cannot be found. > Details: > [ > { > "@type": "type.googleapis.com/google.rpc.RequestInfo", > "requestId": "0xcae837e2891e1117" > } > ] > , badRequest" diagnostic_detail= diagnostic_severity=ERROR tf_proto_version=5.3 tf_req_id=fedba1ce-9188-daf8-e893-447b249368ba tf_resource_type=google_container_cluster @module=sdk.proto tf_rpc=ApplyResourceChange timestamp=2024-01-15T16:35:36.589Z > 2024-01-15T16:35:36.617Z [DEBUG] State storage *statemgr.Filesystem declined to persist a state snapshot > 2024-01-15T16:35:36.617Z [ERROR] vertex "module.dagster_infra.module.cluster.google_container_cluster.default" error: googleapi: Error 400: Generic::not_found: account cannot be found. > Details: > [ > { > "@type": "type.googleapis.com/google.rpc.RequestInfo", > "requestId": "0xcae837e2891e1117" > } > ] > , badRequest > ╷ > │ Error: googleapi: Error 400: Generic::not_found: account cannot be found. > │ Details: > │ [ > │ { > │ "@type": "type.googleapis.com/google.rpc.RequestInfo", > │ "requestId": "0xcae837e2891e1117" > │ } > │ ] > │ , badRequest > │ > │ with module.dagster_infra.module.cluster.google_container_cluster.default, > │ on .terraform/modules/dagster_infra/modules/cluster/main.tf line 12, in resource "google_container_cluster" "default": > │ 12: resource "google_container_cluster" "default" { > │ > ╵ > 2024-01-15T16:35:36.643Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [DEBUG] [transport] [server-transport 0xc0016981a0] Closing: Server.Stop called > 2024-01-15T16:35:36.643Z [DEBUG] provider.terraform-provider-google_v4.84.0_x5: 2024/01/15 16:35:36 [DEBUG] [transport] [server-transport 0xc0016981a0] loopyWriter exiting with error: transport closed by client > 2024-01-15T16:35:36.643Z [DEBUG] provider.stdio: received EOF, stopping recv loop: err="rpc error: code = Unavailable desc = error reading from server: EOF" > 2024-01-15T16:35:36.648Z [DEBUG] provider: plugin process exited: path=.terraform/providers/registry.terraform.io/hashicorp/google/4.84.0/darwin_amd64/terraform-provider-google_v4.84.0_x5 pid=50262 > 2024-01-15T16:35:36.648Z [DEBUG] provider: plugin exited

My questions here are:

I'm authing with ADC as normal (default scopes) and all of the other API interactions in both this module and my own ones work as expected, so I'm at a loss as to what is causing this for this specific resource in this module only. I can't see anything obvious in the module defs or my vars so I just wanted to check here before I go down the rabbit hole of spinning up a standalone cluster external of this module.

Let me know if you need any more info. Thanks!

chrishiste commented 9 months ago

Hey there @gofford ! 👋

I'm glad to hear you're exploring Dagster on GCP and using our module for your POC. It's always great to see efforts in utilizing existing resources.

Regarding the issue you're encountering with the cluster, it's important to note that while we open-sourced this code a while back, it's not entirely plug-and-play in its current state. There's a significant amount of configuration and setup in our private modules that isn't publicly available. This includes crucial components like the helm config, Kubernetes ingresses, service accounts, DNS configurations, and more. These elements are vital for the module to function.

Given that we're currently at a crunch period, nearing the end of our quarter, our capacity to assist is quite limited. However, we definitely understand the importance of your work and are open to supporting you. We could potentially look into helping you out in a couple of weeks when things are a bit less hectic on our end.

In the meantime, I'd suggest exploring the possibility of manually setting up some of these components, or investigating other solutions that could meet your immediate requirements. If you have any specific questions or need more detailed information, please don't hesitate to comment on this thread. We're here to help as much as we can!

Best of luck with your project! 🚀

gofford commented 9 months ago

Hey @chrishiste - thanks for the response! I eventually figured out what the issue was, although have not yet figured out why it was an issue. Disabling/removing authenticator_groups_config in the cluster module allows a clean deploy as-is which is a good starting point for future config.

I definitely agree with you on the additional config. Either way, this module, even in it's non plug-and-play state, is very useful.

Given that the issue I raised above is resolved with some additional config I'll close this out as a config problem. Thanks for the hard work 💪