search

GoogleCloudPlatform / terraformer

CLI tool to generate terraform files from existing infrastructure (reverse Terraform). Infrastructure to Code
Apache License 2.0
12.42k stars 1.63k forks source link

Can't import kms keys from GCP #694

Closed SalvaFiorenza8 closed 3 years ago

SalvaFiorenza8 commented 3 years ago

Hi, I’m using this combination

terraform v0.13.2 terraform-provider-google v3.35.0 terraformer v0.8.9

Unfortunately, I'm unable to import KMS keys, every time I try, I receive this message

terraformer import google --projects my-project-id --resources kms --regions us-west1
2020/12/01 22:46:18 google importing project my-project-id region us-west1
2020/12/01 22:46:19 google importing... kms
2020/12/01 22:46:20 Refreshing state... google_kms_crypto_key.tfer--my-002D-project-002D-id_global_berglas_berglas-002D-key
2020/12/01 22:46:20 Refreshing state... google_kms_key_ring.tfer--global_berglas
2020/12/01 22:46:20 ERROR: Read resource response is null for resource google_kms_crypto_key.tfer--my-002D-project-002D-id_global_berglas_berglas-002D-key
2020/12/01 22:46:20 ERROR: Unable to refresh resource tfer--my-002D-project-002D-id_global_berglas_berglas-002D-key
2020/12/01 22:46:20 google Connecting.... 
2020/12/01 22:46:20 google save kms
2020/12/01 22:46:20 google save tfstate for kms

Using the --verbose flag, I can collect this additional info:

terraformer import google --projects my-project-id --resources kms --regions us-west1 --verbose
2020/12/01 22:52:29 google importing project my-project-id region us-west1
2020-12-01T22:52:30.626Z [INFO]  plugin: configuring client automatic mTLS
2020-12-01T22:52:30.672Z [DEBUG] plugin: starting plugin: path=.terraform/plugins/registry.terraform.io/hashicorp/google/3.35.0/linux_amd64/terraform-provider-google_v3.35.0_x5 args=[.terraform/plugins/registry.terraform.io/hashicorp/google/3.35.0/linux_amd64/terraform-provider-google_v3.35.0_x5]
2020-12-01T22:52:30.675Z [DEBUG] plugin: plugin started: path=.terraform/plugins/registry.terraform.io/hashicorp/google/3.35.0/linux_amd64/terraform-provider-google_v3.35.0_x5 pid=13
2020-12-01T22:52:30.676Z [DEBUG] plugin: waiting for RPC address: path=.terraform/plugins/registry.terraform.io/hashicorp/google/3.35.0/linux_amd64/terraform-provider-google_v3.35.0_x5
2020-12-01T22:52:31.112Z [INFO]  plugin.terraform-provider-google_v3.35.0_x5: configuring server automatic mTLS: timestamp=2020-12-01T22:52:31.112Z
2020-12-01T22:52:31.168Z [DEBUG] plugin: using plugin: version=5
2020-12-01T22:52:31.169Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: plugin address: address=/tmp/plugin468518236 network=unix timestamp=2020-12-01T22:52:31.168Z
2020-12-01T22:52:31.255Z [TRACE] plugin.stdio: waiting for stdio data
2020-12-01T22:52:31.261Z [WARN]  plugin.stdio: received EOF, stopping recv loop: err="rpc error: code = Unimplemented desc = unknown service plugin.GRPCStdio"
2020-12-01T22:52:31.369Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:31 [INFO] Authenticating using DefaultClient...
2020-12-01T22:52:31.369Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:31 [INFO]   -- Scopes: [https://www.googleapis.com/auth/compute https://www.googleapis.com/auth/cloud-platform https://www.googleapis.com/auth/cloud-identity https://www.googleapis.com/auth/ndev.clouddns.readwrite https://www.googleapis.com/auth/devstorage.full_control https://www.googleapis.com/auth/userinfo.email]
2020-12-01T22:52:31.374Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:31 [INFO] Instantiating GCE client for path https://www.googleapis.com/compute/v1/projects/
2020-12-01T22:52:31.376Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:31 [INFO] Instantiating GCE Beta client for path https://www.googleapis.com/compute/beta/projects/
2020-12-01T22:52:31.376Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:31 [INFO] Instantiating GKE client for path https://container.googleapis.com/
2020-12-01T22:52:31.383Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:31 [INFO] Instantiating GKE Beta client for path https://container.googleapis.com/
2020-12-01T22:52:31.385Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:31 [INFO] Instantiating Google Cloud DNS client for path https://www.googleapis.com/dns/v1/projects/
2020-12-01T22:52:31.387Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:31 [INFO] Instantiating Google Cloud DNS Beta client for path https://www.googleapis.com/dns/v1beta2/projects/
2020-12-01T22:52:31.389Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:31 [INFO] Instantiating Google Cloud KMS client for path https://cloudkms.googleapis.com/
2020-12-01T22:52:31.390Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:31 [INFO] Instantiating Google Stackdriver Logging client for path https://logging.googleapis.com/
2020-12-01T22:52:31.395Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:31 [INFO] Instantiating Google Storage client for path https://www.googleapis.com/storage/v1/
2020-12-01T22:52:31.395Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:31 [INFO] Instantiating Google SqlAdmin client for path https://sqladmin.googleapis.com/
2020-12-01T22:52:31.396Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:31 [INFO] Instantiating Google Pubsub client for path https://pubsub.googleapis.com/
2020-12-01T22:52:31.400Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:31 [INFO] Instantiating Google Dataflow client for path https://dataflow.googleapis.com/
2020-12-01T22:52:31.404Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:31 [INFO] Instantiating Google Cloud ResourceManager client for path https://cloudresourcemanager.googleapis.com/
2020-12-01T22:52:31.405Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:31 [INFO] Instantiating Google Cloud ResourceManager V client for path https://cloudresourcemanager.googleapis.com/
2020-12-01T22:52:31.405Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:31 [INFO] Instantiating Google Cloud Runtimeconfig client for path https://runtimeconfig.googleapis.com/
2020-12-01T22:52:31.407Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:31 [INFO] Instantiating Google Cloud IAM client for path https://iam.googleapis.com/
2020-12-01T22:52:31.410Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:31 [INFO] Instantiating Google Cloud IAMCredentials client for path https://iamcredentials.googleapis.com/
2020-12-01T22:52:31.410Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:31 [INFO] Instantiating Google Cloud Service Management client for path https://servicemanagement.googleapis.com/
2020-12-01T22:52:31.411Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:31 [INFO] Instantiating Google Cloud Service Usage client for path https://serviceusage.googleapis.com/
2020-12-01T22:52:31.416Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:31 [INFO] Instantiating Google Cloud Billing client for path https://cloudbilling.googleapis.com/
2020-12-01T22:52:31.418Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:31 [INFO] Instantiating Google Cloud Build client for path https://cloudbuild.googleapis.com/
2020-12-01T22:52:31.419Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:31 [INFO] Instantiating Google Cloud BigQuery client for path https://www.googleapis.com/bigquery/v2/
2020-12-01T22:52:31.421Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:31 [INFO] Instantiating Google Cloud CloudFunctions Client for path https://cloudfunctions.googleapis.com/
2020-12-01T22:52:31.421Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:31 [INFO] Instantiating Google Cloud BigtableAdmin for path https://bigtableadmin.googleapis.com/
2020-12-01T22:52:31.422Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:31 [INFO] Instantiating Google Cloud Source Repo client for path https://sourcerepo.googleapis.com/
2020-12-01T22:52:31.422Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:31 [INFO] Instantiating Google Cloud Spanner client for path https://spanner.googleapis.com/
2020-12-01T22:52:31.424Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:31 [INFO] Instantiating Google Cloud Dataproc client for path https://dataproc.googleapis.com/
2020-12-01T22:52:31.425Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:31 [INFO] Instantiating Google Cloud Dataproc Beta client for path https://dataproc.googleapis.com/
2020-12-01T22:52:31.427Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:31 [INFO] Instantiating Filestore client for path https://file.googleapis.com/
2020-12-01T22:52:31.429Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:31 [INFO] Instantiating Google Cloud IoT Core client for path 
2020-12-01T22:52:31.431Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:31 [INFO] Instantiating App Engine client for path https://appengine.googleapis.com/
2020-12-01T22:52:31.431Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:31 [INFO] Instantiating Cloud Composer client for path https://composer.googleapis.com/
2020-12-01T22:52:31.431Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:31 [INFO] Instantiating Service Networking client for path https://servicenetworking.googleapis.com/
2020-12-01T22:52:31.432Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:31 [INFO] Instantiating Google Cloud Storage Transfer client for path https://storagetransfer.googleapis.com/
2020-12-01T22:52:31.435Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:31 [INFO] Instantiating Google Cloud Healthcare client for path https://healthcare.googleapis.com/
2020/12/01 22:52:31 google importing... kms
2020/12/01 22:52:31 Refreshing state... google_kms_crypto_key.tfer--my-002D-project-002D-id_global_berglas_berglas-002D-key
2020/12/01 22:52:31 Refreshing state... google_kms_key_ring.tfer--global_berglas
2020-12-01T22:52:31.911Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:31 [DEBUG] Waiting for state to become: [success]
2020-12-01T22:52:31.911Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:31 [DEBUG] Waiting for state to become: [success]
2020-12-01T22:52:31.918Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:31 [DEBUG] Retry Transport: starting RoundTrip retry loop
2020-12-01T22:52:31.918Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:31 [DEBUG] Retry Transport: request attempt 0
2020-12-01T22:52:31.918Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:31 [DEBUG] Retry Transport: starting RoundTrip retry loop
2020-12-01T22:52:31.918Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:31 [DEBUG] Retry Transport: request attempt 0
2020-12-01T22:52:32.496Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:32 [DEBUG] Retry Transport: Stopping retries, last request failed with non-retryable error: googleapi: got HTTP response code 404 with body: HTTP/1.1 404 Not Found
2020-12-01T22:52:32.496Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: Connection: close
2020-12-01T22:52:32.497Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: Content-Length: 1669
2020-12-01T22:52:32.498Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: Alt-Svc: h3-29=":443"; ma=2592000,h3-T051=":443"; ma=2592000,h3-Q050=":443"; ma=2592000,h3-Q046=":443"; ma=2592000,h3-Q043=":443"; ma=2592000,quic=":443"; ma=2592000; v="46,43"
2020-12-01T22:52:32.500Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: Content-Type: text/html; charset=UTF-8
2020-12-01T22:52:32.500Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: Date: Tue, 01 Dec 2020 22:52:32 GMT
2020-12-01T22:52:32.500Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: Server: ESF
2020-12-01T22:52:32.500Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: X-Content-Type-Options: nosniff
2020-12-01T22:52:32.500Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: X-Frame-Options: SAMEORIGIN
2020-12-01T22:52:32.500Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: X-Xss-Protection: 0
2020-12-01T22:52:32.500Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 
2020-12-01T22:52:32.500Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: <!DOCTYPE html>
2020-12-01T22:52:32.500Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: <html lang=en>
2020-12-01T22:52:32.500Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5:   <meta charset=utf-8>
2020-12-01T22:52:32.500Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5:   <meta name=viewport content="initial-scale=1, minimum-scale=1, width=device-width">
2020-12-01T22:52:32.500Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5:   <title>Error 404 (Not Found)!!1</title>
2020-12-01T22:52:32.500Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5:   <style>
2020-12-01T22:52:32.501Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5:     *{margin:0;padding:0}html,code{font:15px/22px arial,sans-serif}html{background:#fff;color:#222;padding:15px}body{margin:7% auto 0;max-width:390px;min-height:180px;padding:30px 0 15px}* > body{background:url(//www.google.com/images/errors/robot.png) 100% 5px no-repeat;padding-right:205px}p{margin:11px 0 22px;overflow:hidden}ins{color:#777;text-decoration:none}a img{border:0}@media screen and (max-width:772px){body{background:none;margin-top:0;max-width:none;padding-right:0}}#logo{background:url(//www.google.com/images/branding/googlelogo/1x/googlelogo_color_150x54dp.png) no-repeat;margin-left:-5px}@media only screen and (min-resolution:192dpi){#logo{background:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png) no-repeat 0% 0%/100% 100%;-moz-border-image:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png) 0}}@media only screen and (-webkit-min-device-pixel-ratio:2){#logo{background:url(//www.google.com/images/branding/googlelogo/2x/googlelogo_color_150x54dp.png) no-repeat;-webkit-background-size:100% 100%}}#logo{display:inline-block;height:54px;width:150px}
2020-12-01T22:52:32.501Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5:   </style>
2020-12-01T22:52:32.501Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5:   <a href=//www.google.com/><span id=logo aria-label=Google></span></a>
2020-12-01T22:52:32.501Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5:   <p><b>404.</b> <ins>That’s an error.</ins>
2020-12-01T22:52:32.501Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5:   <p>The requested URL <code>/v1//cryptoKeys/projects/my-project-id/locations/global/keyRings/berglas/cryptoKeys/berglas-key?alt=json</code> was not found on this server.  <ins>That’s all we know.</ins>
2020-12-01T22:52:32.501Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:32 [DEBUG] Retry Transport: Returning after 1 attempts
2020-12-01T22:52:32.501Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:32 [WARN] Removing KMSCryptoKey "projects/my-project-id/locations/global/keyRings/berglas/cryptoKeys/berglas-key" because it's gone
2020/12/01 22:52:32 ERROR: Read resource response is null for resource google_kms_crypto_key.tfer--my-002D-project-002D-id_global_berglas_berglas-002D-key
2020-12-01T22:52:32.542Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:32 [DEBUG] Retry Transport: Stopping retries, last request was successful
2020-12-01T22:52:32.542Z [DEBUG] plugin.terraform-provider-google_v3.35.0_x5: 2020/12/01 22:52:32 [DEBUG] Retry Transport: Returning after 1 attempts
2020/12/01 22:52:32 ERROR: Unable to refresh resource tfer--my-002D-project-002D-id_global_berglas_berglas-002D-key
2020/12/01 22:52:32 google Connecting.... 
2020/12/01 22:52:32 google save kms
2020/12/01 22:52:32 google save tfstate for kms
2020-12-01T22:52:32.579Z [DEBUG] plugin: plugin process exited: path=.terraform/plugins/registry.terraform.io/hashicorp/google/3.35.0/linux_amd64/terraform-provider-google_v3.35.0_x5 pid=13
2020-12-01T22:52:32.579Z [DEBUG] plugin: plugin exited

That looks like is implying that some GCP URLs are broken, sadly, I'm not sure if that's the real cause or how to fix the issue on the tool.

github-actions[bot] commented 3 years ago

This issue is stale because it has been open 60 days with no activity. Remove stale label or comment or this will be closed in 7 days.

github-actions[bot] commented 3 years ago

This issue was closed because it has been stalled for 7 days with no activity.

cikupin commented 2 years ago

up