Closed rkamisetti792 closed 11 months ago
Can you share the debug log to understand what's going on ?
2020/05/05 10:31:51 [DEBUG] New state was assigned lineage "5d5b6816-2d81-e862-7cd3-16cc8e32bdc3"
2020/05/05 10:31:51 [DEBUG] checking for provider in "."
2020/05/05 10:31:51 [DEBUG] checking for provider in "C:\terraform"
2020/05/05 10:31:51 [DEBUG] checking for provider in ".terraform\plugins\windows_amd64"
2020/05/05 10:31:51 [DEBUG] found provider "terraform-provider-google_v3.19.0_x5.exe"
2020/05/05 10:31:51 [DEBUG] found valid plugin: "google", "3.19.0", "C:\storagetransfer\storage-transfer-terraform\storage-transfer-terraform\.terraform\plugins\windows_amd64\terraform-provider-google_v3.19.0_x5.exe"
2020/05/05 10:31:51 [DEBUG] checking for provisioner in "."
2020/05/05 10:31:51 [DEBUG] checking for provisioner in "C:\terraform"
2020/05/05 10:31:51 [DEBUG] checking for provisioner in ".terraform\plugins\windows_amd64"
2020/05/05 10:31:51 [INFO] backend/local: starting Apply operation
2020-05-05T10:32:03.126+0530 [INFO] plugin: configuring client automatic mTLS
2020-05-05T10:32:03.156+0530 [DEBUG] plugin: starting plugin: path=C:\storagetransfer\storage-transfer-terraform\storage-transfer-terraform.terraform\plugins\windows_amd64\terraform-provider-google_v3.19.0_x5.exe args=[C:\storagetransfer\storage-transfer-terraform\storage-transfer-terraform.terraform\plugins\windows_amd64\terraform-provider-google_v3.19.0_x5.exe]
2020-05-05T10:32:03.461+0530 [DEBUG] plugin: plugin started: path=C:\storagetransfer\storage-transfer-terraform\storage-transfer-terraform.terraform\plugins\windows_amd64\terraform-provider-google_v3.19.0_x5.exe pid=11824
2020-05-05T10:32:03.461+0530 [DEBUG] plugin: waiting for RPC address: path=C:\storagetransfer\storage-transfer-terraform\storage-transfer-terraform.terraform\plugins\windows_amd64\terraform-provider-google_v3.19.0_x5.exe
2020-05-05T10:32:03.528+0530 [INFO] plugin.terraform-provider-google_v3.19.0_x5.exe: configuring server automatic mTLS: timestamp=2020-05-05T10:32:03.527+0530
2020-05-05T10:32:03.574+0530 [DEBUG] plugin: using plugin: version=5
2020-05-05T10:32:03.574+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: plugin address: address=127.0.0.1:10000 network=tcp timestamp=2020-05-05T10:32:03.574+0530
2020-05-05T10:32:03.685+0530 [DEBUG] plugin: plugin process exited: path=C:\storagetransfer\storage-transfer-terraform\storage-transfer-terraform.terraform\plugins\windows_amd64\terraform-provider-google_v3.19.0_x5.exe pid=11824
2020-05-05T10:32:03.685+0530 [DEBUG] plugin: plugin exited
2020/05/05 10:32:03 [INFO] terraform: building graph: GraphTypeValidate
2020/05/05 10:32:03 [DEBUG] ProviderTransformer: "google_storage_bucket_iam_member.gcs-iam-service-account-role" (terraform.NodeValidatableResource) needs provider.google
2020/05/05 10:32:03 [DEBUG] ProviderTransformer: "google_storage_transfer_job.s3-bucket-migration-gcs-bucket" (terraform.NodeValidatableResource) needs provider.google
2020/05/05 10:32:03 [DEBUG] ProviderTransformer: "data.google_storage_transfer_project_service_account.default" (terraform.NodeValidatableResource) needs provider.google
2020/05/05 10:32:03 [DEBUG] ProviderTransformer: "google_storage_bucket.gcp-bucket" (terraform.NodeValidatableResource) needs provider.google
2020/05/05 10:32:03 [DEBUG] ReferenceTransformer: "google_storage_bucket_iam_member.gcs-iam-service-account-role" references: [google_storage_bucket.gcp-bucket google_storage_bucket.gcp-bucket data.google_storage_transfer_project_service_account.default]
2020/05/05 10:32:03 [DEBUG] ReferenceTransformer: "google_storage_transfer_job.s3-bucket-migration-gcs-bucket" references: [google_storage_bucket_iam_member.gcs-iam-service-account-role var.project var.aws_s3_bucket var.aws_secret_key var.aws_access_key google_storage_bucket.gcp-bucket]
2020/05/05 10:32:03 [DEBUG] ReferenceTransformer: "data.google_storage_transfer_project_service_account.default" references: [var.project]
2020/05/05 10:32:03 [DEBUG] ReferenceTransformer: "var.region" references: []
2020/05/05 10:32:03 [DEBUG] ReferenceTransformer: "var.service_account" references: []
2020/05/05 10:32:03 [DEBUG] ReferenceTransformer: "var.aws_access_key" references: []
2020/05/05 10:32:03 [DEBUG] ReferenceTransformer: "var.aws_secret_key" references: []
2020/05/05 10:32:03 [DEBUG] ReferenceTransformer: "provider.google" references: [var.project var.region]
2020/05/05 10:32:03 [DEBUG] ReferenceTransformer: "google_storage_bucket.gcp-bucket" references: [var.project var.gcs_bucket_name]
2020/05/05 10:32:03 [DEBUG] ReferenceTransformer: "var.project" references: []
2020/05/05 10:32:03 [DEBUG] ReferenceTransformer: "var.aws_s3_bucket" references: []
2020/05/05 10:32:03 [DEBUG] ReferenceTransformer: "var.gcs_bucket_name" references: []
2020/05/05 10:32:03 [DEBUG] Starting graph walk: walkValidate
2020-05-05T10:32:03.689+0530 [INFO] plugin: configuring client automatic mTLS
2020-05-05T10:32:03.719+0530 [DEBUG] plugin: starting plugin: path=C:\storagetransfer\storage-transfer-terraform\storage-transfer-terraform.terraform\plugins\windows_amd64\terraform-provider-google_v3.19.0_x5.exe args=[C:\storagetransfer\storage-transfer-terraform\storage-transfer-terraform.terraform\plugins\windows_amd64\terraform-provider-google_v3.19.0_x5.exe]
2020-05-05T10:32:04.016+0530 [DEBUG] plugin: plugin started: path=C:\storagetransfer\storage-transfer-terraform\storage-transfer-terraform.terraform\plugins\windows_amd64\terraform-provider-google_v3.19.0_x5.exe pid=10732
2020-05-05T10:32:04.016+0530 [DEBUG] plugin: waiting for RPC address: path=C:\storagetransfer\storage-transfer-terraform\storage-transfer-terraform.terraform\plugins\windows_amd64\terraform-provider-google_v3.19.0_x5.exe
2020-05-05T10:32:04.070+0530 [INFO] plugin.terraform-provider-google_v3.19.0_x5.exe: configuring server automatic mTLS: timestamp=2020-05-05T10:32:04.069+0530
2020-05-05T10:32:04.106+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: plugin address: network=tcp address=127.0.0.1:10000 timestamp=2020-05-05T10:32:04.105+0530
2020-05-05T10:32:04.106+0530 [DEBUG] plugin: using plugin: version=5
2020-05-05T10:32:04.255+0530 [DEBUG] plugin: plugin process exited: path=C:\storagetransfer\storage-transfer-terraform\storage-transfer-terraform.terraform\plugins\windows_amd64\terraform-provider-google_v3.19.0_x5.exe pid=10732
2020-05-05T10:32:04.255+0530 [DEBUG] plugin: plugin exited
2020/05/05 10:32:04 [INFO] backend/local: apply calling Refresh
2020/05/05 10:32:04 [INFO] terraform: building graph: GraphTypeRefresh
2020/05/05 10:32:04 [DEBUG] ProviderTransformer: "google_storage_transfer_job.s3-bucket-migration-gcs-bucket" (terraform.NodeRefreshableManagedResource) needs provider.google
2020/05/05 10:32:04 [DEBUG] ProviderTransformer: "data.google_storage_transfer_project_service_account.default" (terraform.NodeRefreshableDataResource) needs provider.google
2020/05/05 10:32:04 [DEBUG] ProviderTransformer: "google_storage_bucket.gcp-bucket" (terraform.NodeRefreshableManagedResource) needs provider.google
2020/05/05 10:32:04 [DEBUG] ProviderTransformer: "google_storage_bucket_iam_member.gcs-iam-service-account-role" (terraform.NodeRefreshableManagedResource) needs provider.google
2020/05/05 10:32:04 [DEBUG] ReferenceTransformer: "google_storage_bucket_iam_member.gcs-iam-service-account-role" references: [google_storage_bucket.gcp-bucket data.google_storage_transfer_project_service_account.default google_storage_bucket.gcp-bucket]
2020/05/05 10:32:04 [DEBUG] ReferenceTransformer: "google_storage_transfer_job.s3-bucket-migration-gcs-bucket" references: [google_storage_bucket_iam_member.gcs-iam-service-account-role var.project var.aws_s3_bucket var.aws_access_key var.aws_secret_key google_storage_bucket.gcp-bucket]
2020/05/05 10:32:04 [DEBUG] ReferenceTransformer: "var.aws_access_key" references: []
2020/05/05 10:32:04 [DEBUG] ReferenceTransformer: "var.aws_secret_key" references: []
2020/05/05 10:32:04 [DEBUG] ReferenceTransformer: "provider.google" references: [var.region var.project]
2020/05/05 10:32:04 [DEBUG] ReferenceTransformer: "google_storage_bucket.gcp-bucket" references: [var.gcs_bucket_name var.project]
2020/05/05 10:32:04 [DEBUG] ReferenceTransformer: "var.region" references: []
2020/05/05 10:32:04 [DEBUG] ReferenceTransformer: "var.service_account" references: []
2020/05/05 10:32:04 [DEBUG] ReferenceTransformer: "var.project" references: []
2020/05/05 10:32:04 [DEBUG] ReferenceTransformer: "var.aws_s3_bucket" references: []
2020/05/05 10:32:04 [DEBUG] ReferenceTransformer: "var.gcs_bucket_name" references: []
2020/05/05 10:32:04 [DEBUG] ReferenceTransformer: "data.google_storage_transfer_project_service_account.default" references: [var.project]
2020/05/05 10:32:04 [DEBUG] Starting graph walk: walkRefresh
2020-05-05T10:32:04.258+0530 [INFO] plugin: configuring client automatic mTLS
2020-05-05T10:32:04.315+0530 [DEBUG] plugin: starting plugin: path=C:\storagetransfer\storage-transfer-terraform\storage-transfer-terraform.terraform\plugins\windows_amd64\terraform-provider-google_v3.19.0_x5.exe args=[C:\storagetransfer\storage-transfer-terraform\storage-transfer-terraform.terraform\plugins\windows_amd64\terraform-provider-google_v3.19.0_x5.exe]
2020-05-05T10:32:04.650+0530 [DEBUG] plugin: plugin started: path=C:\storagetransfer\storage-transfer-terraform\storage-transfer-terraform.terraform\plugins\windows_amd64\terraform-provider-google_v3.19.0_x5.exe pid=14812
2020-05-05T10:32:04.650+0530 [DEBUG] plugin: waiting for RPC address: path=C:\storagetransfer\storage-transfer-terraform\storage-transfer-terraform.terraform\plugins\windows_amd64\terraform-provider-google_v3.19.0_x5.exe
2020-05-05T10:32:04.710+0530 [INFO] plugin.terraform-provider-google_v3.19.0_x5.exe: configuring server automatic mTLS: timestamp=2020-05-05T10:32:04.708+0530
2020-05-05T10:32:04.743+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: plugin address: address=127.0.0.1:10000 network=tcp timestamp=2020-05-05T10:32:04.743+0530
2020-05-05T10:32:04.743+0530 [DEBUG] plugin: using plugin: version=5
2020-05-05T10:32:04.844+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:04 [INFO] Authenticating using configured Google JSON 'credentials'...
2020-05-05T10:32:04.844+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:04 [INFO] -- Scopes: [https://www.googleapis.com/auth/compute https://www.googleapis.com/auth/cloud-platform https://www.googleapis.com/auth/ndev.clouddns.readwrite https://www.googleapis.com/auth/devstorage.full_control https://www.googleapis.com/auth/userinfo.email]
2020-05-05T10:32:04.844+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:04 [INFO] Instantiating GCE client for path https://www.googleapis.com/compute/v1/projects/
2020-05-05T10:32:04.857+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:04 [INFO] Instantiating GCE Beta client for path https://www.googleapis.com/compute/beta/projects/
2020-05-05T10:32:04.857+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:04 [INFO] Instantiating GKE client for path https://container.googleapis.com/
2020-05-05T10:32:04.857+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:04 [INFO] Instantiating GKE Beta client for path https://container.googleapis.com/
2020-05-05T10:32:04.857+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:04 [INFO] Instantiating Google Cloud DNS client for path https://www.googleapis.com/dns/v1/projects/
2020-05-05T10:32:04.857+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:04 [INFO] Instantiating Google Cloud DNS Beta client for path https://www.googleapis.com/dns/v1beta2/projects/
2020-05-05T10:32:04.857+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:04 [INFO] Instantiating Google Cloud KMS client for path https://cloudkms.googleapis.com/
2020-05-05T10:32:04.858+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:04 [INFO] Instantiating Google Stackdriver Logging client for path https://logging.googleapis.com/
2020-05-05T10:32:04.858+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:04 [INFO] Instantiating Google Storage client for path https://www.googleapis.com/storage/v1/
2020-05-05T10:32:04.858+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:04 [INFO] Instantiating Google SqlAdmin client for path https://sqladmin.googleapis.com/
2020-05-05T10:32:04.858+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:04 [INFO] Instantiating Google Pubsub client for path https://pubsub.googleapis.com/
2020-05-05T10:32:04.858+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:04 [INFO] Instantiating Google Dataflow client for path https://dataflow.googleapis.com/
2020-05-05T10:32:04.858+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:04 [INFO] Instantiating Google Cloud ResourceManager client for path https://cloudresourcemanager.googleapis.com/
2020-05-05T10:32:04.858+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:04 [INFO] Instantiating Google Cloud ResourceManager V client for path https://cloudresourcemanager.googleapis.com/
2020-05-05T10:32:04.858+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:04 [INFO] Instantiating Google Cloud Runtimeconfig client for path https://runtimeconfig.googleapis.com/
2020-05-05T10:32:04.858+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:04 [INFO] Instantiating Google Cloud IAM client for path https://iam.googleapis.com/
2020-05-05T10:32:04.858+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:04 [INFO] Instantiating Google Cloud IAMCredentials client for path https://iamcredentials.googleapis.com/
2020-05-05T10:32:04.858+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:04 [INFO] Instantiating Google Cloud Service Management client for path https://servicemanagement.googleapis.com/
2020-05-05T10:32:04.858+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:04 [INFO] Instantiating Google Cloud Service Usage client for path https://serviceusage.googleapis.com/
2020-05-05T10:32:04.858+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:04 [INFO] Instantiating Google Cloud Billing client for path https://cloudbilling.googleapis.com/
2020-05-05T10:32:04.858+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:04 [INFO] Instantiating Google Cloud Build client for path https://cloudbuild.googleapis.com/
2020-05-05T10:32:04.858+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:04 [INFO] Instantiating Google Cloud BigQuery client for path https://www.googleapis.com/bigquery/v2/
2020-05-05T10:32:04.858+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:04 [INFO] Instantiating Google Cloud CloudFunctions Client for path https://cloudfunctions.googleapis.com/
2020-05-05T10:32:04.858+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:04 [INFO] Instantiating Google Cloud BigtableAdmin for path https://bigtableadmin.googleapis.com/
2020-05-05T10:32:04.858+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:04 [INFO] Instantiating Google Cloud Source Repo client for path https://sourcerepo.googleapis.com/
2020-05-05T10:32:04.858+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:04 [INFO] Instantiating Google Cloud Spanner client for path https://spanner.googleapis.com/
2020-05-05T10:32:04.858+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:04 [INFO] Instantiating Google Cloud Dataproc client for path https://dataproc.googleapis.com/
2020-05-05T10:32:04.858+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:04 [INFO] Instantiating Google Cloud Dataproc Beta client for path https://dataproc.googleapis.com/
2020-05-05T10:32:04.858+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:04 [INFO] Instantiating Filestore client for path https://file.googleapis.com/
2020-05-05T10:32:04.858+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:04 [INFO] Instantiating Google Cloud IoT Core client for path https://cloudiot.googleapis.com/
2020-05-05T10:32:04.858+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:04 [INFO] Instantiating App Engine client for path https://appengine.googleapis.com/
2020-05-05T10:32:04.858+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:04 [INFO] Instantiating Cloud Composer client for path https://composer.googleapis.com/
2020-05-05T10:32:04.858+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:04 [INFO] Instantiating Service Networking client for path https://servicenetworking.googleapis.com/
2020-05-05T10:32:04.858+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:04 [INFO] Instantiating Google Cloud Storage Transfer client for path https://storagetransfer.googleapis.com/
2020/05/05 10:32:04 [DEBUG] ReferenceTransformer: "google_storage_bucket.gcp-bucket" references: []
2020/05/05 10:32:04 [DEBUG] ReferenceTransformer: "data.google_storage_transfer_project_service_account.default" references: []
2020-05-05T10:32:04.863+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:04 [DEBUG] Retry Transport: starting RoundTrip retry loop
2020-05-05T10:32:04.863+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:04 [DEBUG] Retry Transport: request attempt 0
2020-05-05T10:32:04.863+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:04 [DEBUG] Google API Request Details:
2020-05-05T10:32:04.863+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: ---[ REQUEST ]---------------------------------------
2020-05-05T10:32:04.863+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: GET /v1/googleServiceAccounts/transfer-job?alt=json&prettyPrint=false HTTP/1.1
2020-05-05T10:32:04.863+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: Host: storagetransfer.googleapis.com
2020-05-05T10:32:04.863+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: User-Agent: google-api-go-client/0.5 HashiCorp Terraform/0.12.24 (+https://www.terraform.io) Terraform Plugin SDK/1.4.0 terraform-provider-google/3.19.0
2020-05-05T10:32:04.863+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: X-Goog-Api-Client: gl-go/1.13.4 gdcl/20200302
2020-05-05T10:32:04.863+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: Accept-Encoding: gzip
2020-05-05T10:32:04.863+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe:
2020-05-05T10:32:04.863+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe:
2020-05-05T10:32:04.863+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: -----------------------------------------------------
2020-05-05T10:32:04.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:04 [DEBUG] Retry Transport: starting RoundTrip retry loop
2020-05-05T10:32:04.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:04 [DEBUG] Retry Transport: request attempt 0
2020-05-05T10:32:04.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:04 [DEBUG] Google API Request Details:
2020-05-05T10:32:04.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: ---[ REQUEST ]---------------------------------------
2020-05-05T10:32:04.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: GET /storage/v1/b/sink_bucket?alt=json&prettyPrint=false HTTP/1.1
2020-05-05T10:32:04.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: Host: www.googleapis.com
2020-05-05T10:32:04.865+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: User-Agent: google-api-go-client/0.5 HashiCorp Terraform/0.12.24 (+https://www.terraform.io) Terraform Plugin SDK/1.4.0 terraform-provider-google/3.19.0
2020-05-05T10:32:04.865+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: X-Goog-Api-Client: gl-go/1.13.4 gdcl/20200302
2020-05-05T10:32:04.865+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: Accept-Encoding: gzip
2020-05-05T10:32:04.865+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe:
2020-05-05T10:32:04.865+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe:
2020-05-05T10:32:04.865+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: -----------------------------------------------------
2020-05-05T10:32:05.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:05 [DEBUG] Google API Response Details:
2020-05-05T10:32:05.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: ---[ RESPONSE ]--------------------------------------
2020-05-05T10:32:05.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: HTTP/1.1 200 OK
2020-05-05T10:32:05.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: Connection: close
2020-05-05T10:32:05.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: Content-Length: 464
2020-05-05T10:32:05.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: Alt-Svc: h3-Q050=":443"; ma=2592000,h3-Q049=":443"; ma=2592000,h3-Q048=":443"; ma=2592000,h3-Q046=":443"; ma=2592000,h3-Q043=":443"; ma=2592000,quic=":443"; ma=2592000; v="46,43"
2020-05-05T10:32:05.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: Cache-Control: private, max-age=0, must-revalidate, no-transform
2020-05-05T10:32:05.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: Content-Type: application/json; charset=UTF-8
2020-05-05T10:32:05.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: Date: Tue, 05 May 2020 05:02:05 GMT
2020-05-05T10:32:05.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: Etag: CAI=
2020-05-05T10:32:05.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: Expires: Tue, 05 May 2020 05:02:05 GMT
2020-05-05T10:32:05.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: Server: UploadServer
2020-05-05T10:32:05.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: Vary: Origin
2020-05-05T10:32:05.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: Vary: X-Origin
2020-05-05T10:32:05.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: X-Guploader-Uploadid: AAANsUl27cy6kcK0G4EiPBjucP-22hVWDrXFjW07x7GX2o0ck-4S3wI69DA0U0U1yDY-BM0Jnf1h5d7BpSJQEzxzUA
2020-05-05T10:32:05.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe:
2020-05-05T10:32:05.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: {
2020-05-05T10:32:05.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "kind": "storage#bucket",
2020-05-05T10:32:05.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "selfLink": "https://www.googleapis.com/storage/v1/b/sink_bucket",
2020-05-05T10:32:05.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "id": "source_bucket",
2020-05-05T10:32:05.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "name": "sink_bucket",
2020-05-05T10:32:05.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "projectNumber": "745947598348",
2020-05-05T10:32:05.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "metageneration": "2",
2020-05-05T10:32:05.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "location": "US",
2020-05-05T10:32:05.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "storageClass": "STANDARD",
2020-05-05T10:32:05.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "etag": "CAI=",
2020-05-05T10:32:05.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "timeCreated": "2020-05-04T16:50:45.662Z",
2020-05-05T10:32:05.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "updated": "2020-05-04T16:50:47.667Z",
2020-05-05T10:32:05.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "iamConfiguration": {
ovider-google_v3.19.0_x5.exe: "bucketPolicyOnly": {
2020-05-05T10:32:05.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "enabled": false
2020-05-05T10:32:05.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: },
2020-05-05T10:32:05.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "uniformBucketLevelAccess": {
2020-05-05T10:32:05.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "enabled": false
2020-05-05T10:32:05.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: }
2020-05-05T10:32:05.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: },
2020-05-05T10:32:05.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "locationType": "multi-region"
2020-05-05T10:32:05.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: }
2020-05-05T10:32:05.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: -----------------------------------------------------
2020-05-05T10:32:05.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:05 [DEBUG] Retry Transport: Stopping retries, last request was successful
2020-05-05T10:32:05.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:05 [DEBUG] Retry Transport: Returning after 1 attempts
2020-05-05T10:32:05.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:05 [DEBUG] Read bucket sink_bucket at location https://www.googleapis.com/storage/v1/b/sink_bucket
2020-05-05T10:32:05.864+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe:
2020-05-05T10:32:06.814+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:06 [DEBUG] Google API Response Details:
2020-05-05T10:32:06.814+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: ---[ RESPONSE ]--------------------------------------
2020-05-05T10:32:06.814+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: HTTP/1.1 200 OK
2020-05-05T10:32:06.814+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: Connection: close
2020-05-05T10:32:06.814+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: Transfer-Encoding: chunked
2020-05-05T10:32:06.814+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: Alt-Svc: h3-Q050=":443"; ma=2592000,h3-Q049=":443"; ma=2592000,h3-Q048=":443"; ma=2592000,h3-Q046=":443"; ma=2592000,h3-Q043=":443"; ma=2592000,quic=":443"; ma=2592000; v="46,43"
2020-05-05T10:32:06.814+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: Cache-Control: private
2020-05-05T10:32:06.814+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: Content-Type: application/json; charset=UTF-8
2020-05-05T10:32:06.814+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: Date: Tue, 05 May 2020 05:02:06 GMT
2020-05-05T10:32:06.814+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: Server: ESF
2020-05-05T10:32:06.814+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: Vary: Origin
2020-05-05T10:32:06.814+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: Vary: X-Origin
2020-05-05T10:32:06.815+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: Vary: Referer
2020-05-05T10:32:06.815+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: X-Content-Type-Options: nosniff
2020-05-05T10:32:06.815+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: X-Frame-Options: SAMEORIGIN
2020-05-05T10:32:06.815+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: X-Xss-Protection: 0
2020-05-05T10:32:06.815+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe:
2020-05-05T10:32:06.815+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 58
2020-05-05T10:32:06.815+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: {
2020-05-05T10:32:06.815+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "accountEmail": "project-745947598348@storage-transfer-service.iam.gserviceaccount.com"
2020-05-05T10:32:06.815+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: }
2020-05-05T10:32:06.815+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 0
2020-05-05T10:32:06.815+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe:
2020-05-05T10:32:06.815+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe:
2020-05-05T10:32:06.815+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: -----------------------------------------------------
2020-05-05T10:32:06.815+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:06 [DEBUG] Retry Transport: Stopping retries, last request was successful
2020-05-05T10:32:06.815+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:06 [DEBUG] Retry Transport: Returning after 1 attempts
2020/05/05 10:32:06 [DEBUG] ReferenceTransformer: "google_storage_bucket_iam_member.gcs-iam-service-account-role" references: []
2020-05-05T10:32:06.818+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:06 [DEBUG] matching ID b/sink_bucket to regex b/(?P
2020-05-05T10:32:14.088+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "transferSpec": { 2020-05-05T10:32:14.088+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "awsS3DataSource": { 2020-05-05T10:32:14.088+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "awsAccessKey": { 2020-05-05T10:32:14.088+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "accessKeyId": "XXXXXXXXXXXXXXXX", 2020-05-05T10:32:14.088+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "secretAccessKey": "XXXXXXXXXXXX" 2020-05-05T10:32:14.088+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: }, 2020-05-05T10:32:14.088+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "bucketName": "source_bucket" 2020-05-05T10:32:14.088+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: }, 2020-05-05T10:32:14.088+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "gcsDataSink": { 2020-05-05T10:32:14.088+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "bucketName": "sink_bucket" 2020-05-05T10:32:14.088+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: }, 2020-05-05T10:32:14.088+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "objectConditions": { 2020-05-05T10:32:14.088+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "maxTimeElapsedSinceLastModification": "0s", 2020-05-05T10:32:14.088+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "minTimeElapsedSinceLastModification": "0s" 2020-05-05T10:32:14.088+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: }, 2020-05-05T10:32:14.088+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "transferOptions": { 2020-05-05T10:32:14.088+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "overwriteObjectsAlreadyExistingInSink": true 2020-05-05T10:32:14.088+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: } 2020-05-05T10:32:14.088+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: } 2020-05-05T10:32:14.088+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: } 2020-05-05T10:32:14.088+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020-05-05T10:32:14.088+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: ----------------------------------------------------- 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:16 [DEBUG] Google API Response Details: 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: ---[ RESPONSE ]-------------------------------------- 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: HTTP/1.1 200 OK 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: Connection: close 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: Transfer-Encoding: chunked 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: Alt-Svc: h3-Q050=":443"; ma=2592000,h3-Q049=":443"; ma=2592000,h3-Q048=":443"; ma=2592000,h3-Q046=":443"; ma=2592000,h3-Q043=":443"; ma=2592000,quic=":443"; ma=2592000; v="46,43" 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: Cache-Control: private 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: Content-Type: application/json; charset=UTF-8 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: Date: Tue, 05 May 2020 05:02:16 GMT 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: Server: ESF 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: Vary: Origin 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: Vary: X-Origin 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: Vary: Referer 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: X-Content-Type-Options: nosniff 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: X-Frame-Options: SAMEORIGIN 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: X-Xss-Protection: 0 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2b7 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: { 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "name": "transferJobs/6264023302614192316", 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "description": "migration S3 bucket to gcs bucket", 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "projectId": "transfer-job", 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "transferSpec": { 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "awsS3DataSource": { 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "bucketName": "source_bucket" 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: }, 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "gcsDataSink": { 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "bucketName": "sink_bucket" 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: }, 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "objectConditions": { 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "minTimeElapsedSinceLastModification": "0s", 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "maxTimeElapsedSinceLastModification": "0s" 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: }, 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "transferOptions": { 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "overwriteObjectsAlreadyExistingInSink": true 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: } 34+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: }, 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "schedule": { 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "scheduleStartDate": { 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "year": 2020, 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "month": 5, 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "day": 5 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: }, 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "scheduleEndDate": { 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "year": 2020, 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "month": 5, 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "day": 5 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: }, 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "startTimeOfDay": { 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "hours": 5, 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "minutes": 10 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: } 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: }, 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "status": "ENABLED", 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "creationTime": "2020-05-05T05:02:15.926760109Z", 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "lastModificationTime": "2020-05-05T05:02:15.926760109Z" 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: } 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 0 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: ----------------------------------------------------- 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:16 [DEBUG] Retry Transport: Stopping retries, last request was successful 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:16 [DEBUG] Retry Transport: Returning after 1 attempts 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:16 [DEBUG] Retry Transport: starting RoundTrip retry loop 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:16 [DEBUG] Retry Transport: request attempt 0 2020-05-05T10:32:16.534+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:16 [DEBUG] Google API Request Details: 2020-05-05T10:32:16.535+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: ---[ REQUEST ]--------------------------------------- 2020-05-05T10:32:16.535+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: GET /v1/transferJobs/6264023302614192316?alt=json&prettyPrint=false&projectId=transfer-job HTTP/1.1 2020-05-05T10:32:16.535+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: Host: storagetransfer.googleapis.com Terraform Plugin SDK/1.4.0 terraform-provider-google/3.19.0 2020-05-05T10:32:16.535+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: X-Goog-Api-Client: gl-go/1.13.4 gdcl/20200302 2020-05-05T10:32:16.535+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: Accept-Encoding: gzip 2020-05-05T10:32:16.535+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020-05-05T10:32:16.535+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020-05-05T10:32:16.535+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: ----------------------------------------------------- 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:18 [DEBUG] Google API Response Details: 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: ---[ RESPONSE ]-------------------------------------- 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: HTTP/1.1 200 OK 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: Connection: close 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: Transfer-Encoding: chunked 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: Alt-Svc: h3-Q050=":443"; ma=2592000,h3-Q049=":443"; ma=2592000,h3-Q048=":443"; ma=2592000,h3-Q046=":443"; ma=2592000,h3-Q043=":443"; ma=2592000,quic=":443"; ma=2592000; v="46,43" 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: Cache-Control: private 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: Content-Type: application/json; charset=UTF-8 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: Date: Tue, 05 May 2020 05:02:17 GMT 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: Server: ESF 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: Vary: Origin 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: Vary: X-Origin 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: Vary: Referer 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: X-Content-Type-Options: nosniff 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: X-Frame-Options: SAMEORIGIN 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: X-Xss-Protection: 0 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2b7 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: { 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "name": "transferJobs/6264023302614192316", 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "description": "migration S3 bucket to gcs bucket", 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "projectId": "transfer-job", 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "transferSpec": { 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "awsS3DataSource": { 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "bucketName": "source_bucket" 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: }, 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "gcsDataSink": { 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "bucketName": "sink_bucket" 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: }, 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "objectConditions": { 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "minTimeElapsedSinceLastModification": "0s", 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "maxTimeElapsedSinceLastModification": "0s" 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: }, 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "transferOptions": { _v3.19.0_x5.exe: "overwriteObjectsAlreadyExistingInSink": true 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: } 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: }, 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "schedule": { 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "scheduleStartDate": { 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "year": 2020, 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "month": 5, 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "day": 5 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: }, 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "scheduleEndDate": { 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "year": 2020, 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "month": 5, 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "day": 5 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: }, 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "startTimeOfDay": { 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "hours": 5, 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "minutes": 10 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: } 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: }, 2020-05-05T10:32:18.190+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "status": "ENABLED", nTime": "2020-05-05T05:02:15.926760109Z", 2020-05-05T10:32:18.191+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: "lastModificationTime": "2020-05-05T05:02:15.926760109Z" 2020-05-05T10:32:18.191+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: } 2020-05-05T10:32:18.191+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 0 2020-05-05T10:32:18.191+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020-05-05T10:32:18.191+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020-05-05T10:32:18.191+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: ----------------------------------------------------- 2020-05-05T10:32:18.191+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:18 [DEBUG] Retry Transport: Stopping retries, last request was successful 2020-05-05T10:32:18.191+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:18 [DEBUG] Retry Transport: Returning after 1 attempts 2020-05-05T10:32:18.191+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020/05/05 10:32:18 [DEBUG] Read transfer job: transferJobs/6264023302614192316 in project: transfer-job 2020-05-05T10:32:18.191+0530 [DEBUG] plugin.terraform-provider-google_v3.19.0_x5.exe: 2020-05-05T10:32:18.269+0530 [DEBUG] plugin: plugin process exited: path=C:\storagetransfer\storage-transfer-terraform\storage-transfer-terraform.terraform\plugins\windows_amd64\terraform-provider-google_v3.19.0_x5.exe pid=1188 2020-05-05T10:32:18.269+0530 [DEBUG] plugin: plugin exited
@venkykuberan I didn't see any error while running terraform apply & terraform plan, but somehow the objects in s3 are not synced to GCS bucket
With PR above, anyone is still seeing this same problem?
Closing assume it is no longer an issue
I'm going to lock this issue because it has been closed for 30 days ⏳. This helps our maintainers find and focus on the active issues. If you have found a problem that seems similar to this, please open a new issue and complete the issue template so we can capture all the details necessary to investigate further.
data "google_storage_transfer_project_service_account" "default" { project = var.project }
resource "google_storage_bucket" "gcp-bucket" { name = var.gcs_bucket_name // storage_class = "NEARLINE" // storage_class = "MULTI_REGIONAL" storage_class = "STANDARD" // storage_class = "REGIONAL" // storage_class = "COLDLINE" project = var.project }
// data "google_storage_bucket" "source-bucket" { // name = var.gcs_bucket_name // }
resource "google_storage_bucket_iam_member" "gcs-iam-service-account-role" { bucket = google_storage_bucket.gcp-bucket.name role = "roles/storage.admin" member = "serviceAccount:${data.google_storage_transfer_project_service_account.default.email}" depends_on = [google_storage_bucket.gcp-bucket] }
resource "google_storage_transfer_job" "s3-bucket-migration-gcs-bucket" { description = "migration S3 bucket to gcs bucket" project = var.project
transfer_spec { object_conditions { max_time_elapsed_since_last_modification = "600s" min_time_elapsed_since_last_modification = "400s" // exclude_prefixes = [ // "requests.gz", // ] include_prefixes = [ "*", ] } transfer_options { delete_objects_unique_in_sink = false overwrite_objects_already_existing_in_sink = true delete_objects_from_source_after_transfer = false } aws_s3_data_source { bucket_name = var.aws_s3_bucket aws_access_key { access_key_id = var.aws_access_key secret_access_key = var.aws_secret_key } } gcs_data_sink { bucket_name = google_storage_bucket.gcp-bucket.name } }
schedule { schedule_start_date { year = 2020 month = 05 day = 04 } schedule_end_date { year = 2020 month = 05 day = 04 } start_time_of_day { hours = 14 minutes = 10 seconds = 0 nanos = 0 } }
depends_on = [google_storage_bucket_iam_member.gcs-iam-service-account-role] }
Job is executed successfully but s3 objects are not synced to GCS bucket when performing manual transfer job it works fine as expected The service account has all the required roles
Affected Resource(s)