Open zhaoyi0113 opened 2 years ago
What happens if you just run terraform apply
a second time after that?
I get the same error. The bootstrap admin is not ready. I have tried to increase the timeout to be 20 minutes. but still get the same error.
Can you run terraform with debug logs (TF_LOG=debug terraform apply
). Maybe there is more information in there that can help to identify what is going wrong.
Hello i have the same problem, here is my debug log:
`Terraform used the selected providers to generate the following execution plan. Resource actions are indicated with the following symbols:
Terraform will perform the following actions:
resource "aws_instance" "quickstart_node" {
ami = "ami-01f7183c498da740b"
arn = (known after apply)
associate_public_ip_address = true
availability_zone = (known after apply)
cpu_core_count = (known after apply)
cpu_threads_per_core = (known after apply)
disable_api_termination = (known after apply)
ebs_optimized = (known after apply)
get_password_data = false
host_id = (known after apply)
id = (known after apply)
instance_initiated_shutdown_behavior = (known after apply)
instance_state = (known after apply)
instance_type = "t3a.small"
ipv6_address_count = (known after apply)
ipv6_addresses = (known after apply)
key_name = "quickstart-rancher-20230228164739125700000001"
monitoring = (known after apply)
outpost_arn = (known after apply)
password_data = (known after apply)
placement_group = (known after apply)
placement_partition_number = (known after apply)
primary_network_interface_id = (known after apply)
private_dns = (known after apply)
private_ip = (known after apply)
public_dns = (known after apply)
public_ip = (known after apply)
secondary_private_ips = (known after apply)
security_groups = (known after apply)
source_dest_check = true
subnet_id = "subnet-01bac293de54b8759"
tags = {
tags_all = {
tenancy = (known after apply)
user_data = (known after apply)
user_data_base64 = (known after apply)
user_data_replace_on_change = false
vpc_security_group_ids = [
capacity_reservation_specification {
capacity_reservation_preference = (known after apply)
capacity_reservation_target {
ebs_block_device {
enclave_options {
ephemeral_block_device {
maintenance_options {
metadata_options {
network_interface {
root_block_device {
resource "local_file" "kube_config_workload_yaml" {
resource "rancher2_bootstrap" "admin" {
resource "rancher2_cluster_v2" "quickstart_workload" {
annotations = (known after apply)
cluster_registration_token = (sensitive value)
cluster_v1_id = (known after apply)
enable_network_policy = (known after apply)
fleet_namespace = "fleet-default"
id = (known after apply)
kube_config = (sensitive value)
kubernetes_version = "v1.23.14+rke2r1"
labels = (known after apply)
name = "quickstart-aws-custom"
resource_version = (known after apply)
rke_config {
additional_manifest = (known after apply)
chart_values = (known after apply)
machine_global_config = (known after apply)
etcd {
disable_snapshots = (known after apply)
snapshot_retention = (known after apply)
snapshot_schedule_cron = (known after apply)
s3_config {
etcd_snapshot_create {
etcd_snapshot_restore {
local_auth_endpoint {
machine_pools {
annotations = (known after apply)
cloud_credential_secret_name = (known after apply)
control_plane_role = (known after apply)
drain_before_delete = (known after apply)
etcd_role = (known after apply)
labels = (known after apply)
max_unhealthy = (known after apply)
name = (known after apply)
node_drain_timeout = (known after apply)
node_startup_timeout_seconds = (known after apply)
paused = (known after apply)
quantity = (known after apply)
unhealthy_node_timeout_seconds = (known after apply)
unhealthy_range = (known after apply)
worker_role = (known after apply)
machine_config {
rolling_update {
taints {
machine_selector_config {
config = (known after apply)
machine_label_selector {
match_labels = (known after apply)
match_expressions {
registries {
configs {
mirrors {
rotate_certificates {
upgrade_strategy {
control_plane_concurrency = (known after apply)
worker_concurrency = (known after apply)
control_plane_drain_options {
worker_drain_options {
Plan: 4 to add, 0 to change, 0 to destroy.
Changes to Outputs:
Do you want to perform these actions? Terraform will perform the actions described above. Only 'yes' will be accepted to approve.
Enter a value: yes
2023-02-28T13:12:27.417-0400 [INFO] backend/local: apply calling Apply 2023-02-28T13:12:27.417-0400 [DEBUG] Building and walking apply graph for NormalMode plan 2023-02-28T13:12:27.418-0400 [DEBUG] Resource state not found for node "module.rancher_common.rancher2_bootstrap.admin", instance module.rancher_common.rancher2_bootstrap.admin 2023-02-28T13:12:27.418-0400 [DEBUG] Resource state not found for node "aws_instance.quickstart_node", instance aws_instance.quickstart_node 2023-02-28T13:12:27.418-0400 [DEBUG] Resource state not found for node "module.rancher_common.local_file.kube_config_workload_yaml", instance module.rancher_common.local_file.kube_config_workload_yaml 2023-02-28T13:12:27.418-0400 [DEBUG] Resource state not found for node "module.rancher_common.rancher2_cluster_v2.quickstart_workload", instance module.rancher_common.rancher2_cluster_v2.quickstart_workload 2023-02-28T13:12:27.418-0400 [DEBUG] adding implicit provider configuration provider["registry.terraform.io/loafoe/ssh"], implied first by module.rancher_common.ssh_resource.retrieve_config (expand) 2023-02-28T13:12:27.418-0400 [DEBUG] adding implicit provider configuration provider["registry.terraform.io/rancher/rancher2"], implied first by module.rancher_common.rancher2_bootstrap.admin 2023-02-28T13:12:27.418-0400 [DEBUG] adding implicit provider configuration provider["registry.terraform.io/hashicorp/helm"], implied first by module.rancher_common.helm_release.cert_manager (expand) 2023-02-28T13:12:27.418-0400 [DEBUG] adding implicit provider configuration provider["registry.terraform.io/hashicorp/http"], implied first by data.http.ip (expand) 2023-02-28T13:12:27.419-0400 [DEBUG] ProviderTransformer: "aws_instance.quickstart_node" (terraform.NodeApplyableResourceInstance) needs provider["registry.terraform.io/hashicorp/aws"] 2023-02-28T13:12:27.419-0400 [DEBUG] ProviderTransformer: "aws_subnet.rancher_subnet (expand)" (terraform.nodeExpandApplyableResource) needs provider["registry.terraform.io/hashicorp/aws"] 2023-02-28T13:12:27.419-0400 [DEBUG] ProviderTransformer: "module.rancher_common.local_file.kube_config_workload_yaml" (terraform.NodeApplyableResourceInstance) needs provider["registry.terraform.io/hashicorp/local"] 2023-02-28T13:12:27.419-0400 [DEBUG] ProviderTransformer: "data.http.ip (expand)" (terraform.nodeExpandApplyableResource) needs provider["registry.terraform.io/hashicorp/http"] 2023-02-28T13:12:27.419-0400 [DEBUG] ProviderTransformer: "local_sensitive_file.ssh_private_key_pem (expand)" (terraform.nodeExpandApplyableResource) needs provider["registry.terraform.io/hashicorp/local"] 2023-02-28T13:12:27.419-0400 [DEBUG] ProviderTransformer: "aws_instance.quickstart_node (expand)" (terraform.nodeExpandApplyableResource) needs provider["registry.terraform.io/hashicorp/aws"] 2023-02-28T13:12:27.419-0400 [DEBUG] ProviderTransformer: "module.rancher_common.local_file.kube_config_server_yaml (expand)" (terraform.nodeExpandApplyableResource) needs provider["registry.terraform.io/hashicorp/local"] 2023-02-28T13:12:27.419-0400 [DEBUG] ProviderTransformer: "tls_private_key.global_key (expand)" (terraform.nodeExpandApplyableResource) needs provider["registry.terraform.io/hashicorp/tls"] 2023-02-28T13:12:27.419-0400 [DEBUG] ProviderTransformer: "aws_route_table_association.rancher_route_table_association (expand)" (terraform.nodeExpandApplyableResource) needs provider["registry.terraform.io/hashicorp/aws"] 2023-02-28T13:12:27.419-0400 [DEBUG] ProviderTransformer: "aws_security_group.rancher_sg_allowall (expand)" (terraform.nodeExpandApplyableResource) needs provider["registry.terraform.io/hashicorp/aws"] 2023-02-28T13:12:27.419-0400 [DEBUG] ProviderTransformer: "module.rancher_common.rancher2_bootstrap.admin (expand)" (terraform.nodeExpandApplyableResource) needs module.rancher_common.provider["registry.terraform.io/rancher/rancher2"].bootstrap 2023-02-28T13:12:27.419-0400 [DEBUG] ProviderTransformer: "module.rancher_common.helm_release.rancher_server (expand)" (terraform.nodeExpandApplyableResource) needs module.rancher_common.provider["registry.terraform.io/hashicorp/helm"] 2023-02-28T13:12:27.419-0400 [DEBUG] ProviderTransformer: "module.rancher_common.ssh_resource.install_k3s (expand)" (terraform.nodeExpandApplyableResource) needs provider["registry.terraform.io/loafoe/ssh"] 2023-02-28T13:12:27.419-0400 [DEBUG] ProviderTransformer: "module.rancher_common.local_file.kube_config_workload_yaml (expand)" (terraform.nodeExpandApplyableResource) needs provider["registry.terraform.io/hashicorp/local"] 2023-02-28T13:12:27.419-0400 [DEBUG] ProviderTransformer: "aws_key_pair.quickstart_key_pair (expand)" (terraform.nodeExpandApplyableResource) needs provider["registry.terraform.io/hashicorp/aws"] 2023-02-28T13:12:27.419-0400 [DEBUG] ProviderTransformer: "aws_instance.quickstart_node_win (expand)" (terraform.nodeExpandApplyableResource) needs provider["registry.terraform.io/hashicorp/aws"] 2023-02-28T13:12:27.419-0400 [DEBUG] ProviderTransformer: "aws_instance.rancher_server (expand)" (terraform.nodeExpandApplyableResource) needs provider["registry.terraform.io/hashicorp/aws"] 2023-02-28T13:12:27.419-0400 [DEBUG] ProviderTransformer: "module.rancher_common.ssh_resource.retrieve_config (expand)" (terraform.nodeExpandApplyableResource) needs provider["registry.terraform.io/loafoe/ssh"] 2023-02-28T13:12:27.419-0400 [DEBUG] ProviderTransformer: "aws_vpc.rancher_vpc (expand)" (terraform.nodeExpandApplyableResource) needs provider["registry.terraform.io/hashicorp/aws"] 2023-02-28T13:12:27.419-0400 [DEBUG] ProviderTransformer: "local_file.ssh_public_key_openssh (expand)" (terraform.nodeExpandApplyableResource) needs provider["registry.terraform.io/hashicorp/local"] 2023-02-28T13:12:27.419-0400 [DEBUG] ProviderTransformer: "data.aws_ami.sles (expand)" (terraform.nodeExpandApplyableResource) needs provider["registry.terraform.io/hashicorp/aws"] 2023-02-28T13:12:27.419-0400 [DEBUG] ProviderTransformer: "aws_internet_gateway.rancher_gateway (expand)" (terraform.nodeExpandApplyableResource) needs provider["registry.terraform.io/hashicorp/aws"] 2023-02-28T13:12:27.419-0400 [DEBUG] ProviderTransformer: "aws_route_table.rancher_route_table (expand)" (terraform.nodeExpandApplyableResource) needs provider["registry.terraform.io/hashicorp/aws"] 2023-02-28T13:12:27.419-0400 [DEBUG] ProviderTransformer: "module.rancher_common.rancher2_bootstrap.admin" (terraform.NodeApplyableResourceInstance) needs module.rancher_common.provider["registry.terraform.io/rancher/rancher2"].bootstrap 2023-02-28T13:12:27.419-0400 [DEBUG] ProviderTransformer: "module.rancher_common.helm_release.cert_manager (expand)" (terraform.nodeExpandApplyableResource) needs module.rancher_common.provider["registry.terraform.io/hashicorp/helm"] 2023-02-28T13:12:27.419-0400 [DEBUG] ProviderTransformer: "module.rancher_common.rancher2_cluster_v2.quickstart_workload" (terraform.NodeApplyableResourceInstance) needs module.rancher_common.provider["registry.terraform.io/rancher/rancher2"].admin 2023-02-28T13:12:27.419-0400 [DEBUG] ProviderTransformer: "module.rancher_common.rancher2_cluster_v2.quickstart_workload (expand)" (terraform.nodeExpandApplyableResource) needs module.rancher_common.provider["registry.terraform.io/rancher/rancher2"].admin 2023-02-28T13:12:27.419-0400 [DEBUG] ProviderTransformer: "data.aws_ami.windows (expand)" (terraform.nodeExpandApplyableResource) needs provider["registry.terraform.io/hashicorp/aws"] 2023-02-28T13:12:27.420-0400 [DEBUG] pruning unused provider["registry.terraform.io/hashicorp/helm"] 2023-02-28T13:12:27.420-0400 [DEBUG] pruning unused provider["registry.terraform.io/rancher/rancher2"] 2023-02-28T13:12:27.421-0400 [DEBUG] ReferenceTransformer: "module.rancher_common.provider[\"registry.terraform.io/rancher/rancher2\"].admin" references: [module.rancher_common.rancher2_bootstrap.admin (expand) module.rancher_common.rancher2_bootstrap.admin module.rancher_common.rancher2_bootstrap.admin module.rancher_common.var.rancher_server_dns (expand)] 2023-02-28T13:12:27.421-0400 [DEBUG] ReferenceTransformer: "module.rancher_common.rancher2_cluster_v2.quickstart_workload (expand)" references: [] 2023-02-28T13:12:27.421-0400 [DEBUG] ReferenceTransformer: "module.rancher_common.var.rancher_kubernetes_version (expand)" references: [var.rancher_kubernetes_version] 2023-02-28T13:12:27.421-0400 [DEBUG] ReferenceTransformer: "provider[\"registry.terraform.io/hashicorp/tls\"]" references: [] 2023-02-28T13:12:27.421-0400 [DEBUG] ReferenceTransformer: "var.instance_type" references: [] 2023-02-28T13:12:27.421-0400 [DEBUG] ReferenceTransformer: "module.rancher_common.var.workload_cluster_name (expand)" references: [] 2023-02-28T13:12:27.421-0400 [DEBUG] ReferenceTransformer: "module.rancher_common.var.cert_manager_version (expand)" references: [var.cert_manager_version] 2023-02-28T13:12:27.421-0400 [DEBUG] ReferenceTransformer: "module.rancher_common.var.node_internal_ip (expand)" references: [aws_instance.rancher_server (expand)] 2023-02-28T13:12:27.421-0400 [DEBUG] ReferenceTransformer: "aws_route_table_association.rancher_route_table_association (expand)" references: [] 2023-02-28T13:12:27.421-0400 [DEBUG] ReferenceTransformer: "var.rancher_kubernetes_version" references: [] 2023-02-28T13:12:27.421-0400 [DEBUG] ReferenceTransformer: "module.rancher_common.var.ssh_private_key_pem (expand)" references: [tls_private_key.global_key (expand)] 2023-02-28T13:12:27.421-0400 [INFO] ReferenceTransformer: reference not found: "path.module" 2023-02-28T13:12:27.421-0400 [INFO] ReferenceTransformer: reference not found: "self" 2023-02-28T13:12:27.421-0400 [INFO] ReferenceTransformer: reference not found: "aws_route_table_association.rancher_route_table_association#destroy" 2023-02-28T13:12:27.421-0400 [DEBUG] ReferenceTransformer: "aws_instance.quickstart_node" references: [aws_route_table_association.rancher_route_table_association (expand) aws_key_pair.quickstart_key_pair (expand) var.prefix data.aws_ami.sles (expand) aws_subnet.rancher_subnet (expand) aws_security_group.rancher_sg_allowall (expand) module.rancher_common.output.custom_cluster_command (expand) var.instance_type local.node_username (expand) tls_private_key.global_key (expand)] 2023-02-28T13:12:27.421-0400 [DEBUG] ReferenceTransformer: "local_sensitive_file.ssh_private_key_pem (expand)" references: [] 2023-02-28T13:12:27.422-0400 [DEBUG] ReferenceTransformer: "aws_internet_gateway.rancher_gateway (expand)" references: [] 2023-02-28T13:12:27.422-0400 [DEBUG] ReferenceTransformer: "var.aws_access_key" references: [] 2023-02-28T13:12:27.422-0400 [DEBUG] ReferenceTransformer: "module.rancher_common.var.node_username (expand)" references: [local.node_username (expand)] 2023-02-28T13:12:27.422-0400 [INFO] ReferenceTransformer: reference not found: "path.root" 2023-02-28T13:12:27.422-0400 [DEBUG] ReferenceTransformer: "module.rancher_common.local_file.kube_config_workload_yaml" references: [module.rancher_common.rancher2_cluster_v2.quickstart_workload (expand) module.rancher_common.rancher2_cluster_v2.quickstart_workload module.rancher_common.rancher2_cluster_v2.quickstart_workload] 2023-02-28T13:12:27.422-0400 [DEBUG] ReferenceTransformer: "module.rancher_common.provider[\"registry.terraform.io/rancher/rancher2\"].bootstrap" references: [module.rancher_common.var.rancher_server_dns (expand)] 2023-02-28T13:12:27.422-0400 [DEBUG] ReferenceTransformer: "provider[\"registry.terraform.io/hashicorp/http\"]" references: [] 2023-02-28T13:12:27.422-0400 [DEBUG] ReferenceTransformer: "module.rancher_common (close)" references: [] 2023-02-28T13:12:27.422-0400 [DEBUG] ReferenceTransformer: "aws_security_group.rancher_sg_allowall (expand)" references: [] 2023-02-28T13:12:27.422-0400 [DEBUG] ReferenceTransformer: "var.aws_region" references: [] 2023-02-28T13:12:27.422-0400 [DEBUG] ReferenceTransformer: "var.prefix" references: [] 2023-02-28T13:12:27.422-0400 [DEBUG] ReferenceTransformer: "module.rancher_common.var.node_public_ip (expand)" references: [aws_instance.rancher_server (expand)] 2023-02-28T13:12:27.422-0400 [DEBUG] ReferenceTransformer: "output.windows_password (expand)" references: [aws_instance.quickstart_node_win (expand) tls_private_key.global_key (expand)] 2023-02-28T13:12:27.422-0400 [DEBUG] ReferenceTransformer: "module.rancher_common.rancher2_bootstrap.admin (expand)" references: [] 2023-02-28T13:12:27.422-0400 [DEBUG] ReferenceTransformer: "var.aws_zone" references: [] 2023-02-28T13:12:27.422-0400 [DEBUG] ReferenceTransformer: "var.workload_kubernetes_version" references: [] 2023-02-28T13:12:27.422-0400 [DEBUG] ReferenceTransformer: "var.rancher_version" references: [] 2023-02-28T13:12:27.422-0400 [DEBUG] ReferenceTransformer: "module.rancher_common.rancher2_cluster_v2.quickstart_workload" references: [module.rancher_common.var.workload_cluster_name (expand) module.rancher_common.var.workload_kubernetes_version (expand)] 2023-02-28T13:12:27.422-0400 [DEBUG] ReferenceTransformer: "provider[\"registry.terraform.io/hashicorp/aws\"]" references: [var.aws_region var.aws_session_token] 2023-02-28T13:12:27.422-0400 [DEBUG] ReferenceTransformer: "data.aws_ami.sles (expand)" references: [] 2023-02-28T13:12:27.422-0400 [DEBUG] ReferenceTransformer: "module.rancher_common.ssh_resource.install_k3s (expand)" references: [] 2023-02-28T13:12:27.422-0400 [DEBUG] ReferenceTransformer: "module.rancher_common.helm_release.rancher_server (expand)" references: [] 2023-02-28T13:12:27.422-0400 [DEBUG] ReferenceTransformer: "module.rancher_common.var.rancher_server_dns (expand)" references: [aws_instance.rancher_server (expand)] 2023-02-28T13:12:27.422-0400 [DEBUG] ReferenceTransformer: "module.rancher_common.var.rancher_helm_repository (expand)" references: [var.rancher_helm_repository] 2023-02-28T13:12:27.422-0400 [DEBUG] ReferenceTransformer: "output.workload_node_ip (expand)" references: [aws_instance.quickstart_node aws_instance.quickstart_node aws_instance.quickstart_node (expand)] 2023-02-28T13:12:27.422-0400 [DEBUG] ReferenceTransformer: "provider[\"registry.terraform.io/loafoe/ssh\"]" references: [] 2023-02-28T13:12:27.422-0400 [DEBUG] ReferenceTransformer: "aws_key_pair.quickstart_key_pair (expand)" references: [] 2023-02-28T13:12:27.422-0400 [DEBUG] ReferenceTransformer: "module.rancher_common.local_file.kube_config_workload_yaml (expand)" references: [] 2023-02-28T13:12:27.422-0400 [DEBUG] ReferenceTransformer: "var.rancher_server_admin_password" references: [] 2023-02-28T13:12:27.422-0400 [DEBUG] ReferenceTransformer: "var.add_windows_node" references: [] 2023-02-28T13:12:27.422-0400 [DEBUG] ReferenceTransformer: "aws_instance.rancher_server (expand)" references: [] 2023-02-28T13:12:27.422-0400 [DEBUG] ReferenceTransformer: "aws_instance.quickstart_node_win (expand)" references: [var.add_windows_node] 2023-02-28T13:12:27.422-0400 [DEBUG] ReferenceTransformer: "module.rancher_common.ssh_resource.retrieve_config (expand)" references: [] 2023-02-28T13:12:27.422-0400 [DEBUG] ReferenceTransformer: "module.rancher_common.var.admin_password (expand)" references: [var.rancher_server_admin_password] 2023-02-28T13:12:27.422-0400 [DEBUG] ReferenceTransformer: "module.rancher_common.output.rancher_url (expand)" references: [module.rancher_common.var.rancher_server_dns (expand)] 2023-02-28T13:12:27.422-0400 [INFO] ReferenceTransformer: reference not found: "helm_release.rancher_server#destroy" 2023-02-28T13:12:27.422-0400 [DEBUG] ReferenceTransformer: "module.rancher_common.rancher2_bootstrap.admin" references: [module.rancher_common.helm_release.rancher_server (expand) module.rancher_common.var.admin_password (expand)] 2023-02-28T13:12:27.422-0400 [DEBUG] ReferenceTransformer: "module.rancher_common.provider[\"registry.terraform.io/hashicorp/helm\"]" references: [module.rancher_common.local_file.kube_config_server_yaml (expand)] 2023-02-28T13:12:27.422-0400 [DEBUG] ReferenceTransformer: "var.aws_secret_key" references: [] 2023-02-28T13:12:27.422-0400 [DEBUG] ReferenceTransformer: "var.cert_manager_version" references: [] 2023-02-28T13:12:27.422-0400 [DEBUG] ReferenceTransformer: "output.rancher_node_ip (expand)" references: [aws_instance.rancher_server (expand)] 2023-02-28T13:12:27.422-0400 [DEBUG] ReferenceTransformer: "provider[\"registry.terraform.io/hashicorp/local\"]" references: [] 2023-02-28T13:12:27.422-0400 [DEBUG] ReferenceTransformer: "aws_instance.quickstart_node (expand)" references: [] 2023-02-28T13:12:27.422-0400 [DEBUG] ReferenceTransformer: "module.rancher_common.helm_release.cert_manager (expand)" references: [] 2023-02-28T13:12:27.422-0400 [DEBUG] ReferenceTransformer: "var.rancher_helm_repository" references: [] 2023-02-28T13:12:27.422-0400 [DEBUG] ReferenceTransformer: "var.windows_instance_type" references: [] 2023-02-28T13:12:27.423-0400 [DEBUG] ReferenceTransformer: "module.rancher_common.output.custom_cluster_windows_command (expand)" references: [module.rancher_common.rancher2_cluster_v2.quickstart_workload (expand) module.rancher_common.rancher2_cluster_v2.quickstart_workload module.rancher_common.rancher2_cluster_v2.quickstart_workload] 2023-02-28T13:12:27.423-0400 [DEBUG] ReferenceTransformer: "module.rancher_common (expand)" references: [] 2023-02-28T13:12:27.423-0400 [DEBUG] ReferenceTransformer: "aws_vpc.rancher_vpc (expand)" references: [] 2023-02-28T13:12:27.423-0400 [DEBUG] ReferenceTransformer: "data.http.ip (expand)" references: [] 2023-02-28T13:12:27.423-0400 [DEBUG] ReferenceTransformer: "data.aws_ami.windows (expand)" references: [] 2023-02-28T13:12:27.423-0400 [DEBUG] ReferenceTransformer: "module.rancher_common.var.rancher_version (expand)" references: [var.rancher_version] 2023-02-28T13:12:27.423-0400 [DEBUG] ReferenceTransformer: "local.node_username (expand)" references: [] 2023-02-28T13:12:27.423-0400 [DEBUG] ReferenceTransformer: "aws_route_table.rancher_route_table (expand)" references: [] 2023-02-28T13:12:27.423-0400 [DEBUG] ReferenceTransformer: "local_file.ssh_public_key_openssh (expand)" references: [] 2023-02-28T13:12:27.423-0400 [DEBUG] ReferenceTransformer: "module.rancher_common.var.workload_kubernetes_version (expand)" references: [var.workload_kubernetes_version] 2023-02-28T13:12:27.423-0400 [DEBUG] ReferenceTransformer: "output.windows-workload-ips (expand)" references: [aws_instance.quickstart_node_win (expand)] 2023-02-28T13:12:27.423-0400 [DEBUG] ReferenceTransformer: "output.rancher_server_url (expand)" references: [module.rancher_common.output.rancher_url (expand)] 2023-02-28T13:12:27.423-0400 [DEBUG] ReferenceTransformer: "aws_subnet.rancher_subnet (expand)" references: [] 2023-02-28T13:12:27.423-0400 [DEBUG] ReferenceTransformer: "module.rancher_common.local_file.kube_config_server_yaml (expand)" references: [] 2023-02-28T13:12:27.423-0400 [DEBUG] ReferenceTransformer: "module.rancher_common.output.custom_cluster_command (expand)" references: [module.rancher_common.rancher2_cluster_v2.quickstart_workload (expand) module.rancher_common.rancher2_cluster_v2.quickstart_workload module.rancher_common.rancher2_cluster_v2.quickstart_workload] 2023-02-28T13:12:27.423-0400 [DEBUG] ReferenceTransformer: "tls_private_key.global_key (expand)" references: [] 2023-02-28T13:12:27.423-0400 [DEBUG] ReferenceTransformer: "var.aws_session_token" references: [] 2023-02-28T13:12:27.425-0400 [DEBUG] pruneUnusedNodes: module.rancher_common.var.rancher_kubernetes_version (expand) is no longer needed, removing 2023-02-28T13:12:27.425-0400 [DEBUG] pruneUnusedNodes: module.rancher_common.var.cert_manager_version (expand) is no longer needed, removing 2023-02-28T13:12:27.425-0400 [DEBUG] pruneUnusedNodes: module.rancher_common.var.node_internal_ip (expand) is no longer needed, removing 2023-02-28T13:12:27.425-0400 [DEBUG] pruneUnusedNodes: module.rancher_common.var.ssh_private_key_pem (expand) is no longer needed, removing 2023-02-28T13:12:27.425-0400 [DEBUG] pruneUnusedNodes: local_sensitive_file.ssh_private_key_pem (expand) is no longer needed, removing 2023-02-28T13:12:27.425-0400 [DEBUG] pruneUnusedNodes: aws_internet_gateway.rancher_gateway (expand) is no longer needed, removing 2023-02-28T13:12:27.425-0400 [DEBUG] pruneUnusedNodes: module.rancher_common.var.node_username (expand) is no longer needed, removing 2023-02-28T13:12:27.425-0400 [DEBUG] pruneUnusedNodes: module.rancher_common.var.node_public_ip (expand) is no longer needed, removing 2023-02-28T13:12:27.425-0400 [DEBUG] pruneUnusedNodes: module.rancher_common.ssh_resource.install_k3s (expand) is no longer needed, removing 2023-02-28T13:12:27.425-0400 [DEBUG] pruneUnusedNodes: module.rancher_common.var.rancher_helm_repository (expand) is no longer needed, removing 2023-02-28T13:12:27.425-0400 [DEBUG] pruneUnusedNodes: aws_instance.quickstart_node_win (expand) is no longer needed, removing 2023-02-28T13:12:27.425-0400 [DEBUG] pruneUnusedNodes: module.rancher_common.ssh_resource.retrieve_config (expand) is no longer needed, removing 2023-02-28T13:12:27.425-0400 [DEBUG] pruneUnusedNodes: module.rancher_common.helm_release.cert_manager (expand) is no longer needed, removing 2023-02-28T13:12:27.425-0400 [DEBUG] pruneUnusedNodes: module.rancher_common.output.custom_cluster_windows_command (expand) is no longer needed, removing 2023-02-28T13:12:27.425-0400 [DEBUG] pruneUnusedNodes: module.rancher_common.local_file.kube_config_server_yaml (expand) is no longer needed, removing 2023-02-28T13:12:27.425-0400 [DEBUG] pruneUnusedNodes: local_file.ssh_public_key_openssh (expand) is no longer needed, removing 2023-02-28T13:12:27.425-0400 [DEBUG] pruneUnusedNodes: aws_route_table.rancher_route_table (expand) is no longer needed, removing 2023-02-28T13:12:27.425-0400 [DEBUG] pruneUnusedNodes: module.rancher_common.var.rancher_version (expand) is no longer needed, removing 2023-02-28T13:12:27.425-0400 [DEBUG] pruneUnusedNodes: data.aws_ami.windows (expand) is no longer needed, removing 2023-02-28T13:12:27.425-0400 [DEBUG] pruneUnusedNodes: provider["registry.terraform.io/loafoe/ssh"] is no longer needed, removing 2023-02-28T13:12:27.425-0400 [DEBUG] pruneUnusedNodes: data.http.ip (expand) is no longer needed, removing 2023-02-28T13:12:27.425-0400 [DEBUG] pruneUnusedNodes: aws_vpc.rancher_vpc (expand) is no longer needed, removing 2023-02-28T13:12:27.425-0400 [DEBUG] pruneUnusedNodes: provider["registry.terraform.io/hashicorp/http"] is no longer needed, removing 2023-02-28T13:12:27.426-0400 [DEBUG] Starting graph walk: walkApply 2023-02-28T13:12:27.427-0400 [DEBUG] created provider logger: level=debug 2023-02-28T13:12:27.427-0400 [INFO] provider: configuring client automatic mTLS 2023-02-28T13:12:27.433-0400 [DEBUG] provider: starting plugin: path=.terraform/providers/registry.terraform.io/hashicorp/local/2.2.3/linux_amd64/terraform-provider-local_v2.2.3_x5 args=[.terraform/providers/registry.terraform.io/hashicorp/local/2.2.3/linux_amd64/terraform-provider-local_v2.2.3_x5] 2023-02-28T13:12:27.434-0400 [DEBUG] provider: plugin started: path=.terraform/providers/registry.terraform.io/hashicorp/local/2.2.3/linux_amd64/terraform-provider-local_v2.2.3_x5 pid=11296 2023-02-28T13:12:27.434-0400 [DEBUG] provider: waiting for RPC address: path=.terraform/providers/registry.terraform.io/hashicorp/local/2.2.3/linux_amd64/terraform-provider-local_v2.2.3_x5 2023-02-28T13:12:27.440-0400 [INFO] provider.terraform-provider-local_v2.2.3_x5: configuring server automatic mTLS: timestamp=2023-02-28T13:12:27.439-0400 2023-02-28T13:12:27.465-0400 [DEBUG] provider: using plugin: version=5 2023-02-28T13:12:27.465-0400 [DEBUG] provider.terraform-provider-local_v2.2.3_x5: plugin address: address=/tmp/plugin078043677 network=unix timestamp=2023-02-28T13:12:27.465-0400 2023-02-28T13:12:27.484-0400 [DEBUG] created provider logger: level=debug 2023-02-28T13:12:27.484-0400 [INFO] provider: configuring client automatic mTLS 2023-02-28T13:12:27.490-0400 [DEBUG] provider: starting plugin: path=.terraform/providers/registry.terraform.io/hashicorp/helm/2.9.0/linux_amd64/terraform-provider-helm_v2.9.0_x5 args=[.terraform/providers/registry.terraform.io/hashicorp/helm/2.9.0/linux_amd64/terraform-provider-helm_v2.9.0_x5] 2023-02-28T13:12:27.491-0400 [DEBUG] provider: plugin started: path=.terraform/providers/registry.terraform.io/hashicorp/helm/2.9.0/linux_amd64/terraform-provider-helm_v2.9.0_x5 pid=11308 2023-02-28T13:12:27.491-0400 [DEBUG] provider: waiting for RPC address: path=.terraform/providers/registry.terraform.io/hashicorp/helm/2.9.0/linux_amd64/terraform-provider-helm_v2.9.0_x5 2023-02-28T13:12:27.512-0400 [INFO] provider.terraform-provider-helm_v2.9.0_x5: configuring server automatic mTLS: timestamp=2023-02-28T13:12:27.512-0400 2023-02-28T13:12:27.529-0400 [DEBUG] provider: using plugin: version=5 2023-02-28T13:12:27.529-0400 [DEBUG] provider.terraform-provider-helm_v2.9.0_x5: plugin address: address=/tmp/plugin635751179 network=unix timestamp=2023-02-28T13:12:27.529-0400 2023-02-28T13:12:27.544-0400 [DEBUG] created provider logger: level=debug 2023-02-28T13:12:27.544-0400 [INFO] provider: configuring client automatic mTLS 2023-02-28T13:12:27.550-0400 [DEBUG] provider: starting plugin: path=.terraform/providers/registry.terraform.io/hashicorp/tls/3.4.0/linux_amd64/terraform-provider-tls_v3.4.0_x5 args=[.terraform/providers/registry.terraform.io/hashicorp/tls/3.4.0/linux_amd64/terraform-provider-tls_v3.4.0_x5] 2023-02-28T13:12:27.550-0400 [DEBUG] provider: plugin started: path=.terraform/providers/registry.terraform.io/hashicorp/tls/3.4.0/linux_amd64/terraform-provider-tls_v3.4.0_x5 pid=11326 2023-02-28T13:12:27.550-0400 [DEBUG] provider: waiting for RPC address: path=.terraform/providers/registry.terraform.io/hashicorp/tls/3.4.0/linux_amd64/terraform-provider-tls_v3.4.0_x5 2023-02-28T13:12:27.555-0400 [INFO] provider.terraform-provider-tls_v3.4.0_x5: configuring server automatic mTLS: timestamp=2023-02-28T13:12:27.555-0400 2023-02-28T13:12:27.561-0400 [DEBUG] provider: using plugin: version=5 2023-02-28T13:12:27.562-0400 [DEBUG] provider.terraform-provider-tls_v3.4.0_x5: plugin address: address=/tmp/plugin953863215 network=unix timestamp=2023-02-28T13:12:27.561-0400 2023-02-28T13:12:27.572-0400 [DEBUG] created provider logger: level=debug 2023-02-28T13:12:27.572-0400 [INFO] provider: configuring client automatic mTLS 2023-02-28T13:12:27.578-0400 [WARN] ValidateProviderConfig from "module.rancher_common.provider[\"registry.terraform.io/hashicorp/helm\"]" changed the config value, but that value is unused 2023-02-28T13:12:27.580-0400 [DEBUG] provider: starting plugin: path=.terraform/providers/registry.terraform.io/hashicorp/aws/4.18.0/linux_amd64/terraform-provider-aws_v4.18.0_x5 args=[.terraform/providers/registry.terraform.io/hashicorp/aws/4.18.0/linux_amd64/terraform-provider-aws_v4.18.0_x5] 2023-02-28T13:12:27.580-0400 [DEBUG] provider: plugin started: path=.terraform/providers/registry.terraform.io/hashicorp/aws/4.18.0/linux_amd64/terraform-provider-aws_v4.18.0_x5 pid=11338 2023-02-28T13:12:27.580-0400 [DEBUG] provider: waiting for RPC address: path=.terraform/providers/registry.terraform.io/hashicorp/aws/4.18.0/linux_amd64/terraform-provider-aws_v4.18.0_x5 2023-02-28T13:12:27.592-0400 [INFO] provider.terraform-provider-aws_v4.18.0_x5: configuring server automatic mTLS: timestamp=2023-02-28T13:12:27.592-0400 2023-02-28T13:12:27.623-0400 [DEBUG] provider.terraform-provider-aws_v4.18.0_x5: plugin address: address=/tmp/plugin3061339940 network=unix timestamp=2023-02-28T13:12:27.622-0400 2023-02-28T13:12:27.623-0400 [DEBUG] provider: using plugin: version=5 2023-02-28T13:12:27.634-0400 [DEBUG] provider.stdio: received EOF, stopping recv loop: err="rpc error: code = Unavailable desc = error reading from server: EOF" 2023-02-28T13:12:27.634-0400 [INFO] provider.terraform-provider-helm_v2.9.0_x5: 2023/02/28 13:12:27 [DEBUG] Experiments enabled: []: timestamp=2023-02-28T13:12:27.634-0400 2023-02-28T13:12:27.635-0400 [DEBUG] provider: plugin process exited: path=.terraform/providers/registry.terraform.io/hashicorp/tls/3.4.0/linux_amd64/terraform-provider-tls_v3.4.0_x5 pid=11326 2023-02-28T13:12:27.635-0400 [DEBUG] provider: plugin exited 2023-02-28T13:12:27.686-0400 [DEBUG] provider.stdio: received EOF, stopping recv loop: err="rpc error: code = Unavailable desc = error reading from server: EOF" 2023-02-28T13:12:27.688-0400 [DEBUG] provider: plugin process exited: path=.terraform/providers/registry.terraform.io/hashicorp/helm/2.9.0/linux_amd64/terraform-provider-helm_v2.9.0_x5 pid=11308 2023-02-28T13:12:27.688-0400 [DEBUG] provider: plugin exited 2023-02-28T13:12:27.810-0400 [WARN] ValidateProviderConfig from "provider[\"registry.terraform.io/hashicorp/aws\"]" changed the config value, but that value is unused 2023-02-28T13:12:27.814-0400 [INFO] provider.terraform-provider-aws_v4.18.0_x5: Retrieved credentials from "EnvConfigCredentials": timestamp=2023-02-28T13:12:27.813-0400 2023-02-28T13:12:27.815-0400 [DEBUG] provider.terraform-provider-aws_v4.18.0_x5: Trying to get account information via sts:GetCallerIdentity: timestamp=2023-02-28T13:12:27.814-0400 2023-02-28T13:12:27.815-0400 [DEBUG] provider.terraform-provider-aws_v4.18.0_x5: [aws-sdk-go-v2] Request POST / HTTP/1.1 Host: sts.us-east-1.amazonaws.com User-Agent: APN/1.0 HashiCorp/1.0 Terraform/1.3.6 (+https://www.terraform.io) terraform-provider-aws/dev (+https://registry.terraform.io/providers/hashicorp/aws) aws-sdk-go-v2/1.16.5 os/linux lang/go/1.17.6 md/GOOS/linux md/GOARCH/amd64 api/sts/1.16.4 Content-Length: 43 Amz-Sdk-Invocation-Id: f83e0597-d544-489e-8a45-6e49794ae2c5 Amz-Sdk-Request: attempt=1; max=25 Authorization: AWS4-HMAC-SHA256 Credential=AKIA5DPC6D5ACM33HY6I/20230228/us-east-1/sts/aws4_request, SignedHeaders=amz-sdk-invocation-id;amz-sdk-request;content-length;content-type;host;x-amz-date, Signature=8356f4027c05f9ca39ccef7a04eb1855d403bd27760d7b7703908846b5857417 Content-Type: application/x-www-form-urlencoded X-Amz-Date: 20230228T171227Z Accept-Encoding: gzip
Action=GetCallerIdentity&Version=2011-06-15: timestamp=2023-02-28T13:12:27.815-0400 2023-02-28T13:12:28.232-0400 [DEBUG] provider.terraform-provider-aws_v4.18.0_x5: [aws-sdk-go-v2] Response HTTP/1.1 200 OK Content-Length: 407 Content-Type: text/xml Date: Tue, 28 Feb 2023 17:12:19 GMT X-Amzn-Requestid: 3783aa21-88dd-43cf-b820-7c4987590881
I am trying to deploy rancher to aws via terraform but got below error at the end. The rancher provider version is
1.23.0
. What could be the reason causing this error?I am using
Terraform v1.1.6
.