[BUG] Error removing Cloud Credential

principekiss commented 1 year ago

Rancher Server Setup

Rancher version: 2.7.1
Installation option (Docker install/Helm Chart): Helm Chart
- If Helm Chart, Kubernetes Cluster and version (RKE1, RKE2, k3s, EKS, etc): AKS, Helm provider v2.6.0
Proxy/Cert Details: Ingress Nginx v4.5.2/Cert Manager v1.11.0

Information about the Cluster

Kubernetes version: v1.23.15
Cluster Type (Local/Downstream): Local

User Information

What is the role of the user logged in? Admin/Cluster

Provider Information

What is the version of the Rancher v2 Terraform Provider in use? v1.25.0
What is the version of Terraform in use? v1.3.7

Describe the bug

On Terraform destroy, the rancher2_cloud_credential resource return an error intermittently:

Error removing Cloud Credential: Bad response statusCode [500]. Status [500 Internal Server Error]. Body: [baseType=error, code=ServerError, message=Index with name by-cloud-cred does not exist] from [https://rancher.lawliet.net/v3/cloudCredentials/cattle-global-data:cc-lxwhp]

When browsing the URL https://rancher.lawliet.net/v3/cloudCredentials/cattle-global-data:cc-lxwhp, the cloud credential exists.

If running multiple times the terraform destroy command, it finally gets deleted.

This bug appeared since Rancher v2.6.9.

To Reproduce

Install the Ingress Nginx, Cert Manager and Rancher in an AKS cluster
Create a DNS record pointing to the Ingress Nginx Controller LB Public IP with the following pattern: "https://rancher.${var.dns_zone}"

Setup the rancher2 provider:


provider "rancher2" {
alias      = "bootstrap"

bootstrap  = true
api_url    = "https://rancher.${var.dns_zone}"
insecure   = true
timeout    = "600s"
}

resource "rancher2_bootstrap" "admin" { provider = rancher2.bootstrap

initial_password  = random_password.rancher.result
password          = var.admin_password
telemetry         = false
token_update      = false

depends_on = [ helm_release.rancher, azurerm_dns_a_record.rancher ] }

provider "rancher2" { alias = "admin"

api_url    = rancher2_bootstrap.admin.url
token_key  = rancher2_bootstrap.admin.token
insecure   = true
timeout    = "600s"

}

- Create cloud credentials 

### Actual Result
rancher2 Terraform provider fail to remove the cloud credentials:

```sh
rancher2_cloud_credential.rancher: Destroying... [id=cattle-global-data:cc-lxwhp]
╷
│ Error: Error removing Cloud Credential: Bad response statusCode [500]. Status [500 Internal Server Error]. Body: [baseType=error, code=ServerError, message=Index with name by-cloud-cred does not exist] from [https://rancher.ines.kangaroot.net/v3/cloudCredentials/cattle-global-data:cc-lxwhp]

Expected Result

The cloud credentials destroyed successfully.

davidhrbac commented 1 year ago

Same here.

code-eg commented 1 year ago

This happens often for me as well, even in the Rancher UI it takes 3-4 retries for Rancher to actually delete a credential. This was so bad I had to rip out the Cloud Credential from my Terraform and re-use the same Cloud Credential for every cluster. Very frustrating experience.

rancher / terraform-provider-rancher2