[question]: error "another operation install/upgrade/rollback is in progress" monitoring upgrade to 24-08-24

wesbragagt commented 2 months ago

Prior Search

[X] I have already searched this project's issues to determine if a similar question has already been asked.

What is your question?

Hey, I'm running the 08-22-2024 release and I was trying to upgrade to 08-24-2024 however I keep getting the following error under kube_monitoring. I also can't find any references to that redis-9a3d. What other steps can I try to recover?

plan. Resource actions are indicated with the following symbols:
  ~ update in-place

OpenTofu will perform the following actions:

  # module.redis_cache.helm_release.redis will be updated in-place
  ~ resource "helm_release" "redis" {
        id                         = "redis-9a3d"
        name                       = "redis-9a3d"
      ~ status                     = "pending-upgrade" -> "deployed"
        # (27 unchanged attributes hidden)

        # (1 unchanged block hidden)
    }

Plan: 0 to add, 1 to change, 0 to destroy.
module.redis_cache.helm_release.redis: Modifying... [id=redis-9a3d]
╷
│ Error: another operation (install/upgrade/rollback) is in progress
│
│   with module.redis_cache.helm_release.redis,
│   on ../kube_redis_sentinel/main.tf line 103, in resource "helm_release" "redis":
│  103: resource "helm_release" "redis" {
│
╵
ERRO[0051] tofu invocation failed in /Users/wesbragagt/dev/work/implentio/infrastructure-v2/.terragrunt-cache/CmTEAzeKxSt97XgfhAc19UAW6PQ/jefY46BK7z-2whPUMHguV-9ROrg/packages/infrastructure/kube_logging  error=[/Users/wesbragagt/dev/work/implentio/infrastructure-v2/.terragrunt-cache/CmTEAzeKxSt97XgfhAc19UAW6PQ/jefY46BK7z-2whPUMHguV-9ROrg/packages/infrastructure/kube_logging] exit status 1 prefix=[/Users/wesbragagt/dev/work/implentio/infrastructure-v2/environments/development/us-west-2/kube_logging]
ERRO[0051] 1 error occurred:
        * [/Users/wesbragagt/dev/work/implentio/infrastructure-v2/.terragrunt-cache/CmTEAzeKxSt97XgfhAc19UAW6PQ/jefY46BK7z-2whPUMHguV-9ROrg/packages/infrastructure/kube_logging] exit status 1

What primary components of the stack does this relate to?

terraform

Code of Conduct

[X] I agree to follow this project's Code of Conduct

fullykubed commented 2 months ago

You cannot skip edge versions when upgrading. So, you need to have gone edge.24-08-22 -> edge.24-08-23 -> edge.24-08-24.

The current error shows that your helm deployment failed.

To resolve, you need to initial a rollback helm rollback on the Helm chart deployed by the module and try again.

wesbragagt commented 2 months ago

@fullykubed That resolved my issue. Thank you for the clarity.

Panfactum / stack