syndesisio / syndesis

A flexible, customizable, open source platform that provides core integration capabilities as a service.
https://syndesis.io/
Apache License 2.0
592 stars 205 forks source link

Stuck in UpgradeFailed CR status #9981

Open akraskovski opened 1 year ago

akraskovski commented 1 year ago

Hi everyone, need some help to move from stuck CR status "UpgradeFailed".

Pre-condition We got a situation while operator reconciling the DB wasn't reachable. So after 5 retry attempts of "Db upgrade" job execution it failed and set the status of Custom Resource to "Upgrade Failed".

apiVersion: syndesis.io/v1beta3
kind: Syndesis
...
status:
  backup: {}
  description: Upgrade failed too many times and will not be retried
  lastUpgradeFailure: '2023-01-30T10:13:36Z'
  phase: UpgradeFailed
  reason: TooManyUpgradeAttempts
  upgradeAttempts: 5
  version: 1.7.3.141.dev

Current DB state is OK. But the syndesis operator do nothing due to stuck CR status "UpgradeFailed"

Problem The official guide says that:

UpgradeFailed: After the maximum amount of failed upgrades, the upgrade will not be tried anymore. The CR needs a manual action to move away from here

Can anyone help what does it mean: The CR needs a manual action to move away from here?

claudio4j commented 1 year ago

Are you trying to upgrade from 1.6 ro 1.7 ? When the upgrade process starts, you can have a look at the syndesis operator pod log, also there is an additional pod created that takes care of the migration, can you have a look at the pod's log to see if there errors there ? Also, if you don't have too much integrations running, you can export them to files on your local file system to later import them into a new syndesis installation.