Argo app health for CP4WAIOps is Degraded in some cases

[morningspace]

Sometimes when deploy CP4WAIOps, the Argo Application for CP4WAIOps shows Degraded. This is due to the Subscription ibm-aiops-orchestrator has missing install plan which is detected by Argo health check. e.g.:

  conditions:
    - lastTransitionTime: '2022-02-20T23:58:03Z'
      message: all available catalogsources are healthy
      reason: AllCatalogSourcesHealthy
      status: 'False'
      type: CatalogSourcesUnhealthy
    - lastTransitionTime: '2022-02-21T00:06:46Z'
      reason: ReferencedInstallPlanNotFound
      status: 'True'
      type: InstallPlanMissing
  installPlanRef:
    apiVersion: operators.coreos.com/v1alpha1
    kind: InstallPlan
    name: install-t76br
    namespace: cp4waiops
    resourceVersion: '38323'
    uid: 21238495-bcfd-473a-a178-6c1ddc67b0f0
  installplan:
    apiVersion: operators.coreos.com/v1alpha1
    kind: InstallPlan
    name: install-t76br
    uuid: 21238495-bcfd-473a-a178-6c1ddc67b0f0

Usually the installplan should be there in the namespace where CP4WAIOps is deployed. When see this, I cannot find the installplan. However, it looks all pods are still up and running quite well.

[essie-chiang]

Same issue with install plan missing.

But to check the status of ai manager, it failed without any event or error log, all pod in cp4waiops namespace is running or complete status.

  conditions:
    - lastTransitionTime: '2022-03-02T06:09:08Z'
      message: all available catalogsources are healthy
      reason: AllCatalogSourcesHealthy
      status: 'False'
      type: CatalogSourcesUnhealthy
    - lastTransitionTime: '2022-03-02T06:19:09Z'
      reason: ReferencedInstallPlanNotFound
      status: 'True'
      type: InstallPlanMissing
  currentCSV: ibm-aiops-orchestrator.v3.2.1
  installPlanGeneration: 1
  installPlanRef:
    apiVersion: operators.coreos.com/v1alpha1
    kind: InstallPlan
    name: install-q7dv4
    namespace: cp4waiops
    resourceVersion: '1047194'
    uid: 8e15fc10-c65a-4c0c-a5dd-49c6950735c3
  installedCSV: ibm-aiops-orchestrator.v3.2.1
  installplan:
    apiVersion: operators.coreos.com/v1alpha1
    kind: InstallPlan
    name: install-q7dv4
    uuid: 8e15fc10-c65a-4c0c-a5dd-49c6950735c3
  lastUpdated: '2022-03-02T06:19:09Z'
  state: AtLatestKnown