canonical / knative-operators

Charmed Knative Operators
Apache License 2.0
1 stars 2 forks source link

Knative-operator fails to fetch serving and eventing manifests for version >= 1.10.x #147

Closed orfeas-k closed 1 year ago

orfeas-k commented 1 year ago

Bug Description

After this PR https://github.com/canonical/knative-operators/pull/135, we tried delpoying knative charms from latest/edge. Regarding knative-eventing, we used config option and set it to 1.10.1. For both of the components, knative-operator failed to fetch their manifests, the custom resources (knativeserving and knativeeventing) had the following errors in their conditions and no deployments (or their pods) were created. knativeserving:

  status:
    conditions:
    - lastTransitionTime: "2023-09-01T09:10:06Z"
      status: Unknown
      type: DependenciesInstalled
    - lastTransitionTime: "2023-09-01T09:10:06Z"
      status: Unknown
      type: DeploymentsAvailable
    - lastTransitionTime: "2023-09-01T09:10:06Z"
      message: 'Install failed with message: the manifests of the target version 1.10.2
        are not available to this release'
      reason: Error
      status: "False"
      type: InstallSucceeded
    - lastTransitionTime: "2023-09-01T09:10:06Z"
      message: 'Install failed with message: the manifests of the target version 1.10.2
        are not available to this release'
      reason: Error
      status: "False"
      type: Ready
    - lastTransitionTime: "2023-09-01T09:10:06Z"
      status: "True"
      type: VersionMigrationEligible

The above error is what is also described in this upstream issue https://github.com/knative/operator/issues/1533.

To Reproduce

Deploy knative charms from latest/edge

Environment

Microk8s, ubuntu 22.04, juju 2.9.44

Relevant log output

2023-09-01T07:56:41.767Z [knative-operator] {"severity":"ERROR","timestamp":"2023-09-01T07:56:41.767365311Z","logger":"knative-operator","caller":"common/stages.go:84","message":"Unable to fetch installed manifest, trying targetthe manifests of the target version 1.10.1 are not available to this release","commit":"e0ef2a2-dirty","knative.dev/pod":"knative-operator","knative.dev/controller":"knative.dev.operator.pkg.reconciler.knativeeventing.Reconciler","knative.dev/kind":"operator.knative.dev.KnativeEventing","knative.dev/traceid":"d360a018-b496-4630-81d7-8c427486308e","knative.dev/key":"knative-eventing/knative-eventing","stacktrace":"knative.dev/operator/pkg/reconciler/common.AppendInstalled\n\tknative.dev/operator/pkg/reconciler/common/stages.go:84\nknative.dev/operator/pkg/reconciler/common.Stages.Execute\n\tknative.dev/operator/pkg/reconciler/common/stages.go:37\nknative.dev/operator/pkg/reconciler/knativeeventing.(*Reconciler).installed\n\tknative.dev/operator/pkg/reconciler/knativeeventing/knativeeventing.go:148\nknative.dev/operator/pkg/reconciler/common.DeleteObsoleteResources\n\tknative.dev/operator/pkg/reconciler/common/stages.go:110\nknative.dev/operator/pkg/reconciler/knativeeventing.(*Reconciler).ReconcileKind\n\tknative.dev/operator/pkg/reconciler/knativeeventing/knativeeventing.go:124\nknative.dev/operator/pkg/client/injection/reconciler/operator/v1beta1/knativeeventing.(*reconcilerImpl).Reconcile\n\tknative.dev/operator/pkg/client/injection/reconciler/operator/v1beta1/knativeeventing/reconciler.go:235\nknative.dev/pkg/controller.(*Impl).processNextWorkItem\n\tknative.dev/pkg@v0.0.0-20221014164553-b812affa3893/controller/controller.go:542\nknative.dev/pkg/controller.(*Impl).RunContext.func3\n\tknative.dev/pkg@v0.0.0-20221014164553-b812affa3893/controller/controller.go:491"}
2023-09-01T07:56:41.767Z [knative-operator] {"severity":"ERROR","timestamp":"2023-09-01T07:56:41.76744627Z","logger":"knative-operator","caller":"common/stages.go:112","message":"Unable to obtain the installed manifest; obsolete resources may lingerthe manifests of the target version 1.10.1 are not available to this release","commit":"e0ef2a2-dirty","knative.dev/pod":"knative-operator","knative.dev/controller":"knative.dev.operator.pkg.reconciler.knativeeventing.Reconciler","knative.dev/kind":"operator.knative.dev.KnativeEventing","knative.dev/traceid":"d360a018-b496-4630-81d7-8c427486308e","knative.dev/key":"knative-eventing/knative-eventing","stacktrace":"knative.dev/operator/pkg/reconciler/common.DeleteObsoleteResources\n\tknative.dev/operator/pkg/reconciler/common/stages.go:112\nknative.dev/operator/pkg/reconciler/knativeeventing.(*Reconciler).ReconcileKind\n\tknative.dev/operator/pkg/reconciler/knativeeventing/knativeeventing.go:124\nknative.dev/operator/pkg/client/injection/reconciler/operator/v1beta1/knativeeventing.(*reconcilerImpl).Reconcile\n\tknative.dev/operator/pkg/client/injection/reconciler/operator/v1beta1/knativeeventing/reconciler.go:235\nknative.dev/pkg/controller.(*Impl).processNextWorkItem\n\tknative.dev/pkg@v0.0.0-20221014164553-b812affa3893/controller/controller.go:542\nknative.dev/pkg/controller.(*Impl).RunContext.func3\n\tknative.dev/pkg@v0.0.0-20221014164553-b812affa3893/controller/controller.go:491"}
2023-09-01T07:56:41.768Z [knative-operator] {"severity":"INFO","timestamp":"2023-09-01T07:56:41.768125701Z","logger":"knative-operator.event-broadcaster","caller":"record/event.go:285","message":"Event(v1.ObjectReference{Kind:\"KnativeEventing\", Namespace:\"knative-eventing\", Name:\"knative-eventing\", UID:\"0040e3cc-e9ae-4cf8-b38a-db8a94d03721\", APIVersion:\"operator.knative.dev/v1beta1\", ResourceVersion:\"5742\", FieldPath:\"\"}): type: 'Normal' reason: 'FinalizerUpdate' Updated \"knative-eventing\" finalizers","commit":"e0ef2a2-dirty","knative.dev/pod":"knative-operator"}
2023-09-01T07:56:41.801Z [knative-operator] {"severity":"ERROR","timestamp":"2023-09-01T07:56:41.801686443Z","logger":"knative-operator","caller":"knativeeventing/reconciler.go:294","message":"Returned an error","commit":"e0ef2a2-dirty","knative.dev/pod":"knative-operator","knative.dev/controller":"knative.dev.operator.pkg.reconciler.knativeeventing.Reconciler","knative.dev/kind":"operator.knative.dev.KnativeEventing","knative.dev/traceid":"d360a018-b496-4630-81d7-8c427486308e","knative.dev/key":"knative-eventing/knative-eventing","targetMethod":"ReconcileKind","error":"the manifests of the target version 1.10.1 are not available to this release","stacktrace":"knative.dev/operator/pkg/client/injection/reconciler/operator/v1beta1/knativeeventing.(*reconcilerImpl).Reconcile\n\tknative.dev/operator/pkg/client/injection/reconciler/operator/v1beta1/knativeeventing/reconciler.go:294\nknative.dev/pkg/controller.(*Impl).processNextWorkItem\n\tknative.dev/pkg@v0.0.0-20221014164553-b812affa3893/controller/controller.go:542\nknative.dev/pkg/controller.(*Impl).RunContext.func3\n\tknative.dev/pkg@v0.0.0-20221014164553-b812affa3893/controller/controller.go:491"}

Additional context

No response

richardvflux commented 1 year ago

try the 1.11.5 operator, it worked for us.

orfeas-k commented 1 year ago

Manually testing this PR, it looks like knative-operator doesn't present any logs with fetching knative-eventing manifests for version 1.10.1. Deployments and their corresponding pods also ran successfully.

orfeas-k commented 1 year ago

After https://github.com/canonical/knative-operators/pull/157 merged, deployed knative-serving and knative-operator doesn't have any issue fetching manifests for 1.10.2. Deployments and their corresponding pods also ran successfully.

orfeas-k commented 1 year ago

Closing this issue since we don't have a bug anymore.