bitnami / charts

Bitnami Helm Charts
https://bitnami.com
Other
8.85k stars 9.14k forks source link

[bitnami/elasticsearch] pod auto updates on some charts #29406

Open maipal-c opened 1 week ago

maipal-c commented 1 week ago

Name and Version

bitnami/elasticsearch:21.3.12, bitnami/apisix3.2.5, bitnami/harbor:22.0.12

What architecture are you using?

arm64

What steps will reproduce the bug?

  1. install bitnami/argocd chart on k8s cluster
  2. use the following config -
    apiVersion: argoproj.io/v1alpha1
    kind: Application
    metadata:
    name: elasticsearch
    namespace: gitops
    spec:
    project: default
    destination:
      server: https://kubernetes.default.svc
      namespace: databases
    sources:
      - repoURL: "registry-1.docker.io/bitnamicharts"
        targetRevision: 21.3.13
        path: elasticsearch
        chart: elasticsearch
        helm:
           valueFiles:
              - $rootDir/<values_yaml_file_path>
      - repoURL: "<values_yaml_file_repo"
        targetRevision: main
        ref: rootDir
    syncPolicy:
      automated:
         prune: true
         selfHeal: true
      syncOptions:
         - CreateNamespace=true

i am not sure how to check diff for statefull set

  1. this same issue presents on few other charts from bitnami -
    • bitnami/apisix3.2.5 (creates new replicaset for all apisix deployments on any argo Application update)
    • bitnami/harbor:22.0.12 (creates new replicasets only for core & job deployments for the same)

Are you using any custom parameters or values?

No response

What is the expected behavior?

should not update or create new replicas without any secret or config change

I am not sure if its. a bug or a feature by chart it self. or maybe bug from argocd

i have few other charts from bitnami (postgresql-ha, kafka, vault & redis-cluster) which doesn't show this behavior

What do you see instead?

  1. when i investigated the main diff between new and old replicast. difference here

  2. in case above link not working -

    • pod template hash label has diff
    • checksum/secret annotation has diff
  3. this happened when i updated tolerations for aws-ebs-csi-driver (another argocd Application on same cluster), all these above 3 Apps also got updated.

Additional information

No response

javsalgar commented 5 days ago

Hi,

Do you see any difference in the Deployment object? To understand why there's a change in the replicaset

maipal-c commented 5 days ago

It got sync too quickly not able to find diff, i can share revision history of argo application set,

i guess either it is a issue with tls or maybe argo cd multi source repositories

maipal-c commented 5 days ago

apiVersion: argoproj.io/v1alpha1
kind: Application
metadata:
  annotations:
    kubectl.kubernetes.io/last-applied-configuration: >
      {"apiVersion":"argoproj.io/v1alpha1","kind":"Application","metadata":{"annotations":{},"name":"apisix","namespace":"gitops"},"spec":{"destination":{"namespace":"app-gateway","server":"https://kubernetes.default.svc"},"ignoreDifferences":[{"group":"apiextensions.k8s.io","jsonPointers":["/spec/versions"],"kind":"CustomResourceDefinition","name":"apisixglobalrules.apisix.apache.org"},{"group":"apiextensions.k8s.io","jsonPointers":["/spec/versions"],"kind":"CustomResourceDefinition","name":"apisixpluginconfigs.apisix.apache.org"},{"group":"apiextensions.k8s.io","jsonPointers":["/spec/versions"],"kind":"CustomResourceDefinition","name":"apisixroutes.apisix.apache.org"}],"project":"default","sources":[{"chart":"apisix","helm":{"valueFiles":["$rootDir/namespaces/app-gateway/apisix/values.yaml"]},"path":"apisix","repoURL":"registry-1.docker.io/bitnamicharts","targetRevision":"3.2.5"},{"ref":"rootDir","repoURL":"git@bitbucket.org:someorg/kube-manifests.git","targetRevision":"main"}],"syncPolicy":{"automated":{"prune":true,"selfHeal":true},"syncOptions":["CreateNamespace=true"]}}}
  creationTimestamp: '2024-08-26T18:28:33Z'
  generation: 10737
  managedFields:
    - apiVersion: argoproj.io/v1alpha1
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:annotations:
            .: {}
            f:kubectl.kubernetes.io/last-applied-configuration: {}
        f:spec:
          .: {}
          f:destination:
            .: {}
            f:namespace: {}
            f:server: {}
          f:ignoreDifferences: {}
          f:project: {}
          f:sources: {}
          f:syncPolicy:
            .: {}
            f:automated:
              .: {}
              f:prune: {}
              f:selfHeal: {}
            f:syncOptions: {}
      manager: kubectl-client-side-apply
      operation: Update
      time: '2024-09-15T17:16:11Z'
    - apiVersion: argoproj.io/v1alpha1
      fieldsType: FieldsV1
      fieldsV1:
        f:status:
          .: {}
          f:controllerNamespace: {}
          f:health:
            .: {}
            f:status: {}
          f:history: {}
          f:operationState:
            .: {}
            f:finishedAt: {}
            f:message: {}
            f:operation:
              .: {}
              f:initiatedBy:
                .: {}
                f:automated: {}
              f:retry:
                .: {}
                f:limit: {}
              f:sync:
                .: {}
                f:prune: {}
                f:revisions: {}
                f:syncOptions: {}
            f:phase: {}
            f:startedAt: {}
            f:syncResult:
              .: {}
              f:resources: {}
              f:revision: {}
              f:revisions: {}
              f:source:
                .: {}
                f:repoURL: {}
              f:sources: {}
          f:reconciledAt: {}
          f:resources: {}
          f:sourceTypes: {}
          f:summary:
            .: {}
            f:images: {}
          f:sync:
            .: {}
            f:comparedTo:
              .: {}
              f:destination:
                .: {}
                f:namespace: {}
                f:server: {}
              f:ignoreDifferences: {}
              f:source:
                .: {}
                f:repoURL: {}
              f:sources: {}
            f:revisions: {}
            f:status: {}
      manager: argocd-application-controller
      operation: Update
      time: '2024-09-16T08:17:52Z'
  name: apisix
  namespace: gitops
  resourceVersion: '8181403'
  uid: 9d28aab2-0f61-40f6-95a4-aaaf7477219f
  selfLink: /apis/argoproj.io/v1alpha1/namespaces/gitops/applications/apisix
status:
  controllerNamespace: gitops
  health:
    status: Healthy
  history:
    - deployStartedAt: '2024-09-13T11:49:24Z'
      deployedAt: '2024-09-13T11:49:29Z'
      id: 26
      initiatedBy:
        automated: true
      revisions:
        - 3.2.5
        - 43a930425dd8ef5890d9a47edd521c452a1cc101
      source:
        repoURL: ''
      sources:
        - chart: apisix
          helm:
            valueFiles:
              - $rootDir/namespaces/app-gateway/apisix/values.yaml
          path: apisix
          repoURL: registry-1.docker.io/bitnamicharts
          targetRevision: 3.2.5
        - ref: rootDir
          repoURL: git@bitbucket.org:someorg/kube-manifests.git
          targetRevision: main
    - deployStartedAt: '2024-09-13T11:51:43Z'
      deployedAt: '2024-09-13T11:51:49Z'
      id: 27
      initiatedBy:
        automated: true
      revisions:
        - 3.2.5
        - 3646c6c8ac89bae04f20bfad3060a4df3ff91964
      source:
        repoURL: ''
      sources:
        - chart: apisix
          helm:
            valueFiles:
              - $rootDir/namespaces/app-gateway/apisix/values.yaml
          path: apisix
          repoURL: registry-1.docker.io/bitnamicharts
          targetRevision: 3.2.5
        - ref: rootDir
          repoURL: git@bitbucket.org:someorg/kube-manifests.git
          targetRevision: main
    - deployStartedAt: '2024-09-13T12:38:37Z'
      deployedAt: '2024-09-13T12:38:42Z'
      id: 28
      initiatedBy:
        automated: true
      revisions:
        - 3.2.5
        - c93c85b33240db292a3d61a8cdb7e2cf41b9b1a9
      source:
        repoURL: ''
      sources:
        - chart: apisix
          helm:
            valueFiles:
              - $rootDir/namespaces/app-gateway/apisix/values.yaml
          path: apisix
          repoURL: registry-1.docker.io/bitnamicharts
          targetRevision: 3.2.5
        - ref: rootDir
          repoURL: git@bitbucket.org:someorg/kube-manifests.git
          targetRevision: main
    - deployStartedAt: '2024-09-14T08:33:36Z'
      deployedAt: '2024-09-14T08:34:08Z'
      id: 29
      initiatedBy:
        automated: true
      revisions:
        - 3.2.5
        - 26da0e96378baaa373e7e7de318356347768fcf8
      source:
        repoURL: ''
      sources:
        - chart: apisix
          helm:
            valueFiles:
              - $rootDir/namespaces/app-gateway/apisix/values.yaml
          path: apisix
          repoURL: registry-1.docker.io/bitnamicharts
          targetRevision: 3.2.5
        - ref: rootDir
          repoURL: git@bitbucket.org:someorg/kube-manifests.git
          targetRevision: main
    - deployStartedAt: '2024-09-14T10:07:21Z'
      deployedAt: '2024-09-14T10:07:33Z'
      id: 30
      initiatedBy:
        automated: true
      revisions:
        - 3.2.5
        - be03c83581818d71f2f349a5040ba8579e769123
      source:
        repoURL: ''
      sources:
        - chart: apisix
          helm:
            valueFiles:
              - $rootDir/namespaces/app-gateway/apisix/values.yaml
          path: apisix
          repoURL: registry-1.docker.io/bitnamicharts
          targetRevision: 3.2.5
        - ref: rootDir
          repoURL: git@bitbucket.org:someorg/kube-manifests.git
          targetRevision: main
    - deployStartedAt: '2024-09-14T10:27:07Z'
      deployedAt: '2024-09-14T10:27:13Z'
      id: 31
      initiatedBy:
        automated: true
      revisions:
        - 3.2.5
        - f5ec24a6babb3810b82c337aff326b4df0d387c1
      source:
        repoURL: ''
      sources:
        - chart: apisix
          helm:
            valueFiles:
              - $rootDir/namespaces/app-gateway/apisix/values.yaml
          path: apisix
          repoURL: registry-1.docker.io/bitnamicharts
          targetRevision: 3.2.5
        - ref: rootDir
          repoURL: git@bitbucket.org:someorg/kube-manifests.git
          targetRevision: main
    - deployStartedAt: '2024-09-15T16:51:40Z'
      deployedAt: '2024-09-15T16:51:45Z'
      id: 32
      initiatedBy:
        automated: true
      revisions:
        - 3.2.5
        - 132bbcfebbd9801e64663472cbc1916e43839690
      source:
        repoURL: ''
      sources:
        - chart: apisix
          helm:
            valueFiles:
              - $rootDir/namespaces/app-gateway/apisix/values.yaml
          path: apisix
          repoURL: registry-1.docker.io/bitnamicharts
          targetRevision: 3.2.5
        - ref: rootDir
          repoURL: git@bitbucket.org:someorg/kube-manifests.git
          targetRevision: main
    - deployStartedAt: '2024-09-15T17:00:12Z'
      deployedAt: '2024-09-15T17:00:50Z'
      id: 33
      initiatedBy:
        automated: true
      revisions:
        - 3.2.5
        - 210794bd61684310cf34c8b6b4ea949c107b809c
      source:
        repoURL: ''
      sources:
        - chart: apisix
          helm:
            valueFiles:
              - $rootDir/namespaces/app-gateway/apisix/values.yaml
          path: apisix
          repoURL: registry-1.docker.io/bitnamicharts
          targetRevision: 3.2.5
        - ref: rootDir
          repoURL: git@bitbucket.org:someorg/kube-manifests.git
          targetRevision: main
    - deployStartedAt: '2024-09-15T17:06:12Z'
      deployedAt: '2024-09-15T17:06:19Z'
      id: 34
      initiatedBy:
        automated: true
      revisions:
        - 3.2.5
        - a1a43f06ebf0a367fbc1813e9000adeb13e40f76
      source:
        repoURL: ''
      sources:
        - chart: apisix
          helm:
            valueFiles:
              - $rootDir/namespaces/app-gateway/apisix/values.yaml
          path: apisix
          repoURL: registry-1.docker.io/bitnamicharts
          targetRevision: 3.2.5
        - ref: rootDir
          repoURL: git@bitbucket.org:someorg/kube-manifests.git
          targetRevision: main
    - deployStartedAt: '2024-09-15T18:18:29Z'
      deployedAt: '2024-09-15T18:18:34Z'
      id: 35
      initiatedBy:
        automated: true
      revisions:
        - 3.2.5
        - 22a8eff4cf2192202387b2745c59700c39212f81
      source:
        repoURL: ''
      sources:
        - chart: apisix
          helm:
            valueFiles:
              - $rootDir/namespaces/app-gateway/apisix/values.yaml
          path: apisix
          repoURL: registry-1.docker.io/bitnamicharts
          targetRevision: 3.2.5
        - ref: rootDir
          repoURL: git@bitbucket.org:someorg/kube-manifests.git
          targetRevision: main
  operationState:
    finishedAt: '2024-09-15T18:18:34Z'
    message: successfully synced (all tasks run)
    operation:
      initiatedBy:
        automated: true
      retry:
        limit: 5
      sync:
        prune: true
        revisions:
          - 3.2.5
          - 22a8eff4cf2192202387b2745c59700c39212f81
        syncOptions:
          - CreateNamespace=true
    phase: Succeeded
    startedAt: '2024-09-15T18:18:29Z'
    syncResult:
      resources:
        - group: networking.k8s.io
          hookPhase: Running
          kind: NetworkPolicy
          message: networkpolicy.networking.k8s.io/apisix-dashboard configured
          name: apisix-dashboard
          namespace: app-gateway
          status: Synced
          syncPhase: Sync
          version: v1
        - group: networking.k8s.io
          hookPhase: Running
          kind: NetworkPolicy
          message: networkpolicy.networking.k8s.io/apisix-control-plane configured
          name: apisix-control-plane
          namespace: app-gateway
          status: Synced
          syncPhase: Sync
          version: v1
        - group: networking.k8s.io
          hookPhase: Running
          kind: NetworkPolicy
          message: networkpolicy.networking.k8s.io/apisix-data-plane configured
          name: apisix-data-plane
          namespace: app-gateway
          status: Synced
          syncPhase: Sync
          version: v1
        - group: networking.k8s.io
          hookPhase: Running
          kind: NetworkPolicy
          message: networkpolicy.networking.k8s.io/apisix-etcd configured
          name: apisix-etcd
          namespace: app-gateway
          status: Synced
          syncPhase: Sync
          version: v1
        - group: networking.k8s.io
          hookPhase: Running
          kind: NetworkPolicy
          message: networkpolicy.networking.k8s.io/apisix-ingress-controller configured
          name: apisix-ingress-controller
          namespace: app-gateway
          status: Synced
          syncPhase: Sync
          version: v1
        - group: policy
          hookPhase: Running
          kind: PodDisruptionBudget
          message: poddisruptionbudget.policy/apisix-data-plane configured
          name: apisix-data-plane
          namespace: app-gateway
          status: Synced
          syncPhase: Sync
          version: v1
        - group: ''
          hookPhase: Running
          kind: ServiceAccount
          message: serviceaccount/apisix-control-plane unchanged
          name: apisix-control-plane
          namespace: app-gateway
          status: Synced
          syncPhase: Sync
          version: v1
        - group: ''
          hookPhase: Running
          kind: ServiceAccount
          message: serviceaccount/apisix-etcd unchanged
          name: apisix-etcd
          namespace: app-gateway
          status: Synced
          syncPhase: Sync
          version: v1
        - group: ''
          hookPhase: Running
          kind: ServiceAccount
          message: serviceaccount/apisix-dashboard unchanged
          name: apisix-dashboard
          namespace: app-gateway
          status: Synced
          syncPhase: Sync
          version: v1
        - group: ''
          hookPhase: Running
          kind: ServiceAccount
          message: serviceaccount/apisix-data-plane unchanged
          name: apisix-data-plane
          namespace: app-gateway
          status: Synced
          syncPhase: Sync
          version: v1
        - group: ''
          hookPhase: Running
          kind: ServiceAccount
          message: serviceaccount/apisix-ingress-controller unchanged
          name: apisix-ingress-controller
          namespace: app-gateway
          status: Synced
          syncPhase: Sync
          version: v1
        - group: ''
          hookPhase: Running
          kind: Secret
          message: secret/apisix-dashboard configured
          name: apisix-dashboard
          namespace: app-gateway
          status: Synced
          syncPhase: Sync
          version: v1
        - group: ''
          hookPhase: Running
          kind: Secret
          message: secret/apisix-data-plane-tls configured
          name: apisix-data-plane-tls
          namespace: app-gateway
          status: Synced
          syncPhase: Sync
          version: v1
        - group: ''
          hookPhase: Running
          kind: Secret
          message: secret/apisix-control-plane-api-token configured
          name: apisix-control-plane-api-token
          namespace: app-gateway
          status: Synced
          syncPhase: Sync
          version: v1
        - group: ''
          hookPhase: Running
          kind: Secret
          message: secret/apisix-etcd-jwt-token configured
          name: apisix-etcd-jwt-token
          namespace: app-gateway
          status: Synced
          syncPhase: Sync
          version: v1
        - group: ''
          hookPhase: Running
          kind: ConfigMap
          message: configmap/apisix-control-plane-extra unchanged
          name: apisix-control-plane-extra
          namespace: app-gateway
          status: Synced
          syncPhase: Sync
          version: v1
        - group: ''
          hookPhase: Running
          kind: ConfigMap
          message: configmap/apisix-dashboard-default unchanged
          name: apisix-dashboard-default
          namespace: app-gateway
          status: Synced
          syncPhase: Sync
          version: v1
        - group: ''
          hookPhase: Running
          kind: ConfigMap
          message: configmap/apisix-data-plane-extra unchanged
          name: apisix-data-plane-extra
          namespace: app-gateway
          status: Synced
          syncPhase: Sync
          version: v1
        - group: ''
          hookPhase: Running
          kind: ConfigMap
          message: configmap/apisix-ingress-controller-default unchanged
          name: apisix-ingress-controller-default
          namespace: app-gateway
          status: Synced
          syncPhase: Sync
          version: v1
        - group: ''
          hookPhase: Running
          kind: ConfigMap
          message: configmap/apisix-control-plane-default unchanged
          name: apisix-control-plane-default
          namespace: app-gateway
          status: Synced
          syncPhase: Sync
          version: v1
        - group: ''
          hookPhase: Running
          kind: ConfigMap
          message: configmap/apisix-data-plane-default unchanged
          name: apisix-data-plane-default
          namespace: app-gateway
          status: Synced
          syncPhase: Sync
          version: v1
        - group: apiextensions.k8s.io
          hookPhase: Running
          kind: CustomResourceDefinition
          message: >-
            customresourcedefinition.apiextensions.k8s.io/apisixupstreams.apisix.apache.org
            unchanged
          name: apisixupstreams.apisix.apache.org
          namespace: app-gateway
          status: Synced
          syncPhase: Sync
          version: v1
        - group: apiextensions.k8s.io
          hookPhase: Running
          kind: CustomResourceDefinition
          message: >-
            customresourcedefinition.apiextensions.k8s.io/apisixclusterconfigs.apisix.apache.org
            configured
          name: apisixclusterconfigs.apisix.apache.org
          namespace: app-gateway
          status: Synced
          syncPhase: Sync
          version: v1
        - group: apiextensions.k8s.io
          hookPhase: Running
          kind: CustomResourceDefinition
          message: >-
            customresourcedefinition.apiextensions.k8s.io/apisixtlses.apisix.apache.org
            configured
          name: apisixtlses.apisix.apache.org
          namespace: app-gateway
          status: Synced
          syncPhase: Sync
          version: v1
        - group: apiextensions.k8s.io
          hookPhase: Running
          kind: CustomResourceDefinition
          message: >-
            customresourcedefinition.apiextensions.k8s.io/apisixpluginconfigs.apisix.apache.org
            configured
          name: apisixpluginconfigs.apisix.apache.org
          namespace: app-gateway
          status: Synced
          syncPhase: Sync
          version: v1
        - group: apiextensions.k8s.io
          hookPhase: Running
          kind: CustomResourceDefinition
          message: >-
            customresourcedefinition.apiextensions.k8s.io/apisixglobalrules.apisix.apache.org
            configured
          name: apisixglobalrules.apisix.apache.org
          namespace: app-gateway
          status: Synced
          syncPhase: Sync
          version: v1
        - group: apiextensions.k8s.io
          hookPhase: Running
          kind: CustomResourceDefinition
          message: >-
            customresourcedefinition.apiextensions.k8s.io/apisixconsumers.apisix.apache.org
            configured
          name: apisixconsumers.apisix.apache.org
          namespace: app-gateway
          status: Synced
          syncPhase: Sync
          version: v1
        - group: apiextensions.k8s.io
          hookPhase: Running
          kind: CustomResourceDefinition
          message: >-
            customresourcedefinition.apiextensions.k8s.io/apisixroutes.apisix.apache.org
            configured
          name: apisixroutes.apisix.apache.org
          namespace: app-gateway
          status: Synced
          syncPhase: Sync
          version: v1
        - group: rbac.authorization.k8s.io
          hookPhase: Running
          kind: ClusterRole
          message: >-
            clusterrole.rbac.authorization.k8s.io/apisix-app-gateway-ingress-controller
            reconciled.
            clusterrole.rbac.authorization.k8s.io/apisix-app-gateway-ingress-controller
            unchanged
          name: apisix-app-gateway-ingress-controller
          namespace: app-gateway
          status: Synced
          syncPhase: Sync
          version: v1
        - group: rbac.authorization.k8s.io
          hookPhase: Running
          kind: ClusterRole
          message: >-
            clusterrole.rbac.authorization.k8s.io/apisix-app-gateway-control-plane
            reconciled.
            clusterrole.rbac.authorization.k8s.io/apisix-app-gateway-control-plane
            unchanged
          name: apisix-app-gateway-control-plane
          namespace: app-gateway
          status: Synced
          syncPhase: Sync
          version: v1
        - group: rbac.authorization.k8s.io
          hookPhase: Running
          kind: ClusterRole
          message: >-
            clusterrole.rbac.authorization.k8s.io/apisix-app-gateway-data-plane
            reconciled.
            clusterrole.rbac.authorization.k8s.io/apisix-app-gateway-data-plane
            unchanged
          name: apisix-app-gateway-data-plane
          namespace: app-gateway
          status: Synced
          syncPhase: Sync
          version: v1
        - group: rbac.authorization.k8s.io
          hookPhase: Running
          kind: ClusterRoleBinding
          message: >-
            clusterrolebinding.rbac.authorization.k8s.io/apisix-app-gateway-data-plane
            reconciled.
            clusterrolebinding.rbac.authorization.k8s.io/apisix-app-gateway-data-plane
            unchanged
          name: apisix-app-gateway-data-plane
          namespace: app-gateway
          status: Synced
          syncPhase: Sync
          version: v1
        - group: rbac.authorization.k8s.io
          hookPhase: Running
          kind: ClusterRoleBinding
          message: >-
            clusterrolebinding.rbac.authorization.k8s.io/apisix-app-gateway-ingress-controller
            reconciled.
            clusterrolebinding.rbac.authorization.k8s.io/apisix-app-gateway-ingress-controller
            unchanged
          name: apisix-app-gateway-ingress-controller
          namespace: app-gateway
          status: Synced
          syncPhase: Sync
          version: v1
        - group: rbac.authorization.k8s.io
          hookPhase: Running
          kind: ClusterRoleBinding
          message: >-
            clusterrolebinding.rbac.authorization.k8s.io/apisix-app-gateway-control-plane
            reconciled.
            clusterrolebinding.rbac.authorization.k8s.io/apisix-app-gateway-control-plane
            unchanged
          name: apisix-app-gateway-control-plane
          namespace: app-gateway
          status: Synced
          syncPhase: Sync
          version: v1
        - group: ''
          hookPhase: Running
          kind: Service
          message: service/apisix-etcd-headless unchanged
          name: apisix-etcd-headless
          namespace: app-gateway
          status: Synced
          syncPhase: Sync
          version: v1
        - group: ''
          hookPhase: Running
          kind: Service
          message: service/apisix-etcd configured
          name: apisix-etcd
          namespace: app-gateway
          status: Synced
          syncPhase: Sync
          version: v1
        - group: ''
          hookPhase: Running
          kind: Service
          message: service/apisix-data-plane unchanged
          name: apisix-data-plane
          namespace: app-gateway
          status: Synced
          syncPhase: Sync
          version: v1
        - group: ''
          hookPhase: Running
          kind: Service
          message: service/apisix-ingress-controller configured
          name: apisix-ingress-controller
          namespace: app-gateway
          status: Synced
          syncPhase: Sync
          version: v1
        - group: ''
          hookPhase: Running
          kind: Service
          message: service/apisix-control-plane configured
          name: apisix-control-plane
          namespace: app-gateway
          status: Synced
          syncPhase: Sync
          version: v1
        - group: ''
          hookPhase: Running
          kind: Service
          message: service/apisix-dashboard configured
          name: apisix-dashboard
          namespace: app-gateway
          status: Synced
          syncPhase: Sync
          version: v1
        - group: apps
          hookPhase: Running
          kind: Deployment
          message: deployment.apps/apisix-data-plane configured
          name: apisix-data-plane
          namespace: app-gateway
          status: Synced
          syncPhase: Sync
          version: v1
        - group: apps
          hookPhase: Running
          kind: Deployment
          message: deployment.apps/apisix-ingress-controller configured
          name: apisix-ingress-controller
          namespace: app-gateway
          status: Synced
          syncPhase: Sync
          version: v1
        - group: apps
          hookPhase: Running
          kind: Deployment
          message: deployment.apps/apisix-dashboard configured
          name: apisix-dashboard
          namespace: app-gateway
          status: Synced
          syncPhase: Sync
          version: v1
        - group: apps
          hookPhase: Running
          kind: Deployment
          message: deployment.apps/apisix-control-plane configured
          name: apisix-control-plane
          namespace: app-gateway
          status: Synced
          syncPhase: Sync
          version: v1
        - group: apps
          hookPhase: Running
          kind: StatefulSet
          message: statefulset.apps/apisix-etcd configured
          name: apisix-etcd
          namespace: app-gateway
          status: Synced
          syncPhase: Sync
          version: v1
        - group: networking.k8s.io
          hookPhase: Running
          kind: IngressClass
          message: ingressclass.networking.k8s.io/apisix unchanged
          name: apisix
          namespace: app-gateway
          status: Synced
          syncPhase: Sync
          version: v1
      revision: ''
      revisions:
        - 3.2.5
        - 22a8eff4cf2192202387b2745c59700c39212f81
      source:
        repoURL: ''
      sources:
        - chart: apisix
          helm:
            valueFiles:
              - $rootDir/namespaces/app-gateway/apisix/values.yaml
          path: apisix
          repoURL: registry-1.docker.io/bitnamicharts
          targetRevision: 3.2.5
        - ref: rootDir
          repoURL: git@bitbucket.org:someorg/kube-manifests.git
          targetRevision: main
  reconciledAt: '2024-09-16T08:17:51Z'
  resources:
    - kind: ConfigMap
      name: apisix-control-plane-default
      namespace: app-gateway
      status: Synced
      version: v1
    - kind: ConfigMap
      name: apisix-control-plane-extra
      namespace: app-gateway
      status: Synced
      version: v1
    - kind: ConfigMap
      name: apisix-dashboard-default
      namespace: app-gateway
      status: Synced
      version: v1
    - kind: ConfigMap
      name: apisix-data-plane-default
      namespace: app-gateway
      status: Synced
      version: v1
    - kind: ConfigMap
      name: apisix-data-plane-extra
      namespace: app-gateway
      status: Synced
      version: v1
    - kind: ConfigMap
      name: apisix-ingress-controller-default
      namespace: app-gateway
      status: Synced
      version: v1
    - kind: Secret
      name: apisix-control-plane-api-token
      namespace: app-gateway
      status: Synced
      version: v1
    - kind: Secret
      name: apisix-dashboard
      namespace: app-gateway
      status: Synced
      version: v1
    - kind: Secret
      name: apisix-data-plane-tls
      namespace: app-gateway
      status: Synced
      version: v1
    - kind: Secret
      name: apisix-etcd-jwt-token
      namespace: app-gateway
      status: Synced
      version: v1
    - health:
        status: Healthy
      kind: Service
      name: apisix-control-plane
      namespace: app-gateway
      status: Synced
      version: v1
    - health:
        status: Healthy
      kind: Service
      name: apisix-dashboard
      namespace: app-gateway
      status: Synced
      version: v1
    - health:
        status: Healthy
      kind: Service
      name: apisix-data-plane
      namespace: app-gateway
      status: Synced
      version: v1
    - health:
        status: Healthy
      kind: Service
      name: apisix-etcd
      namespace: app-gateway
      status: Synced
      version: v1
    - health:
        status: Healthy
      kind: Service
      name: apisix-etcd-headless
      namespace: app-gateway
      status: Synced
      version: v1
    - health:
        status: Healthy
      kind: Service
      name: apisix-ingress-controller
      namespace: app-gateway
      status: Synced
      version: v1
    - kind: ServiceAccount
      name: apisix-control-plane
      namespace: app-gateway
      status: Synced
      version: v1
    - kind: ServiceAccount
      name: apisix-dashboard
      namespace: app-gateway
      status: Synced
      version: v1
    - kind: ServiceAccount
      name: apisix-data-plane
      namespace: app-gateway
      status: Synced
      version: v1
    - kind: ServiceAccount
      name: apisix-etcd
      namespace: app-gateway
      status: Synced
      version: v1
    - kind: ServiceAccount
      name: apisix-ingress-controller
      namespace: app-gateway
      status: Synced
      version: v1
    - group: apiextensions.k8s.io
      kind: CustomResourceDefinition
      name: apisixclusterconfigs.apisix.apache.org
      status: Synced
      version: v1
    - group: apiextensions.k8s.io
      kind: CustomResourceDefinition
      name: apisixconsumers.apisix.apache.org
      status: Synced
      version: v1
    - group: apiextensions.k8s.io
      kind: CustomResourceDefinition
      name: apisixglobalrules.apisix.apache.org
      status: Synced
      version: v1
    - group: apiextensions.k8s.io
      kind: CustomResourceDefinition
      name: apisixpluginconfigs.apisix.apache.org
      status: Synced
      version: v1
    - group: apiextensions.k8s.io
      kind: CustomResourceDefinition
      name: apisixroutes.apisix.apache.org
      status: Synced
      version: v1
    - group: apiextensions.k8s.io
      kind: CustomResourceDefinition
      name: apisixtlses.apisix.apache.org
      status: Synced
      version: v1
    - group: apiextensions.k8s.io
      kind: CustomResourceDefinition
      name: apisixupstreams.apisix.apache.org
      status: Synced
      version: v1
    - group: apps
      health:
        status: Healthy
      kind: Deployment
      name: apisix-control-plane
      namespace: app-gateway
      status: Synced
      version: v1
    - group: apps
      health:
        status: Healthy
      kind: Deployment
      name: apisix-dashboard
      namespace: app-gateway
      status: Synced
      version: v1
    - group: apps
      health:
        status: Healthy
      kind: Deployment
      name: apisix-data-plane
      namespace: app-gateway
      status: Synced
      version: v1
    - group: apps
      health:
        status: Healthy
      kind: Deployment
      name: apisix-ingress-controller
      namespace: app-gateway
      status: Synced
      version: v1
    - group: apps
      health:
        message: >-
          statefulset rolling update complete 1 pods at revision
          apisix-etcd-786f45b64...
        status: Healthy
      kind: StatefulSet
      name: apisix-etcd
      namespace: app-gateway
      status: Synced
      version: v1
    - group: networking.k8s.io
      kind: IngressClass
      name: apisix
      status: Synced
      version: v1
    - group: networking.k8s.io
      kind: NetworkPolicy
      name: apisix-control-plane
      namespace: app-gateway
      status: Synced
      version: v1
    - group: networking.k8s.io
      kind: NetworkPolicy
      name: apisix-dashboard
      namespace: app-gateway
      status: Synced
      version: v1
    - group: networking.k8s.io
      kind: NetworkPolicy
      name: apisix-data-plane
      namespace: app-gateway
      status: Synced
      version: v1
    - group: networking.k8s.io
      kind: NetworkPolicy
      name: apisix-etcd
      namespace: app-gateway
      status: Synced
      version: v1
    - group: networking.k8s.io
      kind: NetworkPolicy
      name: apisix-ingress-controller
      namespace: app-gateway
      status: Synced
      version: v1
    - group: policy
      kind: PodDisruptionBudget
      name: apisix-data-plane
      namespace: app-gateway
      status: Synced
      version: v1
    - group: rbac.authorization.k8s.io
      kind: ClusterRole
      name: apisix-app-gateway-control-plane
      status: Synced
      version: v1
    - group: rbac.authorization.k8s.io
      kind: ClusterRole
      name: apisix-app-gateway-data-plane
      status: Synced
      version: v1
    - group: rbac.authorization.k8s.io
      kind: ClusterRole
      name: apisix-app-gateway-ingress-controller
      status: Synced
      version: v1
    - group: rbac.authorization.k8s.io
      kind: ClusterRoleBinding
      name: apisix-app-gateway-control-plane
      status: Synced
      version: v1
    - group: rbac.authorization.k8s.io
      kind: ClusterRoleBinding
      name: apisix-app-gateway-data-plane
      status: Synced
      version: v1
    - group: rbac.authorization.k8s.io
      kind: ClusterRoleBinding
      name: apisix-app-gateway-ingress-controller
      status: Synced
      version: v1
  sourceTypes:
    - Helm
    - ''
  summary:
    images:
      - busybox
      - docker.io/bitnami/apisix-dashboard:3.0.1-debian-12-r34
      - docker.io/bitnami/apisix-ingress-controller:1.8.2-debian-12-r6
      - docker.io/bitnami/apisix:3.9.1-debian-12-r4
      - docker.io/bitnami/etcd:3.5.14-debian-12-r1
      - docker.io/bitnami/os-shell:12-debian-12-r22
  sync:
    comparedTo:
      destination:
        namespace: app-gateway
        server: https://kubernetes.default.svc
      ignoreDifferences:
        - group: apiextensions.k8s.io
          jsonPointers:
            - /spec/versions
          kind: CustomResourceDefinition
          name: apisixglobalrules.apisix.apache.org
        - group: apiextensions.k8s.io
          jsonPointers:
            - /spec/versions
          kind: CustomResourceDefinition
          name: apisixpluginconfigs.apisix.apache.org
        - group: apiextensions.k8s.io
          jsonPointers:
            - /spec/versions
          kind: CustomResourceDefinition
          name: apisixroutes.apisix.apache.org
      source:
        repoURL: ''
      sources:
        - chart: apisix
          helm:
            valueFiles:
              - $rootDir/namespaces/app-gateway/apisix/values.yaml
          path: apisix
          repoURL: registry-1.docker.io/bitnamicharts
          targetRevision: 3.2.5
        - ref: rootDir
          repoURL: git@bitbucket.org:someorg/kube-manifests.git
          targetRevision: main
    revisions:
      - 3.2.5
      - 22a8eff4cf2192202387b2745c59700c39212f81
    status: Synced
spec:
  destination:
    namespace: app-gateway
    server: https://kubernetes.default.svc
  ignoreDifferences:
    - group: apiextensions.k8s.io
      jsonPointers:
        - /spec/versions
      kind: CustomResourceDefinition
      name: apisixglobalrules.apisix.apache.org
    - group: apiextensions.k8s.io
      jsonPointers:
        - /spec/versions
      kind: CustomResourceDefinition
      name: apisixpluginconfigs.apisix.apache.org
    - group: apiextensions.k8s.io
      jsonPointers:
        - /spec/versions
      kind: CustomResourceDefinition
      name: apisixroutes.apisix.apache.org
  project: default
  sources:
    - chart: apisix
      helm:
        valueFiles:
          - $rootDir/namespaces/app-gateway/apisix/values.yaml
      path: apisix
      repoURL: registry-1.docker.io/bitnamicharts
      targetRevision: 3.2.5
    - ref: rootDir
      repoURL: git@bitbucket.org:someorg/kube-manifests.git
      targetRevision: main
  syncPolicy:
    automated:
      prune: true
      selfHeal: true
    syncOptions:
      - CreateNamespace=true
maipal-c commented 5 days ago

Even its now refreshing kafka as well mostly the autogenerated secrets

Maybe when i do commit in any applications values file (becuase of same repo) argocd renders helm template and compare with existing and in each render bitnami charts creates new passwords/ secrets that leads to argocd app state change

javsalgar commented 4 days ago

I understand, in this case, the helm template is not taking into account the existing secret in the cluster (we use fetch to obtain the actual value), not causing the diff. I'm afraid that, when using the autogenerated values (and not existingSecret for example), it is going to perform a diff all the time.

maipal-c commented 4 days ago

Yea it is all the time and even if you do a hard refresh through argo UI it start performing update.

by replacing all autogenerated secrets with either eixising or proving a fixed value, i solved that issue.

I guess maybe there should be an note on all charts that- “using autogenerated secrets will break app argocd sync”