search

argoproj-labs / argocd-image-updater

Automatic container image update for Argo CD
https://argocd-image-updater.readthedocs.io/en/stable/
Apache License 2.0
1.22k stars 252 forks source link

ArgoCD fails to Sync image update for Helm, succeeds for Kustomize #833

Open kallentrustle opened 1 month ago

kallentrustle commented 1 month ago

Describe the bug My test case app is in 2 different layouts. One is Kustomize, one is Helm. Ultimately we want to go with Helm. They both deploy successfully by ArgoCD. ArgoCD Image Updater (AIU) detects updated image for both and it successfully adds the .argocd-source* file to gitops. After AIU updates gitops, ArgoCD polls gitops: The test app running as Kustomize is successfully updated, the Helm test app is not. It's as if ArgoCD doesn't see the update.

I figure I'm doing something wrong, rather than this being a bug. Help greatly appreciated!

Application beep-int-helm

beep-int-helm-staging.yaml
---
apiVersion: argoproj.io/v1alpha1
kind: Application
metadata:
  name: beep-int-helm-staging
  namespace: argocd
  annotations:
    argocd-image-updater.argoproj.io/image-list: beep-int=us-central1-docker.pkg.dev/PROJECT_ID/boop-repo/beep-int/beep-int
    argocd-image-updater.argoproj.io/beep-int.update-strategy: newest-build
    argocd-image-updater.argoproj.io/beep-int.allow-tags: regexp:^[0-9a-f]{7}$
    argocd-image-updater.argoproj.io/beep-int.force-update: "true"
    argocd-image-updater.argoproj.io/write-back-method: git
  finalizers:
    - resources-finalizer.argocd.argoproj.io
spec:
  project: main
  source:
    repoURL: git@github.com:MYDOMAIN/gitops.git
    targetRevision: poc
    path: hack/apps/beep-int-helm
    helm:
      valueFiles:
        - values.yaml
        - values-staging.yaml
  destination:
    server: https://kubernetes.default.svc
    namespace: staging
  syncPolicy:
    automated:
      prune: true
      selfHeal: true
    retry:
      limit: 5
      backoff:
        duration: 5s
        maxDuration: 3m0s
        factor: 2
    syncOptions:
      - CreateNamespace=true

gitops: beep-int-helm $ tree -a .
.
├── .argocd-source-beep-int-helm-dev.yaml
├── .argocd-source-beep-int-helm-prod.yaml
├── .argocd-source-beep-int-helm-staging.yaml
├── .helmignore
├── Chart.yaml
├── README.md
├── templates
│   └── runservice.yaml
├── values-dev.yaml
├── values-prod.yaml
├── values-staging.yaml
└── values.yaml

Application beep-int-kust

beep-int-kust-staging.yaml
---
apiVersion: argoproj.io/v1alpha1
kind: Application
metadata:
  name: beep-int-kust-staging
  namespace: argocd
  annotations:
    argocd-image-updater.argoproj.io/image-list: beep-int=us-central1-docker.pkg.dev/PROJECT_ID/boop-repo/beep-int/beep-int
    argocd-image-updater.argoproj.io/beep-int.update-strategy: newest-build
    argocd-image-updater.argoproj.io/beep-int.allow-tags: regexp:^[0-9a-f]{7}$
    argocd-image-updater.argoproj.io/beep-int.force-update: "true"
    argocd-image-updater.argoproj.io/write-back-method: git
  finalizers:
    - resources-finalizer.argocd.argoproj.io
spec:
  project: main
  source:
    repoURL: git@github.com:MYDOMAIN/gitops.git
    targetRevision: poc
    path: hack/apps/beep-int-kust/overlays/staging
  destination:
    server: https://kubernetes.default.svc
    namespace: staging
  syncPolicy:
    automated:
      prune: true
      selfHeal: true
    retry:
      limit: 5
      backoff:
        duration: 5s
        maxDuration: 3m0s
        factor: 2
    syncOptions:
      - CreateNamespace=true

gitops: beep-int-kust $ tree -a .
.
├── README.md
├── base
│   ├── kustomization.yaml
│   ├── runservice.yaml
└── overlays
    ├── dev
    │   ├── .argocd-source-beep-int-kust-dev.yaml
    │   ├── kustomization.yaml
    │   └── runservice-patch.yaml
    ├── prod
    │   ├── .argocd-source-beep-int-kust-prod.yaml
    │   ├── kustomization.yaml
    │   └── runservice-patch.yaml
    └── staging
        ├── .argocd-source-beep-int-kust-staging.yaml
        ├── kustomization.yaml
        └── runservice-patch.yaml

Failing case: Here's what happens for the failing case, my test app using Helm.

1) deploy app with ArgoCD using manifest beep-int-helm-staging.yaml with an older image tag. 2) AIU polls our package repo and sees there's a newer package 3) AIU updates gitops repo, creating file .argocd-source-beep-int-helm-staging.yaml

gitops: beep-int-helm $ cat .argocd-source-beep-int-helm-staging.yaml
helm:
  parameters:
  - name: image.name
    value: us-central1-docker.pkg.dev/PROJECT_ID/boop-repo/beep-int/beep-int
    forcestring: true
  - name: image.tag
    value: b48d028
    forcestring: true

4) I hit refresh button on ArgoCD UI. ArgoCD does nothing. Here's the log:

time="2024-08-13T17:27:20Z" level=info msg="Refreshing app status (normal refresh requested), level (3)" application=argocd/beep-int-helm-staging
time="2024-08-13T17:27:20Z" level=info msg="Comparing app state (cluster: https://kubernetes.default.svc, namespace: staging)" application=argocd/beep-int-helm-staging
time="2024-08-13T17:27:23Z" level=info msg="GetRepoObjs stats" application=argocd/beep-int-helm-staging build_options_ms=0 helm_ms=0 plugins_ms=0 repo_ms=0 time_ms=3127 unmarshal_ms=3126 version_ms=0
time="2024-08-13T17:27:23Z" level=info msg="Normalized app spec: {\"status\":{\"sync\":{\"comparedTo\":{\"destination\":{\"namespace\":\"staging\",\"server\":\"https://kubernetes.default.svc\"},\"source\":{\"helm\":{\"valueFiles\":[\"values.yaml\",\"values-staging.yaml\"]},\"path\":\"hack/apps/beep-int-helm\",\"repoURL\":\"git@github.com:MYDOMAIN/gitops.git\",\"targetRevision\":\"poc\"}}}}}" application=argocd/beep-int-helm-staging
time="2024-08-13T17:27:23Z" level=info msg="Skipping auto-sync: application status is Synced" application=argocd/beep-int-helm-staging
time="2024-08-13T17:27:24Z" level=info msg="Update successful" application=argocd/beep-int-helm-staging
time="2024-08-13T17:27:24Z" level=info msg="Reconciliation completed" application=argocd/beep-int-helm-staging dedup_ms=0 dest-name= dest-namespace=staging dest-server="https://kubernetes.default.svc" diff_ms=3 fields.level=3 git_ms=3127 health_ms=0 live_ms=0 patch_ms=20 setop_ms=0 settings_ms=0 sync_ms=0 time_ms=3178

Succeeding case: Here's what happens for the working case, my test app using Kustomize

1) deploy app with ArgoCD using manifest beep-int-kust-staging.yaml with an older image tag. 2) AIU polls our package repo and sees there's a newer package 3) AIU updates gitops repo, creating file .argocd-source-beep-int-kust-staging.yaml

beep-int-kust $ cat overlays/staging/.argocd-source-beep-int-kust-staging.yaml
kustomize:
  images:
  - us-central1-docker.pkg.dev/PROJECT_ID/boop-repo/beep-int/beep-int:b48d028

4) I hit refresh button on ArgoCD UI. ArgoCD Syncs the update successfully. Here's the log:

time="2024-08-13T05:14:16Z" level=info msg="Refreshing app status (normal refresh requested), level (3)" application=argocd/beep-int-kust-staging
time="2024-08-13T05:14:16Z" level=info msg="Comparing app state (cluster: https://kubernetes.default.svc, namespace: staging)" application=argocd/beep-int-kust-staging
time="2024-08-13T05:14:20Z" level=info msg="GetRepoObjs stats" application=argocd/beep-int-kust-staging build_options_ms=0 helm_ms=0 plugins_ms=0 repo_ms=0 time_ms=3279 unmarshal_ms=3278 version_ms=0
time="2024-08-13T05:14:20Z" level=info msg="Normalized app spec: {\"status\":{\"sync\":{\"comparedTo\":{\"destination\":{\"namespace\":\"staging\",\"server\":\"https://kubernetes.default.svc\"},\"source\":{\"path\":\"hack/apps/beep-int-kust/overlays/staging\",\"repoURL\":\"git@github.com:MYDOMAIN/gitops.git\",\"targetRevision\":\"poc\"}}}}}" application=argocd/beep-int-kust-staging
time="2024-08-13T05:14:20Z" level=info msg="Initiated automated sync to '3988291092e99973d251c0bfe07d2968c86b8d3f'" application=beep-int-kust-staging dest-namespace=staging dest-server="https://kubernetes.default.svc" reason=OperationStarted type=Normal
time="2024-08-13T05:14:20Z" level=info msg="Initiated automated sync to '3988291092e99973d251c0bfe07d2968c86b8d3f'" application=argocd/beep-int-kust-staging
time="2024-08-13T05:14:20Z" level=info msg="Updated sync status: Synced -> OutOfSync" application=beep-int-kust-staging dest-namespace=staging dest-server="https://kubernetes.default.svc" reason=ResourceUpdated type=Normal
time="2024-08-13T05:14:20Z" level=info msg="updated 'argocd/beep-int-kust-staging' operation (phase: Running)" appNamespace=argocd application=beep-int-kust-staging project=main
...snip I assume that's enough log to see it succeeded, compared to the failing example..

Version

helm chart: argocd-image-updater-0.10.2
AIU version: v0.13.1

$ argocd version
argocd: v2.12.0+ec30a48
  BuildDate: 2024-08-05T15:31:14Z
  GitCommit: ec30a48bce7a60046836e481cd2160e28c59231d
  GitTreeState: clean
  GoVersion: go1.22.5
  Compiler: gc
  Platform: darwin/arm64
argocd-server: v2.11.7+e4a0246
  BuildDate: 2024-07-24T09:33:49Z
  GitCommit: e4a0246c4d920bc1e5ee5f9048a99eca7e1d53cb
  GitTreeState: clean
  GoVersion: go1.21.10
  Compiler: gc
  Platform: linux/amd64
  Kustomize Version: v5.2.1 2023-10-19T20:13:51Z
  Helm Version: v3.14.4+g81c902a
  Kubectl Version: v0.26.11
  Jsonnet Version: v0.20.0

Logs In-line above.

kallentrustle commented 1 month ago

I have a total of 3 test cases now, and debug logs. Why is beep-int-helm-staging failing to be upgraded by ArgoCD even after AIU has updated its gitops directory with the .argocd-* file?

test1:  kustomize  | beep-int-kust-staging  | GCC RunService  | SUCCESS
test2:  helm       | beep-int-helm-staging  | GCC RunService  | FAIL
test3:  helm       | hello-go-helm-staging  | Deployment      | SUCCESS

The new test is a simple hello-go webapp deployment using Helm. ArgoCD server successfully syncs the image tag update that AIU uploads to its gitops directory.

beep-int-kust-staging == SUCCESS Manifest and dir structure are shown above in initial post.

$ cat overlays/staging/.argocd-source-beep-int-kust-staging.yaml
kustomize:
  images:
  - region-xyz-docker.pkg.dev/PROJECT_ID/boop-repo/beep-int/beep-int:94d99bf

time="2024-08-14T18:33:30Z" level=info msg="Refreshing app status (normal refresh requested), level (3)" application=argocd/beep-int-kust-staging
time="2024-08-14T18:33:30Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:33:30Z" level=info msg="Comparing app state (cluster: https://kubernetes.default.svc, namespace: staging)" application=argocd/beep-int-kust-staging
time="2024-08-14T18:33:30Z" level=debug msg="git@github.com:MYDOMAIN/gitops.git has credentials"
time="2024-08-14T18:33:30Z" level=debug msg="Generating Manifest for source {git@github.com:MYDOMAIN/gitops.git hack/apps/beep-int-kust/overlays/staging poc nil nil nil nil  } revision poc"
time="2024-08-14T18:33:30Z" level=debug msg="Successfully saved info of 1 clusters"
time="2024-08-14T18:33:33Z" level=info msg="GetRepoObjs stats" application=argocd/beep-int-kust-staging build_options_ms=0 helm_ms=0 plugins_ms=0 repo_ms=0 time_ms=3406 unmarshal_ms=3405 version_ms=0
time="2024-08-14T18:33:33Z" level=debug msg="Retrieved live manifests" application=argocd/beep-int-kust-staging
time="2024-08-14T18:33:33Z" level=debug msg="refresh type normal requested" application=argocd/beep-int-kust-staging useDiffCache=false
time="2024-08-14T18:33:33Z" level=info msg="Normalized app spec: {\"status\":{\"sync\":{\"comparedTo\":{\"destination\":{\"namespace\":\"staging\",\"server\":\"https://kubernetes.default.svc\"},\"source\":{\"path\":\"hack/apps/beep-int-kust/overlays/staging\",\"repoURL\":\"git@github.com:MYDOMAIN/gitops.git\",\"targetRevision\":\"poc\"}}}}}" application=argocd/beep-int-kust-staging
time="2024-08-14T18:33:33Z" level=info msg="Initiated automated sync to 'c5a7ea429e77f63b4a6ca60a5288a8e3a8210caa'" application=beep-int-kust-staging dest-namespace=staging dest-server="https://kubernetes.default.svc" reason=OperationStarted type=Normal
time="2024-08-14T18:33:33Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:33:33Z" level=debug msg="Skipping sharding distribution update. No relevant changes"
time="2024-08-14T18:33:33Z" level=info msg="Start Update application operation state"
time="2024-08-14T18:33:33Z" level=info msg="Initiated automated sync to 'c5a7ea429e77f63b4a6ca60a5288a8e3a8210caa'" application=argocd/beep-int-kust-staging
time="2024-08-14T18:33:33Z" level=info msg="Updated sync status: Synced -> OutOfSync" application=beep-int-kust-staging dest-namespace=staging dest-server="https://kubernetes.default.svc" reason=ResourceUpdated type=Normal
time="2024-08-14T18:33:33Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:33:33Z" level=info msg="Completed Update application operation state"
time="2024-08-14T18:33:33Z" level=debug msg="Skipping sharding distribution update. No relevant changes"
time="2024-08-14T18:33:33Z" level=info msg="updated 'argocd/beep-int-kust-staging' operation (phase: Running)" appNamespace=argocd application=beep-int-kust-staging project=main
time="2024-08-14T18:33:33Z" level=info msg="Initialized new operation: {&SyncOperation{Revision:c5a7ea429e77f63b4a6ca60a5288a8e3a8210caa,Prune:true,DryRun:false,SyncStrategy:nil,Resources:[]SyncOperationResource{},Source:nil,Manifests:[],SyncOptions:[CreateNamespace=true],Sources:[]ApplicationSource{},Revisions:[],} { true} [] {5 &Backoff{Duration:5s,Factor:*2,MaxDuration:3m0s,}}}" application=argocd/beep-int-kust-staging
time="2024-08-14T18:33:33Z" level=info msg="Comparing app state (cluster: https://kubernetes.default.svc, namespace: staging)" application=argocd/beep-int-kust-staging
time="2024-08-14T18:33:33Z" level=debug msg="git@github.com:MYDOMAIN/gitops.git has credentials"
time="2024-08-14T18:33:33Z" level=debug msg="Generating Manifest for source {git@github.com:MYDOMAIN/gitops.git hack/apps/beep-int-kust/overlays/staging poc nil nil nil nil  } revision c5a7ea429e77f63b4a6ca60a5288a8e3a8210caa"
time="2024-08-14T18:33:33Z" level=info msg="GetRepoObjs stats" application=argocd/beep-int-kust-staging build_options_ms=0 helm_ms=0 plugins_ms=0 repo_ms=0 time_ms=16 unmarshal_ms=14 version_ms=1
time="2024-08-14T18:33:33Z" level=debug msg="Retrieved live manifests" application=argocd/beep-int-kust-staging
time="2024-08-14T18:33:33Z" level=debug msg="refresh type normal requested" application=argocd/beep-int-kust-staging useDiffCache=false
time="2024-08-14T18:33:34Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:33:34Z" level=info msg="Update successful" application=argocd/beep-int-kust-staging
time="2024-08-14T18:33:34Z" level=info msg="Reconciliation completed" application=argocd/beep-int-kust-staging dedup_ms=0 dest-name= dest-namespace=staging dest-server="https://kubernetes.default.svc" diff_ms=3 fields.level=3 git_ms=3406 health_ms=0 live_ms=1 patch_ms=59 setop_ms=29 settings_ms=0 sync_ms=0 time_ms=3569
time="2024-08-14T18:33:34Z" level=debug msg="Skipping sharding distribution update. No relevant changes"
time="2024-08-14T18:33:34Z" level=info msg=Syncing application=argocd/beep-int-kust-staging skipHooks=false started=false syncId=00007-IEkBu
time="2024-08-14T18:33:34Z" level=info msg="Tasks from managed resources" application=argocd/beep-int-kust-staging resourceTasks="[Sync/0 resource run.cnrm.cloud.google.com/RunService:staging/beep-int-kust obj->obj (,,)]" syncId=00007-IEkBu
time="2024-08-14T18:33:34Z" level=info msg="tasks from hooks" application=argocd/beep-int-kust-staging hookTasks="[]" syncId=00007-IEkBu
time="2024-08-14T18:33:34Z" level=info msg="Namespace already exists" application=argocd/beep-int-kust-staging namespace=staging syncId=00007-IEkBu
time="2024-08-14T18:33:34Z" level=info msg="Tasks (dry-run)" application=argocd/beep-int-kust-staging syncId=00007-IEkBu tasks="[Sync/0 resource run.cnrm.cloud.google.com/RunService:staging/beep-int-kust obj->obj (,,)]"
time="2024-08-14T18:33:34Z" level=info msg="Running tasks" application=argocd/beep-int-kust-staging dryRun=true numTasks=1 syncId=00007-IEkBu
time="2024-08-14T18:33:34Z" level=info msg=Applying application=argocd/beep-int-kust-staging dryRun=true syncId=00007-IEkBu task="Sync/0 resource run.cnrm.cloud.google.com/RunService:staging/beep-int-kust obj->obj (,,)"
time="2024-08-14T18:33:34Z" level=info msg="Applying resource RunService/beep-int-kust in cluster: https://10.0.32.1:443, namespace: staging" dry-run=client manager=argocd-controller serverSideApply=false serverSideDiff=false
time="2024-08-14T18:33:34Z" level=info msg="{\"apiVersion\":\"run.cnrm.cloud.google.com/v1beta1\",\"kind\":\"RunService\",\"metadata\":{\"labels\":{\"argocd.argoproj.io/instance\":\"beep-int-kust-staging\"},\"name\":\"beep-int-kust\",\"namespace\":\"staging\"},\"spec\":{\"ingress\":\"INGRESS_TRAFFIC_INTERNAL_ONLY\",\"launchStage\":\"GA\",\"location\":\"region-xyz\",\"projectRef\":{\"external\":\"projects/PROJECT_ID\"},\"template\":{\"containers\":[{\"env\":[{\"name\":\"GOOGLE_CLOUD_PROJECT\",\"value\":\"PROJECT_ID\"},{\"name\":\"API_BASE_URL\",\"value\":\"http://10.1.0.32:80\"},{\"name\":\"API_JWT_ENABLED\",\"value\":\"false\"},{\"name\":\"LOG_LEVEL\",\"value\":\"debug\"},{\"name\":\"API_AUTH_PRIVATE_KEY\",\"valueSource\":{\"secretKeyRef\":{\"secretRef\":{\"external\":\"projects/PROJECT_NUMBER/secrets/staging-beep-int\"},\"versionRef\":{\"external\":\"latest\"}}}}],\"image\":\"region-xyz-docker.pkg.dev/PROJECT_ID/boop-repo/beep-int/beep-int:94d99bf\"}],\"maxInstanceRequestConcurrency\":80,\"scaling\":{\"maxInstanceCount\":100,\"minInstanceCount\":0},\"serviceAccountRef\":{\"external\":\"sa-gcp-acct@PROJECT_ID.iam.gserviceaccount.com\"},\"timeout\":\"3600s\",\"vpcAccess\":{\"egress\":\"PRIVATE_RANGES_ONLY\",\"networkInterfaces\":[{\"networkRef\":{\"external\":\"projects/PROJECT_ID/global/networks/staging\"},\"subnetworkRef\":{\"external\":\"projects/PROJECT_ID/regions/region-xyz/subnetworks/staging-region-xyz\"}}]}},\"traffic\":[{\"percent\":100,\"type\":\"TRAFFIC_TARGET_ALLOCATION_TYPE_LATEST\"}]}}"
time="2024-08-14T18:33:35Z" level=info msg="Filtering out non-pending tasks" application=argocd/beep-int-kust-staging syncId=00007-IEkBu tasks="[Sync/0 resource run.cnrm.cloud.google.com/RunService:staging/beep-int-kust obj->obj (,,)]"
time="2024-08-14T18:33:35Z" level=info msg="Filtering tasks in correct phase and wave" application=argocd/beep-int-kust-staging phase=Sync syncFailTasks="[]" syncId=00007-IEkBu tasks="[Sync/0 resource run.cnrm.cloud.google.com/RunService:staging/beep-int-kust obj->obj (,,)]" wave=0
time="2024-08-14T18:33:35Z" level=info msg="Updating operation state. phase: Running -> Running, message: '' -> 'one or more tasks are running'" application=argocd/beep-int-kust-staging syncId=00007-IEkBu
time="2024-08-14T18:33:35Z" level=info msg=Wet-run application=argocd/beep-int-kust-staging syncId=00007-IEkBu tasks="[Sync/0 resource run.cnrm.cloud.google.com/RunService:staging/beep-int-kust obj->obj (,,)]"
time="2024-08-14T18:33:35Z" level=info msg="Running tasks" application=argocd/beep-int-kust-staging dryRun=false numTasks=1 syncId=00007-IEkBu
time="2024-08-14T18:33:35Z" level=info msg=Applying application=argocd/beep-int-kust-staging dryRun=false syncId=00007-IEkBu task="Sync/0 resource run.cnrm.cloud.google.com/RunService:staging/beep-int-kust obj->obj (,,)"
time="2024-08-14T18:33:35Z" level=info msg="Applying resource RunService/beep-int-kust in cluster: https://10.0.32.1:443, namespace: staging" dry-run=none manager=argocd-controller serverSideApply=false serverSideDiff=false
time="2024-08-14T18:33:35Z" level=info msg="{\"apiVersion\":\"run.cnrm.cloud.google.com/v1beta1\",\"kind\":\"RunService\",\"metadata\":{\"labels\":{\"argocd.argoproj.io/instance\":\"beep-int-kust-staging\"},\"name\":\"beep-int-kust\",\"namespace\":\"staging\"},\"spec\":{\"ingress\":\"INGRESS_TRAFFIC_INTERNAL_ONLY\",\"launchStage\":\"GA\",\"location\":\"region-xyz\",\"projectRef\":{\"external\":\"projects/PROJECT_ID\"},\"template\":{\"containers\":[{\"env\":[{\"name\":\"GOOGLE_CLOUD_PROJECT\",\"value\":\"PROJECT_ID\"},{\"name\":\"API_BASE_URL\",\"value\":\"http://10.1.0.32:80\"},{\"name\":\"API_JWT_ENABLED\",\"value\":\"false\"},{\"name\":\"LOG_LEVEL\",\"value\":\"debug\"},{\"name\":\"API_AUTH_PRIVATE_KEY\",\"valueSource\":{\"secretKeyRef\":{\"secretRef\":{\"external\":\"projects/PROJECT_NUMBER/secrets/staging-beep-int\"},\"versionRef\":{\"external\":\"latest\"}}}}],\"image\":\"region-xyz-docker.pkg.dev/PROJECT_ID/boop-repo/beep-int/beep-int:94d99bf\"}],\"maxInstanceRequestConcurrency\":80,\"scaling\":{\"maxInstanceCount\":100,\"minInstanceCount\":0},\"serviceAccountRef\":{\"external\":\"sa-gcp-acct@PROJECT_ID.iam.gserviceaccount.com\"},\"timeout\":\"3600s\",\"vpcAccess\":{\"egress\":\"PRIVATE_RANGES_ONLY\",\"networkInterfaces\":[{\"networkRef\":{\"external\":\"projects/PROJECT_ID/global/networks/staging\"},\"subnetworkRef\":{\"external\":\"projects/PROJECT_ID/regions/region-xyz/subnetworks/staging-region-xyz\"}}]}},\"traffic\":[{\"percent\":100,\"type\":\"TRAFFIC_TARGET_ALLOCATION_TYPE_LATEST\"}]}}"
time="2024-08-14T18:33:36Z" level=info msg="Adding resource result, status: 'Synced', phase: 'Running', message: 'runservice.run.cnrm.cloud.google.com/beep-int-kust configured'" application=argocd/beep-int-kust-staging kind=RunService name=beep-int-kust namespace=staging phase=Sync syncId=00007-IEkBu
time="2024-08-14T18:33:36Z" level=info msg="Updating operation state. phase: Running -> Succeeded, message: 'one or more tasks are running' -> 'successfully synced (all tasks run)'" application=argocd/beep-int-kust-staging syncId=00007-IEkBu
time="2024-08-14T18:33:36Z" level=info msg="sync/terminate complete" application=argocd/beep-int-kust-staging duration=1.995069035s syncId=00007-IEkBu
time="2024-08-14T18:33:36Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:33:36Z" level=debug msg="Requesting app refresh caused by object update" api-version=run.cnrm.cloud.google.com/v1beta1 application=argocd/beep-int-kust-staging cluster-name= fields.level=1 kind=RunService name=beep-int-kust namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:33:36Z" level=info msg="Refreshing app status (controller refresh requested), level (1)" application=argocd/beep-int-kust-staging
time="2024-08-14T18:33:36Z" level=info msg="Comparing app state (cluster: https://kubernetes.default.svc, namespace: staging)" application=argocd/beep-int-kust-staging
time="2024-08-14T18:33:36Z" level=info msg="Start Update application operation state"
time="2024-08-14T18:33:36Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:33:36Z" level=debug msg="Skipping sharding distribution update. No relevant changes"
time="2024-08-14T18:33:36Z" level=debug msg="git@github.com:MYDOMAIN/gitops.git has credentials"
time="2024-08-14T18:33:36Z" level=debug msg="Generating Manifest for source {git@github.com:MYDOMAIN/gitops.git hack/apps/beep-int-kust/overlays/staging poc nil nil nil nil  } revision c5a7ea429e77f63b4a6ca60a5288a8e3a8210caa"
time="2024-08-14T18:33:36Z" level=info msg="Completed Update application operation state"
time="2024-08-14T18:33:36Z" level=info msg="updated 'argocd/beep-int-kust-staging' operation (phase: Succeeded)" appNamespace=argocd application=beep-int-kust-staging project=main
time="2024-08-14T18:33:36Z" level=info msg="Sync operation to c5a7ea429e77f63b4a6ca60a5288a8e3a8210caa succeeded" application=beep-int-kust-staging dest-namespace=staging dest-server="https://kubernetes.default.svc" reason=OperationCompleted type=Normal
time="2024-08-14T18:33:36Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:33:36Z" level=debug msg="Skipping sharding distribution update. No relevant changes"
time="2024-08-14T18:33:36Z" level=info msg="GetRepoObjs stats" application=argocd/beep-int-kust-staging build_options_ms=0 helm_ms=0 plugins_ms=0 repo_ms=0 time_ms=102 unmarshal_ms=100 version_ms=1
time="2024-08-14T18:33:36Z" level=debug msg="Retrieved live manifests" application=argocd/beep-int-kust-staging
time="2024-08-14T18:33:36Z" level=debug msg="using diff cache" application=argocd/beep-int-kust-staging useDiffCache=true
time="2024-08-14T18:33:36Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:33:36Z" level=debug msg="Requesting app refresh caused by object update" api-version=run.cnrm.cloud.google.com/v1beta1 application=argocd/beep-int-kust-staging cluster-name= fields.level=1 kind=RunService name=beep-int-kust namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:33:36Z" level=info msg="Normalized app spec: {\"status\":{\"sync\":{\"comparedTo\":{\"destination\":{\"namespace\":\"staging\",\"server\":\"https://kubernetes.default.svc\"},\"source\":{\"path\":\"hack/apps/beep-int-kust/overlays/staging\",\"repoURL\":\"git@github.com:MYDOMAIN/gitops.git\",\"targetRevision\":\"poc\"}}}}}" application=argocd/beep-int-kust-staging
time="2024-08-14T18:33:36Z" level=info msg="Skipping auto-sync: another operation is in progress" application=argocd/beep-int-kust-staging
time="2024-08-14T18:33:36Z" level=info msg="Updated sync status: OutOfSync -> Synced" application=beep-int-kust-staging dest-namespace=staging dest-server="https://kubernetes.default.svc" reason=ResourceUpdated type=Normal
time="2024-08-14T18:33:36Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:33:36Z" level=info msg="Update successful" application=argocd/beep-int-kust-staging
time="2024-08-14T18:33:36Z" level=info msg="Reconciliation completed" application=argocd/beep-int-kust-staging dedup_ms=0 dest-name= dest-namespace=staging dest-server="https://kubernetes.default.svc" diff_ms=91 fields.level=1 git_ms=104 health_ms=0 live_ms=2 patch_ms=98 setop_ms=0 settings_ms=0 sync_ms=0 time_ms=498
time="2024-08-14T18:33:36Z" level=debug msg="Skipping sharding distribution update. No relevant changes"
time="2024-08-14T18:33:36Z" level=info msg="Refreshing app status (controller refresh requested), level (2)" application=argocd/beep-int-kust-staging
time="2024-08-14T18:33:36Z" level=info msg="Comparing app state (cluster: https://kubernetes.default.svc, namespace: staging)" application=argocd/beep-int-kust-staging
time="2024-08-14T18:33:36Z" level=debug msg="git@github.com:MYDOMAIN/gitops.git has credentials"
time="2024-08-14T18:33:36Z" level=debug msg="Generating Manifest for source {git@github.com:MYDOMAIN/gitops.git hack/apps/beep-int-kust/overlays/staging poc nil nil nil nil  } revision poc"
time="2024-08-14T18:33:36Z" level=info msg="GetRepoObjs stats" application=argocd/beep-int-kust-staging build_options_ms=0 helm_ms=0 plugins_ms=0 repo_ms=0 time_ms=15 unmarshal_ms=13 version_ms=0
time="2024-08-14T18:33:36Z" level=debug msg="Retrieved live manifests" application=argocd/beep-int-kust-staging
time="2024-08-14T18:33:36Z" level=debug msg="using diff cache" application=argocd/beep-int-kust-staging useDiffCache=true
time="2024-08-14T18:33:36Z" level=info msg="Normalized app spec: {\"status\":{\"sync\":{\"comparedTo\":{\"destination\":{\"namespace\":\"staging\",\"server\":\"https://kubernetes.default.svc\"},\"source\":{\"path\":\"hack/apps/beep-int-kust/overlays/staging\",\"repoURL\":\"git@github.com:MYDOMAIN/gitops.git\",\"targetRevision\":\"poc\"}}}}}" application=argocd/beep-int-kust-staging
time="2024-08-14T18:33:36Z" level=info msg="Skipping auto-sync: application status is Synced" application=argocd/beep-int-kust-staging
time="2024-08-14T18:33:36Z" level=info msg="Update successful" application=argocd/beep-int-kust-staging
time="2024-08-14T18:33:36Z" level=info msg="Reconciliation completed" application=argocd/beep-int-kust-staging dedup_ms=0 dest-name= dest-namespace=staging dest-server="https://kubernetes.default.svc" diff_ms=5 fields.level=2 git_ms=16 health_ms=0 live_ms=1 patch_ms=52 setop_ms=0 settings_ms=0 sync_ms=0 time_ms=110
time="2024-08-14T18:33:36Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:33:36Z" level=debug msg="Skipping sharding distribution update. No relevant changes"
time="2024-08-14T18:33:39Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:33:39Z" level=debug msg="Skipping sharding distribution update. No relevant changes"
time="2024-08-14T18:33:50Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:33:50Z" level=debug msg="Successfully saved info of 1 clusters"
time="2024-08-14T18:33:56Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:33:56Z" level=debug msg="Requesting app refresh caused by object update" api-version=run.cnrm.cloud.google.com/v1beta1 application=argocd/beep-int-kust-staging cluster-name= fields.level=1 kind=RunService name=beep-int-kust namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:33:56Z" level=info msg="Refreshing app status (controller refresh requested), level (1)" application=argocd/beep-int-kust-staging
time="2024-08-14T18:33:56Z" level=info msg="Comparing app state (cluster: https://kubernetes.default.svc, namespace: staging)" application=argocd/beep-int-kust-staging
time="2024-08-14T18:33:56Z" level=debug msg="git@github.com:MYDOMAIN/gitops.git has credentials"
time="2024-08-14T18:33:56Z" level=debug msg="Generating Manifest for source {git@github.com:MYDOMAIN/gitops.git hack/apps/beep-int-kust/overlays/staging poc nil nil nil nil  } revision c5a7ea429e77f63b4a6ca60a5288a8e3a8210caa"
time="2024-08-14T18:33:56Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:33:56Z" level=debug msg="Requesting app refresh caused by object update" api-version=run.cnrm.cloud.google.com/v1beta1 application=argocd/beep-int-kust-staging cluster-name= fields.level=1 kind=RunService name=beep-int-kust namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:33:56Z" level=info msg="GetRepoObjs stats" application=argocd/beep-int-kust-staging build_options_ms=0 helm_ms=0 plugins_ms=0 repo_ms=0 time_ms=17 unmarshal_ms=16 version_ms=0
time="2024-08-14T18:33:56Z" level=debug msg="Retrieved live manifests" application=argocd/beep-int-kust-staging
time="2024-08-14T18:33:56Z" level=debug msg="using diff cache" application=argocd/beep-int-kust-staging useDiffCache=true
time="2024-08-14T18:33:56Z" level=info msg="Normalized app spec: {\"status\":{\"sync\":{\"comparedTo\":{\"destination\":{\"namespace\":\"staging\",\"server\":\"https://kubernetes.default.svc\"},\"source\":{\"path\":\"hack/apps/beep-int-kust/overlays/staging\",\"repoURL\":\"git@github.com:MYDOMAIN/gitops.git\",\"targetRevision\":\"poc\"}}}}}" application=argocd/beep-int-kust-staging
time="2024-08-14T18:33:56Z" level=info msg="Skipping auto-sync: application status is Synced" application=argocd/beep-int-kust-staging
time="2024-08-14T18:33:56Z" level=info msg="Update successful" application=argocd/beep-int-kust-staging
time="2024-08-14T18:33:56Z" level=info msg="Reconciliation completed" application=argocd/beep-int-kust-staging dedup_ms=0 dest-name= dest-namespace=staging dest-server="https://kubernetes.default.svc" diff_ms=3 fields.level=1 git_ms=17 health_ms=0 live_ms=0 patch_ms=17 setop_ms=0 settings_ms=0 sync_ms=0 time_ms=78

beep-int-helm-staging == FAIL Manifest and dir structure are shown above in initial post.

$ cat .argocd-source-beep-int-helm-staging.yaml
helm:
  parameters:
  - name: image.name
    value: region-xyz-docker.pkg.dev/PROJECT_ID/boop-repo/beep-int/beep-int
    forcestring: true
  - name: image.tag
    value: 94d99bf
    forcestring: true

time="2024-08-14T18:26:08Z" level=info msg="Refreshing app status (normal refresh requested), level (3)" application=argocd/beep-int-helm-staging
time="2024-08-14T18:26:08Z" level=info msg="Comparing app state (cluster: https://kubernetes.default.svc, namespace: staging)" application=argocd/beep-int-helm-staging
time="2024-08-14T18:26:08Z" level=debug msg="git@github.com:MYDOMAIN/gitops.git has credentials"
time="2024-08-14T18:26:08Z" level=debug msg="Generating Manifest for source {git@github.com:MYDOMAIN/gitops.git hack/apps/beep-int-helm poc &ApplicationSourceHelm{ValueFiles:[values-base.yaml values-staging.yaml],Parameters:[]HelmParameter{},ReleaseName:,Values:,FileParameters:[]HelmFileParameter{},Version:,PassCredentials:false,IgnoreMissingValueFiles:false,SkipCrds:false,ValuesObject:nil,} nil nil nil  } revision poc"
time="2024-08-14T18:26:11Z" level=info msg="GetRepoObjs stats" application=argocd/beep-int-helm-staging build_options_ms=0 helm_ms=0 plugins_ms=0 repo_ms=0 time_ms=3050 unmarshal_ms=3049 version_ms=0
time="2024-08-14T18:26:11Z" level=debug msg="Retrieved live manifests" application=argocd/beep-int-helm-staging
time="2024-08-14T18:26:11Z" level=debug msg="refresh type normal requested" application=argocd/beep-int-helm-staging useDiffCache=false
time="2024-08-14T18:26:11Z" level=info msg="Normalized app spec: {\"status\":{\"sync\":{\"comparedTo\":{\"destination\":{\"namespace\":\"staging\",\"server\":\"https://kubernetes.default.svc\"},\"source\":{\"helm\":{\"valueFiles\":[\"values-base.yaml\",\"values-staging.yaml\"]},\"path\":\"hack/apps/beep-int-helm\",\"repoURL\":\"git@github.com:MYDOMAIN/gitops.git\",\"targetRevision\":\"poc\"}}}}}" application=argocd/beep-int-helm-staging
time="2024-08-14T18:26:11Z" level=info msg="Skipping auto-sync: application status is Synced" application=argocd/beep-int-helm-staging
time="2024-08-14T18:26:11Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:26:11Z" level=debug msg="Skipping sharding distribution update. No relevant changes"
time="2024-08-14T18:26:11Z" level=info msg="Update successful" application=argocd/beep-int-helm-staging
time="2024-08-14T18:26:11Z" level=info msg="Reconciliation completed" application=argocd/beep-int-helm-staging dedup_ms=0 dest-name= dest-namespace=staging dest-server="https://kubernetes.default.svc" diff_ms=3 fields.level=3 git_ms=3050 health_ms=0 live_ms=0 patch_ms=30 setop_ms=0 settings_ms=0 sync_ms=0 time_ms=3118
time="2024-08-14T18:26:20Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:26:20Z" level=debug msg="Successfully saved info of 1 clusters"
time="2024-08-14T18:26:24Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:26:24Z" level=debug msg="Skipping sharding distribution update. No relevant changes"

time="2024-08-14T18:26:24Z" level=info msg="Refreshing app status (normal refresh requested), level (3)" application=argocd/beep-int-helm-staging
time="2024-08-14T18:26:24Z" level=info msg="Comparing app state (cluster: https://kubernetes.default.svc, namespace: staging)" application=argocd/beep-int-helm-staging
time="2024-08-14T18:26:24Z" level=debug msg="git@github.com:MYDOMAIN/gitops.git has credentials"
time="2024-08-14T18:26:24Z" level=debug msg="Generating Manifest for source {git@github.com:MYDOMAIN/gitops.git hack/apps/beep-int-helm poc &ApplicationSourceHelm{ValueFiles:[values-base.yaml values-staging.yaml],Parameters:[]HelmParameter{},ReleaseName:,Values:,FileParameters:[]HelmFileParameter{},Version:,PassCredentials:false,IgnoreMissingValueFiles:false,SkipCrds:false,ValuesObject:nil,} nil nil nil  } revision poc"
time="2024-08-14T18:26:24Z" level=info msg="GetRepoObjs stats" application=argocd/beep-int-helm-staging build_options_ms=0 helm_ms=0 plugins_ms=0 repo_ms=0 time_ms=501 unmarshal_ms=500 version_ms=0
time="2024-08-14T18:26:24Z" level=debug msg="Retrieved live manifests" application=argocd/beep-int-helm-staging
time="2024-08-14T18:26:24Z" level=debug msg="refresh type normal requested" application=argocd/beep-int-helm-staging useDiffCache=false
time="2024-08-14T18:26:24Z" level=info msg="Normalized app spec: {\"status\":{\"sync\":{\"comparedTo\":{\"destination\":{\"namespace\":\"staging\",\"server\":\"https://kubernetes.default.svc\"},\"source\":{\"helm\":{\"valueFiles\":[\"values-base.yaml\",\"values-staging.yaml\"]},\"path\":\"hack/apps/beep-int-helm\",\"repoURL\":\"git@github.com:MYDOMAIN/gitops.git\",\"targetRevision\":\"poc\"}}}}}" application=argocd/beep-int-helm-staging
time="2024-08-14T18:26:24Z" level=info msg="Skipping auto-sync: application status is Synced" application=argocd/beep-int-helm-staging
time="2024-08-14T18:26:25Z" level=info msg="Update successful" application=argocd/beep-int-helm-staging
time="2024-08-14T18:26:25Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:26:25Z" level=info msg="Reconciliation completed" application=argocd/beep-int-helm-staging dedup_ms=0 dest-name= dest-namespace=staging dest-server="https://kubernetes.default.svc" diff_ms=3 fields.level=3 git_ms=501 health_ms=0 live_ms=0 patch_ms=31 setop_ms=0 settings_ms=0 sync_ms=0 time_ms=575
time="2024-08-14T18:26:25Z" level=debug msg="Skipping sharding distribution update. No relevant changes"
time="2024-08-14T18:26:37Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:26:37Z" level=debug msg="Skipping sharding distribution update. No relevant changes"
time="2024-08-14T18:26:37Z" level=info msg="Start Update application operation state"
time="2024-08-14T18:26:37Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:26:37Z" level=debug msg="Skipping sharding distribution update. No relevant changes"
time="2024-08-14T18:26:37Z" level=info msg="Completed Update application operation state"
time="2024-08-14T18:26:37Z" level=info msg="updated 'argocd/beep-int-helm-staging' operation (phase: Running)" appNamespace=argocd application=beep-int-helm-staging project=main
time="2024-08-14T18:26:37Z" level=info msg="Initialized new operation: {&SyncOperation{Revision:076ae2eb6ab12d9fc858537c6f6dc00057d4cca5,Prune:false,DryRun:false,SyncStrategy:&SyncStrategy{Apply:nil,Hook:&SyncStrategyHook{SyncStrategyApply:SyncStrategyApply{Force:false,},},},Resources:[]SyncOperationResource{},Source:nil,Manifests:[],SyncOptions:[CreateNamespace=true],Sources:[]ApplicationSource{},Revisions:[],} {kallen@MYDOMAIN.com false} [] {5 &Backoff{Duration:5s,Factor:*2,MaxDuration:3m0s,}}}" application=argocd/beep-int-helm-staging
time="2024-08-14T18:26:37Z" level=info msg="Comparing app state (cluster: https://kubernetes.default.svc, namespace: staging)" application=argocd/beep-int-helm-staging
time="2024-08-14T18:26:37Z" level=debug msg="git@github.com:MYDOMAIN/gitops.git has credentials"
time="2024-08-14T18:26:37Z" level=debug msg="Generating Manifest for source {git@github.com:MYDOMAIN/gitops.git hack/apps/beep-int-helm poc &ApplicationSourceHelm{ValueFiles:[values-base.yaml values-staging.yaml],Parameters:[]HelmParameter{},ReleaseName:,Values:,FileParameters:[]HelmFileParameter{},Version:,PassCredentials:false,IgnoreMissingValueFiles:false,SkipCrds:false,ValuesObject:nil,} nil nil nil  } revision 076ae2eb6ab12d9fc858537c6f6dc00057d4cca5"
time="2024-08-14T18:26:37Z" level=info msg="GetRepoObjs stats" application=argocd/beep-int-helm-staging build_options_ms=0 helm_ms=0 plugins_ms=0 repo_ms=0 time_ms=16 unmarshal_ms=16 version_ms=0
time="2024-08-14T18:26:37Z" level=debug msg="Retrieved live manifests" application=argocd/beep-int-helm-staging
time="2024-08-14T18:26:37Z" level=debug msg="using diff cache" application=argocd/beep-int-helm-staging useDiffCache=true
time="2024-08-14T18:26:37Z" level=info msg=Syncing application=argocd/beep-int-helm-staging skipHooks=false started=false syncId=00005-XOlYo
time="2024-08-14T18:26:37Z" level=info msg="Tasks from managed resources" application=argocd/beep-int-helm-staging resourceTasks="[Sync/0 resource run.cnrm.cloud.google.com/RunService:staging/beep-int-helm obj->obj (,,)]" syncId=00005-XOlYo
time="2024-08-14T18:26:37Z" level=info msg="tasks from hooks" application=argocd/beep-int-helm-staging hookTasks="[]" syncId=00005-XOlYo
time="2024-08-14T18:26:37Z" level=info msg="Namespace already exists" application=argocd/beep-int-helm-staging namespace=staging syncId=00005-XOlYo
time="2024-08-14T18:26:38Z" level=info msg="Tasks (dry-run)" application=argocd/beep-int-helm-staging syncId=00005-XOlYo tasks="[Sync/0 resource run.cnrm.cloud.google.com/RunService:staging/beep-int-helm obj->obj (,,)]"
time="2024-08-14T18:26:38Z" level=info msg="Running tasks" application=argocd/beep-int-helm-staging dryRun=true numTasks=1 syncId=00005-XOlYo
time="2024-08-14T18:26:38Z" level=info msg=Applying application=argocd/beep-int-helm-staging dryRun=true syncId=00005-XOlYo task="Sync/0 resource run.cnrm.cloud.google.com/RunService:staging/beep-int-helm obj->obj (,,)"
time="2024-08-14T18:26:38Z" level=info msg="Applying resource RunService/beep-int-helm in cluster: https://10.0.32.1:443, namespace: staging" dry-run=client manager=argocd-controller serverSideApply=false serverSideDiff=false
time="2024-08-14T18:26:38Z" level=info msg="{\"apiVersion\":\"run.cnrm.cloud.google.com/v1beta1\",\"kind\":\"RunService\",\"metadata\":{\"labels\":{\"argocd.argoproj.io/instance\":\"beep-int-helm-staging\"},\"name\":\"beep-int-helm\",\"namespace\":\"staging\"},\"spec\":{\"ingress\":\"INGRESS_TRAFFIC_INTERNAL_ONLY\",\"launchStage\":\"GA\",\"location\":\"region-xyz\",\"projectRef\":{\"external\":\"projects/PROJECT_ID\"},\"template\":{\"containers\":[{\"env\":[{\"name\":\"GOOGLE_CLOUD_PROJECT\",\"value\":\"PROJECT_ID\"},{\"name\":\"API_BASE_URL\",\"value\":\"http://10.1.0.32:80\"},{\"name\":\"API_JWT_ENABLED\",\"value\":\"false\"},{\"name\":\"LOG_LEVEL\",\"value\":\"debug\"},{\"name\":\"API_AUTH_PRIVATE_KEY\",\"valueSource\":{\"secretKeyRef\":{\"secretRef\":{\"external\":\"projects/PROJECT_NUMBER/secrets/staging-beep-int\"},\"versionRef\":{\"external\":\"latest\"}}}}],\"image\":\"region-xyz-docker.pkg.dev/PROJECT_ID/boop-repo/beep-int/beep-int:38a09c9\",\"name\":\"beep-int-helm\",\"ports\":[{\"containerPort\":8080,\"name\":\"http1\"}],\"resources\":{\"cpuIdle\":true,\"limits\":{\"cpu\":\"1000m\",\"memory\":\"512Mi\"},\"startupCpuBoost\":true},\"startupProbe\":{\"failureThreshold\":1,\"initialDelaySeconds\":0,\"periodSeconds\":240,\"tcpSocket\":{\"port\":8080},\"timeoutSeconds\":240}}],\"maxInstanceRequestConcurrency\":80,\"scaling\":{\"maxInstanceCount\":100,\"minInstanceCount\":0},\"serviceAccountRef\":{\"external\":\"sa-gcp-acct@PROJECT_ID.iam.gserviceaccount.com\"},\"timeout\":\"3600s\",\"vpcAccess\":{\"egress\":\"PRIVATE_RANGES_ONLY\",\"networkInterfaces\":[{\"networkRef\":{\"external\":\"projects/PROJECT_ID/global/networks/staging\"},\"subnetworkRef\":{\"external\":\"projects/PROJECT_ID/regions/region-xyz/subnetworks/staging-region-xyz\"}}]}},\"traffic\":[{\"percent\":100,\"type\":\"TRAFFIC_TARGET_ALLOCATION_TYPE_LATEST\"}]}}"
time="2024-08-14T18:26:40Z" level=info msg="Filtering out non-pending tasks" application=argocd/beep-int-helm-staging syncId=00005-XOlYo tasks="[Sync/0 resource run.cnrm.cloud.google.com/RunService:staging/beep-int-helm obj->obj (,,)]"
time="2024-08-14T18:26:40Z" level=info msg="Filtering tasks in correct phase and wave" application=argocd/beep-int-helm-staging phase=Sync syncFailTasks="[]" syncId=00005-XOlYo tasks="[Sync/0 resource run.cnrm.cloud.google.com/RunService:staging/beep-int-helm obj->obj (,,)]" wave=0
time="2024-08-14T18:26:40Z" level=info msg="Updating operation state. phase: Running -> Running, message: '' -> 'one or more tasks are running'" application=argocd/beep-int-helm-staging syncId=00005-XOlYo
time="2024-08-14T18:26:40Z" level=info msg=Wet-run application=argocd/beep-int-helm-staging syncId=00005-XOlYo tasks="[Sync/0 resource run.cnrm.cloud.google.com/RunService:staging/beep-int-helm obj->obj (,,)]"
time="2024-08-14T18:26:40Z" level=info msg="Running tasks" application=argocd/beep-int-helm-staging dryRun=false numTasks=1 syncId=00005-XOlYo
time="2024-08-14T18:26:40Z" level=info msg=Applying application=argocd/beep-int-helm-staging dryRun=false syncId=00005-XOlYo task="Sync/0 resource run.cnrm.cloud.google.com/RunService:staging/beep-int-helm obj->obj (,,)"
time="2024-08-14T18:26:40Z" level=info msg="Applying resource RunService/beep-int-helm in cluster: https://10.0.32.1:443, namespace: staging" dry-run=none manager=argocd-controller serverSideApply=false serverSideDiff=false
time="2024-08-14T18:26:40Z" level=info msg="{\"apiVersion\":\"run.cnrm.cloud.google.com/v1beta1\",\"kind\":\"RunService\",\"metadata\":{\"labels\":{\"argocd.argoproj.io/instance\":\"beep-int-helm-staging\"},\"name\":\"beep-int-helm\",\"namespace\":\"staging\"},\"spec\":{\"ingress\":\"INGRESS_TRAFFIC_INTERNAL_ONLY\",\"launchStage\":\"GA\",\"location\":\"region-xyz\",\"projectRef\":{\"external\":\"projects/PROJECT_ID\"},\"template\":{\"containers\":[{\"env\":[{\"name\":\"GOOGLE_CLOUD_PROJECT\",\"value\":\"PROJECT_ID\"},{\"name\":\"API_BASE_URL\",\"value\":\"http://10.1.0.32:80\"},{\"name\":\"API_JWT_ENABLED\",\"value\":\"false\"},{\"name\":\"LOG_LEVEL\",\"value\":\"debug\"},{\"name\":\"API_AUTH_PRIVATE_KEY\",\"valueSource\":{\"secretKeyRef\":{\"secretRef\":{\"external\":\"projects/PROJECT_NUMBER/secrets/staging-beep-int\"},\"versionRef\":{\"external\":\"latest\"}}}}],\"image\":\"region-xyz-docker.pkg.dev/PROJECT_ID/boop-repo/beep-int/beep-int:38a09c9\",\"name\":\"beep-int-helm\",\"ports\":[{\"containerPort\":8080,\"name\":\"http1\"}],\"resources\":{\"cpuIdle\":true,\"limits\":{\"cpu\":\"1000m\",\"memory\":\"512Mi\"},\"startupCpuBoost\":true},\"startupProbe\":{\"failureThreshold\":1,\"initialDelaySeconds\":0,\"periodSeconds\":240,\"tcpSocket\":{\"port\":8080},\"timeoutSeconds\":240}}],\"maxInstanceRequestConcurrency\":80,\"scaling\":{\"maxInstanceCount\":100,\"minInstanceCount\":0},\"serviceAccountRef\":{\"external\":\"sa-gcp-acct@PROJECT_ID.iam.gserviceaccount.com\"},\"timeout\":\"3600s\",\"vpcAccess\":{\"egress\":\"PRIVATE_RANGES_ONLY\",\"networkInterfaces\":[{\"networkRef\":{\"external\":\"projects/PROJECT_ID/global/networks/staging\"},\"subnetworkRef\":{\"external\":\"projects/PROJECT_ID/regions/region-xyz/subnetworks/staging-region-xyz\"}}]}},\"traffic\":[{\"percent\":100,\"type\":\"TRAFFIC_TARGET_ALLOCATION_TYPE_LATEST\"}]}}"
time="2024-08-14T18:26:40Z" level=info msg="Adding resource result, status: 'Synced', phase: 'Running', message: 'runservice.run.cnrm.cloud.google.com/beep-int-helm unchanged'" application=argocd/beep-int-helm-staging kind=RunService name=beep-int-helm namespace=staging phase=Sync syncId=00005-XOlYo
time="2024-08-14T18:26:40Z" level=info msg="Updating operation state. phase: Running -> Succeeded, message: 'one or more tasks are running' -> 'successfully synced (all tasks run)'" application=argocd/beep-int-helm-staging syncId=00005-XOlYo
time="2024-08-14T18:26:40Z" level=info msg="sync/terminate complete" application=argocd/beep-int-helm-staging duration=2.424623392s syncId=00005-XOlYo
time="2024-08-14T18:26:40Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:26:40Z" level=debug msg="Skipping sharding distribution update. No relevant changes"
time="2024-08-14T18:26:40Z" level=info msg="Start Update application operation state"
time="2024-08-14T18:26:40Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:26:40Z" level=debug msg="Skipping sharding distribution update. No relevant changes"
time="2024-08-14T18:26:40Z" level=info msg="Completed Update application operation state"
time="2024-08-14T18:26:40Z" level=info msg="updated 'argocd/beep-int-helm-staging' operation (phase: Succeeded)" appNamespace=argocd application=beep-int-helm-staging project=main
time="2024-08-14T18:26:40Z" level=info msg="Sync operation to 076ae2eb6ab12d9fc858537c6f6dc00057d4cca5 succeeded" application=beep-int-helm-staging dest-namespace=staging dest-server="https://kubernetes.default.svc" reason=OperationCompleted type=Normal
time="2024-08-14T18:26:40Z" level=info msg="Refreshing app status (controller refresh requested), level (2)" application=argocd/beep-int-helm-staging
time="2024-08-14T18:26:40Z" level=info msg="Comparing app state (cluster: https://kubernetes.default.svc, namespace: staging)" application=argocd/beep-int-helm-staging
time="2024-08-14T18:26:40Z" level=debug msg="git@github.com:MYDOMAIN/gitops.git has credentials"
time="2024-08-14T18:26:40Z" level=debug msg="Generating Manifest for source {git@github.com:MYDOMAIN/gitops.git hack/apps/beep-int-helm poc &ApplicationSourceHelm{ValueFiles:[values-base.yaml values-staging.yaml],Parameters:[]HelmParameter{},ReleaseName:,Values:,FileParameters:[]HelmFileParameter{},Version:,PassCredentials:false,IgnoreMissingValueFiles:false,SkipCrds:false,ValuesObject:nil,} nil nil nil  } revision poc"
time="2024-08-14T18:26:40Z" level=info msg="GetRepoObjs stats" application=argocd/beep-int-helm-staging build_options_ms=0 helm_ms=0 plugins_ms=0 repo_ms=0 time_ms=24 unmarshal_ms=24 version_ms=0
time="2024-08-14T18:26:40Z" level=debug msg="Retrieved live manifests" application=argocd/beep-int-helm-staging
time="2024-08-14T18:26:40Z" level=debug msg="using diff cache" application=argocd/beep-int-helm-staging useDiffCache=true
time="2024-08-14T18:26:40Z" level=info msg="Normalized app spec: {\"status\":{\"sync\":{\"comparedTo\":{\"destination\":{\"namespace\":\"staging\",\"server\":\"https://kubernetes.default.svc\"},\"source\":{\"helm\":{\"valueFiles\":[\"values-base.yaml\",\"values-staging.yaml\"]},\"path\":\"hack/apps/beep-int-helm\",\"repoURL\":\"git@github.com:MYDOMAIN/gitops.git\",\"targetRevision\":\"poc\"}}}}}" application=argocd/beep-int-helm-staging
time="2024-08-14T18:26:40Z" level=info msg="Skipping auto-sync: application status is Synced" application=argocd/beep-int-helm-staging
time="2024-08-14T18:26:40Z" level=info msg="Update successful" application=argocd/beep-int-helm-staging
time="2024-08-14T18:26:40Z" level=info msg="Reconciliation completed" application=argocd/beep-int-helm-staging dedup_ms=0 dest-name= dest-namespace=staging dest-server="https://kubernetes.default.svc" diff_ms=0 fields.level=2 git_ms=25 health_ms=0 live_ms=0 patch_ms=22 setop_ms=0 settings_ms=0 sync_ms=0 time_ms=78

hello-go-helm-staging == SUCCESS (here, I notice forcestring: true, but the manifest does not say 'force-update: true')

$ cat .argocd-source-hello-go-helm-staging.yaml
helm:
  parameters:
  - name: image.name
    value: region-xyz-docker.pkg.dev/PROJECT_ID/kallen-test/hello-go
    forcestring: true
  - name: image.tag
    value: 1e99e29
    forcestring: true

apiVersion: argoproj.io/v1alpha1
kind: Application
metadata:
  name: hello-go-helm-staging
  namespace: argocd
  annotations:
    argocd-image-updater.argoproj.io/image-list: hello-go=region-xyz-docker.pkg.dev/PROJECT_ID/kallen-test/hello-go
    argocd-image-updater.argoproj.io/hello-go.update-strategy: newest-build
    argocd-image-updater.argoproj.io/hello-go.allow-tags: regexp:^[0-9a-f]{7}$
    argocd-image-updater.argoproj.io/write-back-method: git
  finalizers:
    - resources-finalizer.argocd.argoproj.io
spec:
  project: main
  source:
    repoURL: git@github.com:MYDOMAIN/gitops.git
    targetRevision: poc
    path: hack/apps/hello-go-helm
    helm:
      valueFiles:
        - values-base.yaml
        - values-staging.yaml
  destination:
    server: https://kubernetes.default.svc
    namespace: staging
  syncPolicy:
    automated:
      prune: true
      selfHeal: true
    retry:
      limit: 5
      backoff:
        duration: 5s
        maxDuration: 3m0s
        factor: 2
    syncOptions:
      - CreateNamespace=true

time="2024-08-14T18:39:33Z" level=info msg="Refreshing app status (controller refresh requested), level (0)" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:33Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:33Z" level=debug msg="Requesting app refresh caused by object update" api-version=apps/v1 application=argocd/hello-go-helm-staging cluster-name= fields.level=1 kind=Deployment name=hello-go namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:39:33Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:33Z" level=debug msg="Requesting app refresh caused by object update" api-version=apps/v1 application=argocd/hello-go-helm-staging cluster-name= fields.level=1 kind=Deployment name=hello-go namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:39:33Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:33Z" level=debug msg="Requesting app refresh caused by object update" api-version=apps/v1 application=argocd/hello-go-helm-staging cluster-name= fields.level=0 kind=ReplicaSet name=hello-go-549748d77b namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:39:33Z" level=info msg="Update successful" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:33Z" level=info msg="Reconciliation completed" application=argocd/hello-go-helm-staging dest-name= dest-namespace=staging dest-server="https://kubernetes.default.svc" fields.level=0 patch_ms=87 setop_ms=0 time_ms=96
time="2024-08-14T18:39:33Z" level=info msg="Refreshing app status (controller refresh requested), level (1)" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:33Z" level=info msg="Comparing app state (cluster: https://kubernetes.default.svc, namespace: staging)" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:33Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:33Z" level=debug msg="Requesting app refresh caused by object update" api-version=v1 application=argocd/hello-go-helm-staging cluster-name= fields.level=0 kind=Pod name=hello-go-549748d77b-j4n6p namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:39:33Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:33Z" level=debug msg="Skipping sharding distribution update. No relevant changes"
time="2024-08-14T18:39:33Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:33Z" level=debug msg="Requesting app refresh caused by object update" api-version=v1 application=argocd/hello-go-helm-staging cluster-name= fields.level=0 kind=Pod name=hello-go-549748d77b-j4n6p namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:39:33Z" level=info msg="Start Update application operation state"
time="2024-08-14T18:39:33Z" level=debug msg="git@github.com:MYDOMAIN/gitops.git has credentials"
time="2024-08-14T18:39:33Z" level=debug msg="Generating Manifest for source {git@github.com:MYDOMAIN/gitops.git hack/apps/hello-go-helm poc &ApplicationSourceHelm{ValueFiles:[values-base.yaml values-staging.yaml],Parameters:[]HelmParameter{},ReleaseName:,Values:,FileParameters:[]HelmFileParameter{},Version:,PassCredentials:false,IgnoreMissingValueFiles:false,SkipCrds:false,ValuesObject:nil,} nil nil nil  } revision 53277a91df3851d32bea6ee3c263bececfd3613b"
time="2024-08-14T18:39:33Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:33Z" level=debug msg="Requesting app refresh caused by object update" api-version=apps/v1 application=argocd/hello-go-helm-staging cluster-name= fields.level=1 kind=Deployment name=hello-go namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:39:33Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:33Z" level=debug msg="Requesting app refresh caused by object update" api-version=apps/v1 application=argocd/hello-go-helm-staging cluster-name= fields.level=0 kind=ReplicaSet name=hello-go-549748d77b namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:39:33Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:33Z" level=debug msg="Requesting app refresh caused by object update" api-version=apps/v1 application=argocd/hello-go-helm-staging cluster-name= fields.level=1 kind=Deployment name=hello-go namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:39:33Z" level=info msg="GetRepoObjs stats" application=argocd/hello-go-helm-staging build_options_ms=0 helm_ms=1 plugins_ms=0 repo_ms=0 time_ms=17 unmarshal_ms=15 version_ms=0
time="2024-08-14T18:39:33Z" level=debug msg="Retrieved live manifests" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:33Z" level=debug msg="using diff cache" application=argocd/hello-go-helm-staging useDiffCache=true
time="2024-08-14T18:39:33Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:33Z" level=debug msg="Requesting app refresh caused by object update" api-version=v1 application=argocd/hello-go-helm-staging cluster-name= fields.level=0 kind=Pod name=hello-go-549748d77b-j4n6p namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:39:33Z" level=info msg="Completed Update application operation state"
time="2024-08-14T18:39:33Z" level=info msg="updated 'argocd/hello-go-helm-staging' operation (phase: Succeeded)" appNamespace=argocd application=hello-go-helm-staging project=main
time="2024-08-14T18:39:33Z" level=info msg="Sync operation to 53277a91df3851d32bea6ee3c263bececfd3613b succeeded" application=hello-go-helm-staging dest-namespace=staging dest-server="https://kubernetes.default.svc" reason=OperationCompleted type=Normal
time="2024-08-14T18:39:33Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:33Z" level=debug msg="Skipping sharding distribution update. No relevant changes"
time="2024-08-14T18:39:33Z" level=info msg="Normalized app spec: {\"status\":{\"sync\":{\"comparedTo\":{\"destination\":{\"namespace\":\"staging\",\"server\":\"https://kubernetes.default.svc\"},\"source\":{\"helm\":{\"valueFiles\":[\"values-base.yaml\",\"values-staging.yaml\"]},\"path\":\"hack/apps/hello-go-helm\",\"repoURL\":\"git@github.com:MYDOMAIN/gitops.git\",\"targetRevision\":\"poc\"}}}}}" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:33Z" level=info msg="Skipping auto-sync: another operation is in progress" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:33Z" level=info msg="Updated sync status: OutOfSync -> Synced" application=hello-go-helm-staging dest-namespace=staging dest-server="https://kubernetes.default.svc" reason=ResourceUpdated type=Normal
time="2024-08-14T18:39:33Z" level=info msg="Updated health status: Healthy -> Progressing" application=hello-go-helm-staging dest-namespace=staging dest-server="https://kubernetes.default.svc" reason=ResourceUpdated type=Normal
time="2024-08-14T18:39:33Z" level=info msg="Update successful" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:33Z" level=info msg="Reconciliation completed" application=argocd/hello-go-helm-staging dedup_ms=0 dest-name= dest-namespace=staging dest-server="https://kubernetes.default.svc" diff_ms=81 fields.level=1 git_ms=18 health_ms=1 live_ms=1 patch_ms=24 setop_ms=0 settings_ms=0 sync_ms=0 time_ms=200
time="2024-08-14T18:39:33Z" level=info msg="Refreshing app status (controller refresh requested), level (2)" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:33Z" level=info msg="Comparing app state (cluster: https://kubernetes.default.svc, namespace: staging)" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:33Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:33Z" level=debug msg="Skipping sharding distribution update. No relevant changes"
time="2024-08-14T18:39:33Z" level=debug msg="git@github.com:MYDOMAIN/gitops.git has credentials"
time="2024-08-14T18:39:33Z" level=debug msg="Generating Manifest for source {git@github.com:MYDOMAIN/gitops.git hack/apps/hello-go-helm poc &ApplicationSourceHelm{ValueFiles:[values-base.yaml values-staging.yaml],Parameters:[]HelmParameter{},ReleaseName:,Values:,FileParameters:[]HelmFileParameter{},Version:,PassCredentials:false,IgnoreMissingValueFiles:false,SkipCrds:false,ValuesObject:nil,} nil nil nil  } revision poc"
time="2024-08-14T18:39:33Z" level=info msg="GetRepoObjs stats" application=argocd/hello-go-helm-staging build_options_ms=0 helm_ms=0 plugins_ms=0 repo_ms=0 time_ms=14 unmarshal_ms=14 version_ms=0
time="2024-08-14T18:39:33Z" level=debug msg="Retrieved live manifests" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:33Z" level=debug msg="using diff cache" application=argocd/hello-go-helm-staging useDiffCache=true
time="2024-08-14T18:39:33Z" level=info msg="Normalized app spec: {\"status\":{\"sync\":{\"comparedTo\":{\"destination\":{\"namespace\":\"staging\",\"server\":\"https://kubernetes.default.svc\"},\"source\":{\"helm\":{\"valueFiles\":[\"values-base.yaml\",\"values-staging.yaml\"]},\"path\":\"hack/apps/hello-go-helm\",\"repoURL\":\"git@github.com:MYDOMAIN/gitops.git\",\"targetRevision\":\"poc\"}}}}}" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:33Z" level=info msg="Skipping auto-sync: application status is Synced" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:33Z" level=info msg="Update successful" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:33Z" level=info msg="Reconciliation completed" application=argocd/hello-go-helm-staging dedup_ms=0 dest-name= dest-namespace=staging dest-server="https://kubernetes.default.svc" diff_ms=0 fields.level=2 git_ms=15 health_ms=0 live_ms=0 patch_ms=31 setop_ms=0 settings_ms=0 sync_ms=0 time_ms=79
time="2024-08-14T18:39:33Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:33Z" level=debug msg="Skipping sharding distribution update. No relevant changes"
time="2024-08-14T18:39:33Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:33Z" level=debug msg="Requesting app refresh caused by object update" api-version=cilium.io/v2 application=argocd/hello-go-helm-staging cluster-name= fields.level=0 kind=CiliumEndpoint name=hello-go-549748d77b-j4n6p namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:39:33Z" level=info msg="Refreshing app status (controller refresh requested), level (0)" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:34Z" level=info msg="Update successful" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:34Z" level=info msg="Reconciliation completed" application=argocd/hello-go-helm-staging dest-name= dest-namespace=staging dest-server="https://kubernetes.default.svc" fields.level=0 patch_ms=28 setop_ms=0 time_ms=35
time="2024-08-14T18:39:34Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:34Z" level=debug msg="Requesting app refresh caused by object update" api-version=v1 application=argocd/hello-go-helm-staging cluster-name= fields.level=0 kind=Pod name=hello-go-549748d77b-j4n6p namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:39:34Z" level=info msg="Refreshing app status (controller refresh requested), level (0)" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:35Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:35Z" level=debug msg="Requesting app refresh caused by object update" api-version=discovery.k8s.io/v1 application=argocd/hello-go-helm-staging cluster-name= fields.level=0 kind=EndpointSlice name=hello-go-s5kpr namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:39:35Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:35Z" level=debug msg="Requesting app refresh caused by object update" api-version=apps/v1 application=argocd/hello-go-helm-staging cluster-name= fields.level=0 kind=ReplicaSet name=hello-go-549748d77b namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:39:35Z" level=info msg="Update successful" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:35Z" level=info msg="Reconciliation completed" application=argocd/hello-go-helm-staging dest-name= dest-namespace=staging dest-server="https://kubernetes.default.svc" fields.level=0 patch_ms=27 setop_ms=0 time_ms=34
time="2024-08-14T18:39:35Z" level=info msg="Refreshing app status (controller refresh requested), level (0)" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:35Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:35Z" level=debug msg="Requesting app refresh caused by object update" api-version=apps/v1 application=argocd/hello-go-helm-staging cluster-name= fields.level=0 kind=ReplicaSet name=hello-go-74fbd46fbb namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:39:35Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:35Z" level=debug msg="Requesting app refresh caused by object update" api-version=apps/v1 application=argocd/hello-go-helm-staging cluster-name= fields.level=1 kind=Deployment name=hello-go namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:39:35Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:35Z" level=debug msg="Requesting app refresh caused by object update" api-version=v1 application=argocd/hello-go-helm-staging cluster-name= fields.level=0 kind=Pod name=hello-go-74fbd46fbb-tgsnq namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:39:35Z" level=info msg="Update successful" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:35Z" level=info msg="Reconciliation completed" application=argocd/hello-go-helm-staging dest-name= dest-namespace=staging dest-server="https://kubernetes.default.svc" fields.level=0 patch_ms=34 setop_ms=0 time_ms=40
time="2024-08-14T18:39:35Z" level=info msg="Refreshing app status (controller refresh requested), level (1)" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:35Z" level=info msg="Comparing app state (cluster: https://kubernetes.default.svc, namespace: staging)" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:35Z" level=debug msg="git@github.com:MYDOMAIN/gitops.git has credentials"
time="2024-08-14T18:39:35Z" level=debug msg="Generating Manifest for source {git@github.com:MYDOMAIN/gitops.git hack/apps/hello-go-helm poc &ApplicationSourceHelm{ValueFiles:[values-base.yaml values-staging.yaml],Parameters:[]HelmParameter{},ReleaseName:,Values:,FileParameters:[]HelmFileParameter{},Version:,PassCredentials:false,IgnoreMissingValueFiles:false,SkipCrds:false,ValuesObject:nil,} nil nil nil  } revision 53277a91df3851d32bea6ee3c263bececfd3613b"
time="2024-08-14T18:39:35Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:35Z" level=debug msg="Requesting app refresh caused by object update" api-version=discovery.k8s.io/v1 application=argocd/hello-go-helm-staging cluster-name= fields.level=0 kind=EndpointSlice name=hello-go-s5kpr namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:39:35Z" level=info msg="GetRepoObjs stats" application=argocd/hello-go-helm-staging build_options_ms=0 helm_ms=0 plugins_ms=0 repo_ms=0 time_ms=14 unmarshal_ms=13 version_ms=0
time="2024-08-14T18:39:35Z" level=debug msg="Retrieved live manifests" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:35Z" level=debug msg="using diff cache" application=argocd/hello-go-helm-staging useDiffCache=true
time="2024-08-14T18:39:35Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:35Z" level=debug msg="Requesting app refresh caused by object update" api-version=apps/v1 application=argocd/hello-go-helm-staging cluster-name= fields.level=0 kind=ReplicaSet name=hello-go-74fbd46fbb namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:39:35Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:35Z" level=debug msg="Requesting app refresh caused by object update" api-version=apps/v1 application=argocd/hello-go-helm-staging cluster-name= fields.level=0 kind=ReplicaSet name=hello-go-549748d77b namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:39:35Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:35Z" level=debug msg="Requesting app refresh caused by object update" api-version=apps/v1 application=argocd/hello-go-helm-staging cluster-name= fields.level=0 kind=ReplicaSet name=hello-go-74fbd46fbb namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:39:35Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:35Z" level=debug msg="Requesting app refresh caused by object update" api-version=apps/v1 application=argocd/hello-go-helm-staging cluster-name= fields.level=1 kind=Deployment name=hello-go namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:39:35Z" level=info msg="Normalized app spec: {\"status\":{\"sync\":{\"comparedTo\":{\"destination\":{\"namespace\":\"staging\",\"server\":\"https://kubernetes.default.svc\"},\"source\":{\"helm\":{\"valueFiles\":[\"values-base.yaml\",\"values-staging.yaml\"]},\"path\":\"hack/apps/hello-go-helm\",\"repoURL\":\"git@github.com:MYDOMAIN/gitops.git\",\"targetRevision\":\"poc\"}}}}}" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:35Z" level=info msg="Skipping auto-sync: application status is Synced" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:35Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:35Z" level=debug msg="Requesting app refresh caused by object update" api-version=v1 application=argocd/hello-go-helm-staging cluster-name= fields.level=0 kind=Pod name=hello-go-549748d77b-h7sg7 namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:39:35Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:35Z" level=debug msg="Requesting app refresh caused by object update" api-version=apps/v1 application=argocd/hello-go-helm-staging cluster-name= fields.level=0 kind=ReplicaSet name=hello-go-549748d77b namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:39:35Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:35Z" level=debug msg="Requesting app refresh caused by object update" api-version=v1 application=argocd/hello-go-helm-staging cluster-name= fields.level=0 kind=Pod name=hello-go-549748d77b-h7sg7 namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:39:35Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:35Z" level=debug msg="Requesting app refresh caused by object update" api-version=apps/v1 application=argocd/hello-go-helm-staging cluster-name= fields.level=0 kind=ReplicaSet name=hello-go-549748d77b namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:39:35Z" level=info msg="Update successful" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:35Z" level=info msg="Reconciliation completed" application=argocd/hello-go-helm-staging dedup_ms=0 dest-name= dest-namespace=staging dest-server="https://kubernetes.default.svc" diff_ms=8 fields.level=1 git_ms=14 health_ms=0 live_ms=1 patch_ms=54 setop_ms=0 settings_ms=0 sync_ms=0 time_ms=174
time="2024-08-14T18:39:35Z" level=info msg="Refreshing app status (controller refresh requested), level (1)" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:35Z" level=info msg="Comparing app state (cluster: https://kubernetes.default.svc, namespace: staging)" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:35Z" level=debug msg="git@github.com:MYDOMAIN/gitops.git has credentials"
time="2024-08-14T18:39:35Z" level=debug msg="Generating Manifest for source {git@github.com:MYDOMAIN/gitops.git hack/apps/hello-go-helm poc &ApplicationSourceHelm{ValueFiles:[values-base.yaml values-staging.yaml],Parameters:[]HelmParameter{},ReleaseName:,Values:,FileParameters:[]HelmFileParameter{},Version:,PassCredentials:false,IgnoreMissingValueFiles:false,SkipCrds:false,ValuesObject:nil,} nil nil nil  } revision 53277a91df3851d32bea6ee3c263bececfd3613b"
time="2024-08-14T18:39:35Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:35Z" level=debug msg="Requesting app refresh caused by object update" api-version=apps/v1 application=argocd/hello-go-helm-staging cluster-name= fields.level=1 kind=Deployment name=hello-go namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:39:35Z" level=info msg="GetRepoObjs stats" application=argocd/hello-go-helm-staging build_options_ms=0 helm_ms=0 plugins_ms=0 repo_ms=0 time_ms=13 unmarshal_ms=12 version_ms=0
time="2024-08-14T18:39:35Z" level=debug msg="Retrieved live manifests" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:35Z" level=debug msg="using diff cache" application=argocd/hello-go-helm-staging useDiffCache=true
time="2024-08-14T18:39:35Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:35Z" level=debug msg="Requesting app refresh caused by object update" api-version=v1 application=argocd/hello-go-helm-staging cluster-name= fields.level=0 kind=Pod name=hello-go-549748d77b-h7sg7 namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:39:35Z" level=info msg="Normalized app spec: {\"status\":{\"sync\":{\"comparedTo\":{\"destination\":{\"namespace\":\"staging\",\"server\":\"https://kubernetes.default.svc\"},\"source\":{\"helm\":{\"valueFiles\":[\"values-base.yaml\",\"values-staging.yaml\"]},\"path\":\"hack/apps/hello-go-helm\",\"repoURL\":\"git@github.com:MYDOMAIN/gitops.git\",\"targetRevision\":\"poc\"}}}}}" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:35Z" level=info msg="Skipping auto-sync: application status is Synced" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:35Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:35Z" level=debug msg="Requesting app refresh caused by object update" api-version=cilium.io/v2 application=argocd/hello-go-helm-staging cluster-name= fields.level=0 kind=CiliumEndpoint name=hello-go-74fbd46fbb-tgsnq namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:39:35Z" level=info msg="Update successful" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:35Z" level=info msg="Reconciliation completed" application=argocd/hello-go-helm-staging dedup_ms=0 dest-name= dest-namespace=staging dest-server="https://kubernetes.default.svc" diff_ms=7 fields.level=1 git_ms=14 health_ms=0 live_ms=0 patch_ms=33 setop_ms=0 settings_ms=0 sync_ms=0 time_ms=88
time="2024-08-14T18:39:35Z" level=info msg="Refreshing app status (controller refresh requested), level (1)" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:35Z" level=info msg="Comparing app state (cluster: https://kubernetes.default.svc, namespace: staging)" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:35Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:35Z" level=debug msg="Skipping sharding distribution update. No relevant changes"
time="2024-08-14T18:39:35Z" level=debug msg="git@github.com:MYDOMAIN/gitops.git has credentials"
time="2024-08-14T18:39:35Z" level=debug msg="Generating Manifest for source {git@github.com:MYDOMAIN/gitops.git hack/apps/hello-go-helm poc &ApplicationSourceHelm{ValueFiles:[values-base.yaml values-staging.yaml],Parameters:[]HelmParameter{},ReleaseName:,Values:,FileParameters:[]HelmFileParameter{},Version:,PassCredentials:false,IgnoreMissingValueFiles:false,SkipCrds:false,ValuesObject:nil,} nil nil nil  } revision 53277a91df3851d32bea6ee3c263bececfd3613b"
time="2024-08-14T18:39:35Z" level=info msg="GetRepoObjs stats" application=argocd/hello-go-helm-staging build_options_ms=0 helm_ms=0 plugins_ms=0 repo_ms=0 time_ms=22 unmarshal_ms=21 version_ms=0
time="2024-08-14T18:39:35Z" level=debug msg="Retrieved live manifests" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:35Z" level=debug msg="using diff cache" application=argocd/hello-go-helm-staging useDiffCache=true
time="2024-08-14T18:39:35Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:35Z" level=debug msg="Requesting app refresh caused by object update" api-version=v1 application=argocd/hello-go-helm-staging cluster-name= fields.level=0 kind=Pod name=hello-go-74fbd46fbb-tgsnq namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:39:35Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:35Z" level=debug msg="Requesting app refresh caused by object update" api-version=discovery.k8s.io/v1 application=argocd/hello-go-helm-staging cluster-name= fields.level=0 kind=EndpointSlice name=hello-go-s5kpr namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:39:35Z" level=info msg="Normalized app spec: {\"status\":{\"sync\":{\"comparedTo\":{\"destination\":{\"namespace\":\"staging\",\"server\":\"https://kubernetes.default.svc\"},\"source\":{\"helm\":{\"valueFiles\":[\"values-base.yaml\",\"values-staging.yaml\"]},\"path\":\"hack/apps/hello-go-helm\",\"repoURL\":\"git@github.com:MYDOMAIN/gitops.git\",\"targetRevision\":\"poc\"}}}}}" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:35Z" level=info msg="Skipping auto-sync: application status is Synced" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:35Z" level=info msg="Update successful" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:35Z" level=info msg="Reconciliation completed" application=argocd/hello-go-helm-staging dedup_ms=0 dest-name= dest-namespace=staging dest-server="https://kubernetes.default.svc" diff_ms=0 fields.level=1 git_ms=23 health_ms=0 live_ms=0 patch_ms=25 setop_ms=0 settings_ms=0 sync_ms=0 time_ms=92
time="2024-08-14T18:39:35Z" level=info msg="Refreshing app status (controller refresh requested), level (0)" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:35Z" level=info msg="Update successful" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:35Z" level=info msg="Reconciliation completed" application=argocd/hello-go-helm-staging dest-name= dest-namespace=staging dest-server="https://kubernetes.default.svc" fields.level=0 patch_ms=20 setop_ms=0 time_ms=27
time="2024-08-14T18:39:35Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:35Z" level=debug msg="Requesting app refresh caused by object update" api-version=cilium.io/v2 application=argocd/hello-go-helm-staging cluster-name= fields.level=0 kind=CiliumEndpoint name=hello-go-549748d77b-h7sg7 namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:39:35Z" level=info msg="Refreshing app status (controller refresh requested), level (0)" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:35Z" level=info msg="Update successful" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:35Z" level=info msg="Reconciliation completed" application=argocd/hello-go-helm-staging dest-name= dest-namespace=staging dest-server="https://kubernetes.default.svc" fields.level=0 patch_ms=25 setop_ms=0 time_ms=32
time="2024-08-14T18:39:35Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:35Z" level=debug msg="Requesting app refresh caused by object update" api-version=v1 application=argocd/hello-go-helm-staging cluster-name= fields.level=0 kind=Pod name=hello-go-74fbd46fbb-tgsnq namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:39:35Z" level=info msg="Refreshing app status (controller refresh requested), level (0)" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:36Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:36Z" level=debug msg="Requesting app refresh caused by object update" api-version=v1 application=argocd/hello-go-helm-staging cluster-name= fields.level=0 kind=Pod name=hello-go-74fbd46fbb-tgsnq namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:39:36Z" level=info msg="Update successful" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:36Z" level=info msg="Reconciliation completed" application=argocd/hello-go-helm-staging dest-name= dest-namespace=staging dest-server="https://kubernetes.default.svc" fields.level=0 patch_ms=38 setop_ms=0 time_ms=44
time="2024-08-14T18:39:36Z" level=info msg="Refreshing app status (controller refresh requested), level (0)" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:36Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:36Z" level=debug msg="Requesting app refresh caused by object update" api-version=v1 application=argocd/hello-go-helm-staging cluster-name= fields.level=0 kind=Pod name=hello-go-74fbd46fbb-tgsnq namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:39:36Z" level=info msg="Update successful" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:36Z" level=info msg="Reconciliation completed" application=argocd/hello-go-helm-staging dest-name= dest-namespace=staging dest-server="https://kubernetes.default.svc" fields.level=0 patch_ms=34 setop_ms=0 time_ms=41
time="2024-08-14T18:39:36Z" level=info msg="Refreshing app status (controller refresh requested), level (0)" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:36Z" level=info msg="Update successful" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:36Z" level=info msg="Reconciliation completed" application=argocd/hello-go-helm-staging dest-name= dest-namespace=staging dest-server="https://kubernetes.default.svc" fields.level=0 patch_ms=33 setop_ms=0 time_ms=40
time="2024-08-14T18:39:36Z" level=info msg="Failed to watch CustomResourceDefinition.apiextensions.k8s.io on https://10.0.32.1:443: Resyncing CustomResourceDefinition.apiextensions.k8s.io on https://10.0.32.1:443 due to timeout, retrying in 1s" server="https://kubernetes.default.svc"
time="2024-08-14T18:39:36Z" level=info msg="Start watch CustomResourceDefinition.apiextensions.k8s.io on https://10.0.32.1:443" server="https://kubernetes.default.svc"
time="2024-08-14T18:39:37Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:37Z" level=debug msg="Requesting app refresh caused by object update" api-version=v1 application=argocd/hello-go-helm-staging cluster-name= fields.level=0 kind=Pod name=hello-go-549748d77b-h7sg7 namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:39:37Z" level=info msg="Refreshing app status (controller refresh requested), level (0)" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:37Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:37Z" level=debug msg="Requesting app refresh caused by object update" api-version=discovery.k8s.io/v1 application=argocd/hello-go-helm-staging cluster-name= fields.level=0 kind=EndpointSlice name=hello-go-s5kpr namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:39:37Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:37Z" level=debug msg="Requesting app refresh caused by object update" api-version=apps/v1 application=argocd/hello-go-helm-staging cluster-name= fields.level=0 kind=ReplicaSet name=hello-go-549748d77b namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:39:37Z" level=info msg="Update successful" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:37Z" level=info msg="Reconciliation completed" application=argocd/hello-go-helm-staging dest-name= dest-namespace=staging dest-server="https://kubernetes.default.svc" fields.level=0 patch_ms=25 setop_ms=0 time_ms=32
time="2024-08-14T18:39:37Z" level=info msg="Refreshing app status (controller refresh requested), level (0)" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:37Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:37Z" level=debug msg="Requesting app refresh caused by object update" api-version=apps/v1 application=argocd/hello-go-helm-staging cluster-name= fields.level=0 kind=ReplicaSet name=hello-go-74fbd46fbb namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:39:37Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:37Z" level=debug msg="Requesting app refresh caused by object update" api-version=apps/v1 application=argocd/hello-go-helm-staging cluster-name= fields.level=1 kind=Deployment name=hello-go namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:39:37Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:37Z" level=debug msg="Requesting app refresh caused by object update" api-version=v1 application=argocd/hello-go-helm-staging cluster-name= fields.level=0 kind=Pod name=hello-go-74fbd46fbb-jhbzc namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:39:37Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:37Z" level=debug msg="Requesting app refresh caused by object update" api-version=discovery.k8s.io/v1 application=argocd/hello-go-helm-staging cluster-name= fields.level=0 kind=EndpointSlice name=hello-go-s5kpr namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:39:37Z" level=info msg="Update successful" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:37Z" level=info msg="Reconciliation completed" application=argocd/hello-go-helm-staging dest-name= dest-namespace=staging dest-server="https://kubernetes.default.svc" fields.level=0 patch_ms=62 setop_ms=0 time_ms=68
time="2024-08-14T18:39:37Z" level=info msg="Refreshing app status (controller refresh requested), level (1)" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:37Z" level=info msg="Comparing app state (cluster: https://kubernetes.default.svc, namespace: staging)" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:37Z" level=debug msg="git@github.com:MYDOMAIN/gitops.git has credentials"
time="2024-08-14T18:39:37Z" level=debug msg="Generating Manifest for source {git@github.com:MYDOMAIN/gitops.git hack/apps/hello-go-helm poc &ApplicationSourceHelm{ValueFiles:[values-base.yaml values-staging.yaml],Parameters:[]HelmParameter{},ReleaseName:,Values:,FileParameters:[]HelmFileParameter{},Version:,PassCredentials:false,IgnoreMissingValueFiles:false,SkipCrds:false,ValuesObject:nil,} nil nil nil  } revision 53277a91df3851d32bea6ee3c263bececfd3613b"
time="2024-08-14T18:39:37Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:37Z" level=debug msg="Requesting app refresh caused by object update" api-version=apps/v1 application=argocd/hello-go-helm-staging cluster-name= fields.level=0 kind=ReplicaSet name=hello-go-74fbd46fbb namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:39:37Z" level=info msg="GetRepoObjs stats" application=argocd/hello-go-helm-staging build_options_ms=0 helm_ms=0 plugins_ms=0 repo_ms=0 time_ms=15 unmarshal_ms=13 version_ms=0
time="2024-08-14T18:39:37Z" level=debug msg="Retrieved live manifests" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:37Z" level=debug msg="using diff cache" application=argocd/hello-go-helm-staging useDiffCache=true
time="2024-08-14T18:39:37Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:37Z" level=debug msg="Requesting app refresh caused by object update" api-version=apps/v1 application=argocd/hello-go-helm-staging cluster-name= fields.level=0 kind=ReplicaSet name=hello-go-74fbd46fbb namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:39:37Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:37Z" level=debug msg="Requesting app refresh caused by object update" api-version=apps/v1 application=argocd/hello-go-helm-staging cluster-name= fields.level=1 kind=Deployment name=hello-go namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:39:37Z" level=info msg="Normalized app spec: {\"status\":{\"sync\":{\"comparedTo\":{\"destination\":{\"namespace\":\"staging\",\"server\":\"https://kubernetes.default.svc\"},\"source\":{\"helm\":{\"valueFiles\":[\"values-base.yaml\",\"values-staging.yaml\"]},\"path\":\"hack/apps/hello-go-helm\",\"repoURL\":\"git@github.com:MYDOMAIN/gitops.git\",\"targetRevision\":\"poc\"}}}}}" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:37Z" level=info msg="Skipping auto-sync: application status is Synced" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:37Z" level=info msg="Update successful" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:37Z" level=info msg="Reconciliation completed" application=argocd/hello-go-helm-staging dedup_ms=0 dest-name= dest-namespace=staging dest-server="https://kubernetes.default.svc" diff_ms=7 fields.level=1 git_ms=15 health_ms=0 live_ms=1 patch_ms=36 setop_ms=0 settings_ms=0 sync_ms=0 time_ms=111
time="2024-08-14T18:39:37Z" level=info msg="Refreshing app status (controller refresh requested), level (1)" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:37Z" level=info msg="Comparing app state (cluster: https://kubernetes.default.svc, namespace: staging)" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:37Z" level=debug msg="git@github.com:MYDOMAIN/gitops.git has credentials"
time="2024-08-14T18:39:37Z" level=debug msg="Generating Manifest for source {git@github.com:MYDOMAIN/gitops.git hack/apps/hello-go-helm poc &ApplicationSourceHelm{ValueFiles:[values-base.yaml values-staging.yaml],Parameters:[]HelmParameter{},ReleaseName:,Values:,FileParameters:[]HelmFileParameter{},Version:,PassCredentials:false,IgnoreMissingValueFiles:false,SkipCrds:false,ValuesObject:nil,} nil nil nil  } revision 53277a91df3851d32bea6ee3c263bececfd3613b"
time="2024-08-14T18:39:37Z" level=info msg="GetRepoObjs stats" application=argocd/hello-go-helm-staging build_options_ms=0 helm_ms=0 plugins_ms=0 repo_ms=0 time_ms=14 unmarshal_ms=14 version_ms=0
time="2024-08-14T18:39:37Z" level=debug msg="Retrieved live manifests" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:37Z" level=debug msg="using diff cache" application=argocd/hello-go-helm-staging useDiffCache=true
time="2024-08-14T18:39:37Z" level=info msg="Normalized app spec: {\"status\":{\"sync\":{\"comparedTo\":{\"destination\":{\"namespace\":\"staging\",\"server\":\"https://kubernetes.default.svc\"},\"source\":{\"helm\":{\"valueFiles\":[\"values-base.yaml\",\"values-staging.yaml\"]},\"path\":\"hack/apps/hello-go-helm\",\"repoURL\":\"git@github.com:MYDOMAIN/gitops.git\",\"targetRevision\":\"poc\"}}}}}" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:37Z" level=info msg="Skipping auto-sync: application status is Synced" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:37Z" level=info msg="Updated health status: Progressing -> Healthy" application=hello-go-helm-staging dest-namespace=staging dest-server="https://kubernetes.default.svc" reason=ResourceUpdated type=Normal
time="2024-08-14T18:39:37Z" level=info msg="Update successful" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:37Z" level=info msg="Reconciliation completed" application=argocd/hello-go-helm-staging dedup_ms=0 dest-name= dest-namespace=staging dest-server="https://kubernetes.default.svc" diff_ms=6 fields.level=1 git_ms=15 health_ms=0 live_ms=1 patch_ms=24 setop_ms=0 settings_ms=0 sync_ms=0 time_ms=91
time="2024-08-14T18:39:37Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:37Z" level=debug msg="Skipping sharding distribution update. No relevant changes"
time="2024-08-14T18:39:37Z" level=debug msg="Checking if cluster https://kubernetes.default.svc with clusterShard 0 should be processed by shard 0"
time="2024-08-14T18:39:37Z" level=debug msg="Requesting app refresh caused by object update" api-version=cilium.io/v2 application=argocd/hello-go-helm-staging cluster-name= fields.level=0 kind=CiliumEndpoint name=hello-go-74fbd46fbb-jhbzc namespace=staging server="https://kubernetes.default.svc"
time="2024-08-14T18:39:37Z" level=info msg="Refreshing app status (controller refresh requested), level (0)" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:37Z" level=info msg="Update successful" application=argocd/hello-go-helm-staging
time="2024-08-14T18:39:37Z" level=info msg="Reconciliation completed" application=argocd/hello-go-helm-staging dest-name= dest-namespace=staging dest-server="https://kubernetes.default.svc" fields.level=0 patch_ms=29 setop_ms=0 time_ms=35
chengfang commented 2 weeks ago

Have you tried using write-back-target: helmvalues annotation (https://argocd-image-updater.readthedocs.io/en/latest/basics/update-methods/#git-write-back-target)? Does that make any difference?

Also you may want to try v0.14.0, which contains some bug fixes compared to your version v0.13.1

kallentrustle commented 1 week ago

@chengfang thanks for the suggestion. I will try to return to this work to try out your suggestion. I'll report back my result when I do.