argoproj / argo-cd

Declarative Continuous Deployment for Kubernetes
https://argo-cd.readthedocs.io
Apache License 2.0
18.04k stars 5.51k forks source link

ApplicationSet generated Application takes over all resources managed by ArgoCD, and then deleted #20440

Open AmitBenAmi opened 1 month ago

AmitBenAmi commented 1 month ago

Checklist:

Describe the bug

I have an ArgoCD ApplicationSet that uses git generators to generate applications. The design is:

flowchart LR;
    A[root parent app] --> |ApplicationSet| B;
    B[second level parent app] --> |ApplicationSet| C;
    C[application];

The root parent app uses git generator to find directories and based on them, create the second level parent app. The second level parent app uses git generator to find *.yaml files in that said directory and create applications based on these yaml files.

After some time, for no apparent reason, one of the second level parent app is being deleted and causes issues on the cluster:

  1. All of the resources that were deployed by ArgoCD (from other applications) are suddenly deleted (including namespaces)
  2. The application itself is deleted
  3. Other applications in the second level parent app hierarchy are fine

The main problem is that it leaves my cluster in a fatal state of not working (monitoring applications are deleted, essential workloads are deleted, ArgoCD itself is deleted because it manages itself, etc...).

I suspect it takes over because the app.kubernetes.io/instance label on some namespaces that are terminating has the value of the application that was deleted.

I didn't find a direct root cause or the specific issue, but I did see an error of that said app (before being deleted) that states a git message like:

Unable to load data: Failed to checkout revision <commit-sha>: 
git fetch origin <commit-sha> --tags --force failed exit status 128: fatal: remote error: upload-pack: not our ref <commit-sha>

That specific Commit Hash is from a different repo, that isn't being referenced in this application at all. While I see that message pops up occasionally, I do not see that application being deleted live, but only finds out about it when the cluster is in a fatal state already.

To Reproduce

Not sure how to reproduce, since it is a regular ApplicationSet with git generator for directories.

Expected behavior

  1. The application isn't deleted
  2. All of the other resources in ArgoCD (such as namespaces) aren't deleted

Screenshots

Version

Paste the output from `argocd version` here.

v2.6.6

Logs

Paste any relevant application logs here.

Can't find the logs because the ArgoCD applicationset controller and all other pods were deleted, and unfortunately this cluster isn't set with persistent log archiving.

I do have some other logs:

time="2024-10-17T20:23:31Z" level=info msg="Sync operation to  failed: ComparisonError: Failed to load target state: failed to generate manifest for source 1 of 1: rpc error: code = Unknown desc = failed to initialize repository resources: rpc error: code = Internal desc = Failed to checkout revision 0812f4554deff27bd91179a9713956708d5a6750: `git fetch origin 0812f4554deff27bd91179a9713956708d5a6750 --tags --force --prune` failed exit status 128: fatal: remote error: upload-pack: not our ref 0812f4554deff27bd91179a9713956708d5a6750 (retried 5 times)." application=second-level-parent-app dest-namespace=argocd dest-server="https://kubernetes.default.svc" reason=OperationCompleted spec="{&ApplicationSource{RepoURL:https://github.com/org/repo.git,Path:config/gitops/argocd/runners-applications,TargetRevision:HEAD,Helm:&ApplicationSourceHelm{ValueFiles:[],Parameters:[]HelmParameter{},ReleaseName:,Values:runnersClusterPath: path\nrevision: 0.9.3\nparentAppDirectory: path\nautoSync: true\n,FileParameters:[]HelmFileParameter{},Version:,PassCredentials:false,IgnoreMissingValueFiles:false,SkipCrds:false,ValuesObject:nil,},Kustomize:nil,Directory:nil,Plugin:nil,Chart:,Ref:,} {https://kubernetes.default.svc argocd  false} application &SyncPolicy{Automated:&SyncPolicyAutomated{Prune:true,SelfHeal:true,AllowEmpty:true,},SyncOptions:[Validate=true CreateNamespace=false ApplyOutOfSyncOnly=true PrunePropagationPolicy=foreground RespectIgnoreDifferences=true],Retry:nil,ManagedNamespaceMetadata:nil,} [] [] <nil> []}" type=Warning

Edit:

Adding the log record that shows that this application is taking over all of the resources managed by ArgoCD

time="2024-10-17T21:50:47Z" level=info msg="Normalized app spec: {\"status\":{\"conditions\":[{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"APIService/v1beta1.metrics.k8s.io is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Application/github-runners-parent is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Certificate/argocd-gh-runners-npr-use1-cert is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Certificate/prometheus-tls is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRole/appadmin is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRole/appadmin-super is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRole/argocd-application-controller is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRole/argocd-applicationset-controller is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRole/argocd-image-updater is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRole/argocd-server is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRole/cert-manager-cainjector is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRole/cert-manager-controller-approve:cert-manager-io is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRole/cert-manager-controller-certificates is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRole/cert-manager-controller-certificatesigningrequests is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRole/cert-manager-controller-challenges is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRole/cert-manager-controller-clusterissuers is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRole/cert-manager-controller-ingress-shim is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRole/cert-manager-controller-issuers is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRole/cert-manager-controller-orders is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRole/cert-manager-edit is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRole/cert-manager-view is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRole/cert-manager-webhook:subjectaccessreviews is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRole/cluster-autoscaler is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRole/external-dns is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRole/filebeat is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRole/kube-state-metrics is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRole/metricbeat is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRole/node-termination-handler is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRole/primary-ingress-nginx is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRole/primary-ingress-nginx-admission is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRole/prometheus is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRole/prometheus-adapter is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRole/prometheus-adapter-resource-reader is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRole/prometheus-adapter-server-resources is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRole/resource-metrics-server-resources is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRole/system:aggregated-metrics-reader is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRoleBinding/appadmin is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRoleBinding/appadmin-super is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRoleBinding/argocd-application-controller is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRoleBinding/argocd-applicationset-controller is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRoleBinding/argocd-image-updater is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRoleBinding/argocd-server is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRoleBinding/cert-manager-cainjector is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRoleBinding/cert-manager-controller-approve:cert-manager-io is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRoleBinding/cert-manager-controller-certificates is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRoleBinding/cert-manager-controller-certificatesigningrequests is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRoleBinding/cert-manager-controller-challenges is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRoleBinding/cert-manager-controller-clusterissuers is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRoleBinding/cert-manager-controller-ingress-shim is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRoleBinding/cert-manager-controller-issuers is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRoleBinding/cert-manager-controller-orders is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRoleBinding/cert-manager-webhook:subjectaccessreviews is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRoleBinding/cluster-autoscaler is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRoleBinding/external-dns-viewer is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRoleBinding/filebeat is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRoleBinding/hpa-controller-custom-metrics is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRoleBinding/kube-state-metrics is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRoleBinding/metricbeat is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRoleBinding/node-termination-handler is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRoleBinding/primary-ingress-nginx is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRoleBinding/primary-ingress-nginx-admission is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRoleBinding/prometheus is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRoleBinding/prometheus-adapter is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRoleBinding/prometheus-adapter-hpa-controller is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRoleBinding/prometheus-adapter-resource-reader is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ClusterRoleBinding/resource-metrics:system:auth-delegator is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ConfigMap/adapter-config is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ConfigMap/argocd-cm is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ConfigMap/argocd-cmd-params-cm is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ConfigMap/argocd-gpg-keys-cm is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ConfigMap/argocd-image-updater-config is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ConfigMap/argocd-image-updater-ssh-config is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ConfigMap/argocd-notifications-cm is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ConfigMap/argocd-rbac-cm is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ConfigMap/argocd-ssh-known-hosts-cm is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ConfigMap/argocd-tls-certs-cm is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ConfigMap/cert-manager-webhook is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ConfigMap/filebeat-config is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ConfigMap/filebeat-inputs is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ConfigMap/metricbeat-daemonset-config is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ConfigMap/metricbeat-daemonset-modules is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ConfigMap/metricbeat-deployment-config is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ConfigMap/metricbeat-deployment-modules is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ConfigMap/primary-ingress-nginx-controller is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ConfigMap/prometheus-server-conf is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"DaemonSet/filebeat is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"DaemonSet/metricbeat is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"DaemonSet/node-termination-handler is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Deployment/argocd-applicationset-controller is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Deployment/argocd-dex-server is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Deployment/argocd-image-updater is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Deployment/argocd-notifications-controller is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Deployment/argocd-redis is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Deployment/argocd-repo-server is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Deployment/argocd-server is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Deployment/cert-manager is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Deployment/cert-manager-cainjector is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Deployment/cert-manager-webhook is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Deployment/cluster-autoscaler is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Deployment/external-dns is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Deployment/metricbeat is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Deployment/primary-ingress-nginx-controller is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Deployment/prometheus-adapter is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Deployment/prometheus-deployment is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Ingress/argocd-server is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Ingress/prometheus-ingress is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"IngressClass/primary-ingress-nginx-class is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Job/primary-ingress-nginx-admission-create is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Job/primary-ingress-nginx-admission-patch is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"MutatingWebhookConfiguration/cert-manager-webhook is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Namespace/argocd is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Namespace/cert-manager is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Namespace/monitoring is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"NetworkPolicy/argocd-application-controller-network-policy is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"NetworkPolicy/argocd-applicationset-controller-network-policy is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"NetworkPolicy/argocd-dex-server-network-policy is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"NetworkPolicy/argocd-notifications-controller-network-policy is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"NetworkPolicy/argocd-redis-network-policy is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"NetworkPolicy/argocd-repo-server-network-policy is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"NetworkPolicy/argocd-server-network-policy is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"NetworkPolicy/prometheus-adapter is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"PodDisruptionBudget/prometheus-adapter is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"PriorityClass/monitoring is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Role/argocd-application-controller is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Role/argocd-applicationset-controller is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Role/argocd-dex-server is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Role/argocd-image-updater is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Role/argocd-notifications-controller is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Role/argocd-redis is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Role/argocd-server is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Role/cert-manager-cainjector:leaderelection is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Role/cert-manager-webhook:dynamic-serving is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Role/cert-manager:leaderelection is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Role/cluster-autoscaler is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Role/kube-state-metrics is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Role/primary-ingress-nginx is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Role/primary-ingress-nginx-admission is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"RoleBinding/argocd-application-controller is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"RoleBinding/argocd-applicationset-controller is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"RoleBinding/argocd-dex-server is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"RoleBinding/argocd-image-updater is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"RoleBinding/argocd-notifications-controller is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"RoleBinding/argocd-redis is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"RoleBinding/argocd-server is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"RoleBinding/cert-manager-cainjector:leaderelection is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"RoleBinding/cert-manager-webhook:dynamic-serving is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"RoleBinding/cert-manager:leaderelection is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"RoleBinding/cluster-autoscaler is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"RoleBinding/kube-state-metrics is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"RoleBinding/primary-ingress-nginx is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"RoleBinding/primary-ingress-nginx-admission is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Secret/argocd-image-updater-secret is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Secret/argocd-notifications-secret is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Secret/argocd-secret is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Service/argocd-applicationset-controller is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Service/argocd-dex-server is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Service/argocd-metrics is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Service/argocd-notifications-controller-metrics is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Service/argocd-redis is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Service/argocd-repo-server is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Service/argocd-server is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Service/argocd-server-metrics is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Service/cert-manager is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Service/cert-manager-webhook is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Service/kube-state-metrics is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Service/primary-ingress-nginx-controller is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Service/primary-ingress-nginx-controller-admission is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Service/prometheus-adapter is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"Service/prometheus-service is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ServiceAccount/argocd-application-controller is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ServiceAccount/argocd-applicationset-controller is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ServiceAccount/argocd-dex-server is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ServiceAccount/argocd-image-updater is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ServiceAccount/argocd-notifications-controller is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ServiceAccount/argocd-redis is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ServiceAccount/argocd-repo-server is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ServiceAccount/argocd-server is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ServiceAccount/cert-manager is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ServiceAccount/cert-manager-cainjector is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ServiceAccount/cert-manager-webhook is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ServiceAccount/filebeat is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ServiceAccount/kube-state-metrics is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ServiceAccount/metricbeat is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ServiceAccount/primary-ingress-nginx is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ServiceAccount/primary-ingress-nginx-admission is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ServiceAccount/prometheus-adapter is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"StatefulSet/argocd-application-controller is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"StatefulSet/kube-state-metrics is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ValidatingWebhookConfiguration/cert-manager-webhook is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"},{\"lastTransitionTime\":\"2024-10-17T21:50:46Z\",\"message\":\"ValidatingWebhookConfiguration/primary-ingress-nginx-admission is part of applications argocd/second-level-app-parent and kbp-base\",\"type\":\"SharedResourceWarning\"}],\"sync\":{\"comparedTo\":{\"destination\":{\"namespace\":\"argocd\",\"server\":\"https://kubernetes.default.svc\"},\"source\":{\"helm\":{\"values\":\"runnersClusterPath: github-runners-nonprod-ue1\\nrunnersRSSVersion: 0.9.3\\nparentAppDirectory: sbx-runners\\nautoSync: true\\n\"},\"kustomize\":{\"images\":[\"docker.elastic.co/beats/filebeat:8.8.2\",\"docker.elastic.co/beats/metricbeat:8.8.2\"]},\"path\":\"config/gitops/argocd/runners-applications\",\"repoURL\":\"https://github.com/org/repo.git\",\"targetRevision\":\"HEAD\"}}}}}" application=argocd/second-level-app-parent

Adding other record that shows that the application-controller updates the SyncStatus with a different repo (the logs shows repo-1 with its respective path, while the Application is configured with repo-2 and its respective path

argocd-application-controller-0 argocd-application-controller time="2024-10-17T22:05:49Z" level=info msg="Updated sync status: Synced -> OutOfSync" application=sbx-runners-parent dest-namespace= dest-server="https://kubernetes.default.svc" reason=ResourceUpdated spec="{&ApplicationSource{RepoURL:https://github.com/org/repo-1.git,Path:path,TargetRevision:main,Helm:nil,Kustomize:&ApplicationSourceKustomize{NamePrefix:,NameSuffix:,Images:[docker.elastic.co/beats/filebeat:8.8.2 docker.elastic.co/beats/metricbeat:8.8.2],CommonLabels:map[string]string{},Version:,CommonAnnotations:map[string]string{},ForceCommonLabels:false,ForceCommonAnnotations:false,Namespace:,CommonAnnotationsEnvsubst:false,Replicas:[]KustomizeReplica{},Patches:[]KustomizePatch{},Components:[],LabelWithoutSelector:false,},Directory:nil,Plugin:nil,Chart:,Ref:,} {https://kubernetes.default.svc   false} default &SyncPolicy{Automated:&SyncPolicyAutomated{Prune:true,SelfHeal:true,AllowEmpty:true,},SyncOptions:[CreateNamespace=true ApplyOutOfSyncOnly=true PrunePropagationPolicy=foreground],Retry:nil,ManagedNamespaceMetadata:nil,} [] [] <nil> []}" type=Normal

So it makes me believe that my application is being replaced with other configurations somehow, and the repo and path are being changed for it

[!NOTE]
I did obfuscate some of the data for privacy

[!NOTE]
I tried to upgrade to v2.11.2 to see if it resolves this issue, but the log message is still found, but still haven't reproduced the same issue exactly

AmitBenAmi commented 4 weeks ago

I found another use case in a different environment, with a version of v2.6.6. The behavior seems to be related to an app-of-apps bootstrapping pattern, and it is always with the last application in the lexicographic order (literally the last one on the list).

This happened now with both ApplicationSet and an app-of-apps with kustomize with static Application manifests, which leads me to believe it isn't related to the ApplicationSet, but rather to some conflict and merge between 2 different unrelated applications within ArgoCD, and then the last application under the app-of-apps is being set automatically with a different repoURL, path etc... than what is configured in our repo.

AmitBenAmi commented 4 weeks ago

Might be related to https://github.com/argoproj-labs/argocd-image-updater/issues/896

andrii-korotkov-verkada commented 2 weeks ago

Give a try to v2.12 or v2.13 as well.