aws / karpenter-provider-aws

Karpenter is a Kubernetes Node Autoscaler built for flexibility, performance, and simplicity.
https://karpenter.sh
Apache License 2.0
6.15k stars 849 forks source link

Karpenter evicts pods having do-not-disrupt annotation #6407

Closed tinhhn closed 6 days ago

tinhhn commented 1 week ago

Description

Observed Behavior: Karpenter evicts pods which have karpenter/do-not-disrupt “true” annotation Verified via kube-apiserver-audit log: pods are evicted by Karpenter. Did not see any log related to the evicted pod in the Karpenter log (the leader one), log level is DEBUG.

Expected Behavior: Karpenter should not evict pods having do-not-disrupt annotation

Reproduction Steps (Please include YAML): Not always, just usually, so I can not provide steps here. Sorry that I type from phone and can not provide logs due to company policy. Is there any case that would happen? Thanks in advance!

Versions:

zaldnoay commented 6 days ago

There is a conditional race bug in 0.36.0, update to the new version and try again? Related: https://github.com/kubernetes-sigs/karpenter/issues/1167

tinhhn commented 6 days ago

Yes thanks. Just scouted out that earlier. Let me upgrade and check.