aws / containers-roadmap

This is the public roadmap for AWS container services (ECS, ECR, Fargate, and EKS).
https://aws.amazon.com/about-aws/whats-new/containers/
Other
5.22k stars 321 forks source link

[EKS] [request]: Set priorityClassName for cloudwatch addon #2449

Open voidlily opened 1 month ago

voidlily commented 1 month ago

Community Note

Tell us about your request Cloudwatch addon for EKS doesn't set priorityClassName or have a configuration option to allow it to be set.

Which service(s) is this request for? EKS

Tell us about the problem you're trying to solve. What are you trying to do, and why is it hard? I tried to deploy the Cloudwatch addon to my cluster and several nodes weren't able to schedule the agent or fluent-bit daemonset pods due to the nodes being full. This would be solved by adding priorityClassName: system-node-critical on the daemonset pod templates to allow these pods to preempt.

Are you currently working around this issue? Setting the priorityClassName manually currently, but not sustainable when automating cluster deployments via terraform.

Additional context Anything else we should know?

Attachments If you think you might have additional information that you'd like to include via an attachment, please do - we'll take a look. (Remember to remove any personally-identifiable information.)

voidlily commented 1 month ago

see also https://github.com/aws-observability/helm-charts/pull/70 for an open PR on the helm chart version of this addon (but as of time of writing only sets priorityClassName on fluent-bit, not yet on the cloudwatch agent daemonset)