kubernetes-sigs / karpenter

Karpenter is a Kubernetes Node Autoscaler built for flexibility, performance, and simplicity.
Apache License 2.0
585 stars 195 forks source link

Limit on maximum number of nodes that can be provisioned for a karpenter enabled cluster #1753

Open liafizan opened 5 days ago

liafizan commented 5 days ago

Description

What problem are you trying to solve?

We are migrating from ASG based nodepools to karpenter driven nodepools. One feature that we would want to map from ASG world is to have a limit on number of nodes that can be provisioned for a cluster by karpenter.

I have gone through FAQs and limits but do not see anything defined for this.

In karpenter world, node-count limit on node pool does not add much value since a nodepool can have different instance types underneath it. Hence, request to have a cluster-wide limit.

How important is this feature to you?

It is an important feature as we would like to control our expenditure for AWS for our non production environments & limit clusters beyond CPU/Memory for a nodepool. We would like to have an overall limit for the cluster to have greater control on our costs

k8s-ci-robot commented 5 days ago

This issue is currently awaiting triage.

If Karpenter contributors determines this is a relevant issue, they will accept it by applying the triage/accepted label and provide further guidance.

The triage/accepted label can be added by org members by writing /triage accepted in a comment.

Instructions for interacting with me using PR comments are available [here](https://git.k8s.io/community/contributors/guide/pull-requests.md). If you have questions or suggestions related to my behavior, please file an issue against the [kubernetes-sigs/prow](https://github.com/kubernetes-sigs/prow/issues/new?title=Prow%20issue:) repository.
engedaam commented 4 days ago

It is an important feature as we would like to control our expenditure for AWS for our non production environments & limit clusters beyond CPU/Memory for a nodepool. We would like to have an overall limit for the cluster to have greater control on our costs

Can you provide more insight into your use case? How are you thinking a cluster wide node count limit will help control cost? With having a diversity of nodes within the cluster that will result in varying cost. Are you looking for gating mechanism on Karpenter provisioning based on cost?