Azure / karpenter-provider-azure

AKS Karpenter Provider
Apache License 2.0
397 stars 66 forks source link

Ability to define a subnet for pods? #428

Open spaceiq-vk opened 4 months ago

spaceiq-vk commented 4 months ago

Version

❯ helm ls -A --all -o json | jq '.[] | select(.name=="karpenter") | .app_version' -r
0.5.0

❯ kubectl version | grep Server
Server Version: v1.28.5

Expected Behavior

The pods on the nodes should be able to get the IP.

Actual Behavior

Karpenter can spin up a new node and register it to the cluster but pods are unable to get the IP.

Steps to Reproduce the Problem

Resource Specs and Logs

All the pods that land on the node spun up by Karpenter throw this error. I think, I need a way to define the subnet ID for Pods, maybe an environment variable POD_SUBNET_ID?

plugin type="azure-vnet" failed (add): IPAM Invoker Add failed with error: Failed to allocate pool: Failed to delegate: Failed to allocate address: No available addresses

2024-07-10_22-32-24

2024-07-10_22-32-49

Community Note

bwodecki-lf commented 2 weeks ago

Hi, Are you using Azure CNI Pod Subnet network configuration? I'm facing the same issue with karpenter nodes. I have separate subnets for nodes and pods. But does karpender not support such a configuration or I'm wrong?

Bryce-Soghigian commented 2 weeks ago

Karpenter does not yet support pod subnet.

spaceiq-vk commented 2 weeks ago

Are you using Azure CNI Pod Subnet network configuration?

I am using Cilium.