Azure / AKS

Azure Kubernetes Service
https://azure.github.io/AKS/
1.95k stars 304 forks source link

[BUG] Calico can't be scheduled on virtual nodes (Azure Container Instances) #3995

Open jooooel opened 9 months ago

jooooel commented 9 months ago

Describe the bug Calico fails to schedule on ("virtual nodes" (backed by Azure Container Instances). The error is simply "ProviderFailed".

It started showing up pretty recently, so I suspect it might be related to this: https://github.com/projectcalico/calico/pull/7979? Edit: Ok, it looks like that hasn't been released yet 🤔

I guess we can get around this if we can configure taints and tolerations for the Calico DaemonSet.

To Reproduce Not sure, but I think:

  1. Create an AKS cluster with Calico and the ACI plugin enabled
  2. See error on the virtual node

Expected behavior A clear and concise description of what you expected to happen.

Screenshots image

Environment (please complete the following information):

paulgmiller commented 8 months ago

@wedaly has a fix pendign for this I believe.

avinashreddypulluru commented 8 months ago

Did we get a fix for this?

nunoalima commented 8 months ago

We are facing the same issue.

Some additional details on the error:

Status:               Pending
Reason:               ProviderFailed
Message:              ACI does not support lifecycle hooks

Kubernetes version: 1.26.3 Kubelet version: v1.25.0-vk-azure-aci-1.6.0 Calico image: mcr.microsoft.com/oss/calico/node:v3.24.6