Azure / AKS

Azure Kubernetes Service
https://azure.github.io/AKS/
1.97k stars 308 forks source link

Azure Linux nodes will default to using cgroupsv2 starting AKS 1.29 #4495

Closed flora-taagen closed 1 week ago

flora-taagen commented 2 months ago

Please note that Azure Linux nodes on kubernetes version 1.28 will be end of life in November 2024. When upgrading to kubernetes version 1.29 or above, Azure Linux will default to cgroupsv2 which may impact your workloads.

hterik commented 2 months ago

I'm a bit confused. This has been described as the default in AKS since 1.25, for example here https://github.com/Azure/AKS/releases/tag/2023-07-16 here: https://learn.microsoft.com/en-us/troubleshoot/azure/azure-kubernetes/create-upgrade-delete/aks-increased-memory-usage-cgroup-v2#cause and here https://doc.kaas.thalesdigital.io/docs/Breakingchanges/aks125

Which version of cgroups is really used and how can one verify this? :slightly_smiling_face:

flora-taagen commented 2 months ago

@hterik

Ubuntu has defaulted to cgrouspv2 since AKS 1.25. Azure Linux has defaulted to cgroupsv2 since AKS 1.29

To check the cgroups version on your nodes you can run the following command: grep cgroup /proc/filesystems

If your system supports cgroupv2, you would see: nodev cgroup nodev cgroup2

On a system with only cgroupv1, you would only see: nodev cgroup

eeowaa commented 1 month ago

For those running Node.js workloads on Azure Linux AKS nodes, ensure that you are using Node.js 20.3 or greater, otherwise you will run into memory issues. See also: https://github.com/Azure/AKS/issues/3443#issuecomment-1703354926

microsoft-github-policy-service[bot] commented 2 weeks ago

This issue has been automatically marked as stale because it has not had any activity for 21 days. It will be closed if no further activity occurs within 7 days of this comment.

microsoft-github-policy-service[bot] commented 1 week ago

This issue will now be closed because it hasn't had any activity for 7 days after stale. flora-taagen feel free to comment again on the next 7 days to reopen or open a new issue after that time if you still have a question/issue or suggestion.