Open lippertmarkus opened 10 months ago
Hi @lippertmarkus, we experience similar issue too. Have you checked that the nodes are restarted too? We found in our case that some nodes crash:
az monitor activity-log list \
--subscription "Sub1" \
--resource-id /subscriptions/a8549e6e-fbc2-4ab2-b2c0-6fd39f8e6ffe/resourceGroups/aks-smb-multiple-connection-issue-common-01/providers/Microsoft.Compute/virtualMachineScaleSets/akswin00 \
--offset 2d \
--query "[?properties.title == 'Machine crashed'].{eventTimestamp: eventTimestamp, resourceId: resourceId}" \
--max-events 1000;
We have an ongoing support case with Microsoft related to our issue but I'm not sure if it is related to yours. By the way, I wonder if that can be also related to the in-place Windows patching on these machines. Or aren't these machines ever patched, only reimaged?
Action required from @Azure/aks-pm
Issue needing attention of @Azure/aks-leads
Issue needing attention of @Azure/aks-leads
Issue needing attention of @Azure/aks-leads
Issue needing attention of @Azure/aks-leads
Issue needing attention of @Azure/aks-leads
Issue needing attention of @Azure/aks-leads
Issue needing attention of @Azure/aks-leads
Issue needing attention of @Azure/aks-leads
Issue needing attention of @Azure/aks-leads
Issue needing attention of @Azure/aks-leads
Issue needing attention of @Azure/aks-leads
Issue needing attention of @Azure/aks-leads
Describe the bug When using ephemeral OS disks for the Windows nodes in our cluster, we experience sporadic Pod restarts, especially when there's a high load on the node (e.g. multiple pods starting at the same time). The same pods run fine without issues on nodes with managed OS disks.
On nodes with ephemeral OS disks containers terminate with
Exit Code: -1073741510
and events show:To Reproduce Steps to reproduce the behavior:
It might be related to our specific workload, I can give you access to the container images for troubleshooting.
Expected behavior Pods should be running stable
Screenshots Pods on nodes with ephemeral OS disk:![image](https://github.com/Azure/AKS/assets/1463140/1b7c92c8-7ab6-4aa1-bd99-304d38c741b2)
Pods on nodes with managed OS disk:![image](https://github.com/Azure/AKS/assets/1463140/2491f37e-7a79-4331-8ca0-080f162f251d)
Environment (please complete the following information):
Additional context