search

Azure-Samples / aks-store-demo

Sample microservices app for AKS demos, tutorials, and experiments
MIT License
143 stars 225 forks source link

Flaky product-service pod stuck in ContainerCreating status #97

Closed pauldotyu closed 7 months ago

pauldotyu commented 7 months ago

Describe the bug Product service pod deployment is flaky. Sometimes it will sit in ContainerCreating status and never get to Running status

Expected behavior Product service should be running within a minute or two

Workaround Run kubectl rollout restart product-service to redeploy the pod

To Reproduce Steps to reproduce the behavior:

  1. Clone repo
  2. Log into azd and az cli
  3. Run azd up command
  4. Wait until the deployment is complete

Run the following command to see status:

$ k get po | grep product-service                                                                                                                                                                                                                                                                                                                                                                                      product-service-8498ccfd54-r8w77   0/1     ContainerCreating   0          64m

Also kube events:

$ k events | grep product-service                                                                                                                                                                                                                                                                                                                                                                                      [11:04:19]
56m                 Normal    SuccessfulCreate       ReplicaSet/product-service-8498ccfd54   Created pod: product-service-8498ccfd54-r8w77
56m                 Normal    Scheduled              Pod/product-service-8498ccfd54-r8w77    Successfully assigned default/product-service-8498ccfd54-r8w77 to aks-system-13967210-vmss000002
56m                 Normal    ScalingReplicaSet      Deployment/product-service              Scaled up replica set product-service-8498ccfd54 to 1
26m                 Warning   FailedCreatePodSandBox   Pod/product-service-8498ccfd54-r8w77    Failed to create pod sandbox: rpc error: code = DeadlineExceeded desc = context deadline exceeded