teamhephy / workflow

Hephy Workflow - An open source fork of Deis Workflow - The open source PaaS for Kubernetes.

MIT License

410 stars 36 forks source link

ps:scale doesn't return after scaling to 1000 app pods #13

Open Cryptophobia opened 6 years ago

Cryptophobia commented 6 years ago

From @seanknox on June 16, 2017 23:17

$  deis version
v2.14.0

Running on Azure with 100 worker nodes.

STR

Create an app with deis/example-go
scale to 1000 replicas

EXPECTED

After app replicas reached 1000, command would return

ACTUAL

The pods were scaled to 1000 replicas on Kubernetes, but deis ps:scale cmd=1000 sat indefinitely (waited ~10 minutes before giving up).

Copied from original issue: deis/workflow#827

Cryptophobia commented 6 years ago

From @Joshua-Anderson on June 18, 2017 22:6

I believe that pods are scaled synchronously by the controller, so the command will wait until all 1000 pods are scaled. With the default pod scaling rates and health checks, this could take a really long time.