search

civo / kube100

NOTE: This repo is no longer being maintained or monitored. If you are facing any issues, you could either create an issue on the other respective repos (if any) or directly reach to us via civo.com
29 stars 2 forks source link

Recycle node causes "stuck" cluster #58

Closed mciverza closed 3 years ago

mciverza commented 3 years ago

Cluster stays in 'INSTALLING' state after recycling node.

K3s Version 1.18.6+k3s1 Civo CLI v0.6.45

How to reproduce: via CLi

export clusterName=observe3
civo k3s create observe3  -s g2.medium --nodes 3

wait 5-10 minutes (or longer), then recycle a node like

civo k3s recycle ${clusterName} --node=kube-node-8d14

Result cluster stays like this:

civo@krew:~$ civo k3s show observe3
          ID : dd20d5c3-515a-4a1b-9f99-5c7d44e977d4
        Name : observe3
       Nodes : 3
        Size : g2.medium
      Status : INSTALLING
     Version : 1.18.6+k3s1
mciverza commented 3 years ago

Seems to happen 2/3 of the time. Fairly reproducable

mciverza commented 3 years ago

unable to reproduce on cluster ID: dd20d5c3-515a-4a1b-9f99-5c7d44e977d4

Did occur on these clusters: ed7903a-3856-42de-9904-b67981011fb0 35d54b72-a2c0-41e5-9142-468b31bd90ab

See Slack thread: https://civo-community.slack.com/archives/CMVCKMCN5/p1607453347374900

mciverza commented 3 years ago

Marking closed. No change needed presently. Will re-test after new platform is launched.