rke instead of bootkube

[blaggacao]

Lot's of good things can be read about rke, one of the more impressive is this: https://medium.com/@cfatechblog/bare-metal-k8s-clustering-at-chick-fil-a-scale-7b0607bd3541

Most interesting features (in my horizon):

• OS agnostic
• simple cluster config yaml

Maybe not worth it in the (slow, maybe) advent of its obsoletion:

• https://github.com/kubernetes/community/blob/master/contributors/design-proposals/cluster-lifecycle/self-hosted-kubernetes.md
• https://github.com/kubernetes/kubernetes/issues/28138

Any thoughts?

[afritzler]

Thanks for the RKE link. It really looks pretty good. Have to take a deeper look though.

Regarding the self-hosted Kubernetes approach: it is a nice idea, and we were using it in Kubify at the beginning (you can actually still configure to use the self hosted mode - but we will deprecate it soon) - but it has a couple of drawbacks. You can find a presentation on that here [0] and the recording of this session here [1].

[0] https://github.com/gardener/kubify/blob/master/docs/presentations/Static-ETCD-Setup.pptx [1] https://www.youtube.com/watch?v=a8tHRVnUf3k&t=210s

[afritzler]

Unfortunately RKE doesn't seem to have CoreOS support. Need to also have a deeper look into Atomic.

[blaggacao]

Thanks for your thoughts and the links. I'll have to dig in deeper into those failure scenarios. I din't realize it doesn't support CoreOS. That must be because of the independent etcd cluster used at the CoreOS node level... I've personally yet to find my love for CoreOS, though. :smile: