vmware-archive / tgik

Official repository for TGI Kubernetes (TGIK)!
Apache License 2.0
835 stars 158 forks source link

Episode idea: Runnding Kubernetes on the vmware stack #146

Open hygl opened 6 years ago

hygl commented 6 years ago

After the heptio and vmware news [1] I would be interested in best practices running kubernetes on the vmware stack (vsphere, vsan, nsx-v, nsx-t, vrealize).

[1] https://www.vmware.com/company/news/releases/vmw-newsfeed.VMware-to-Acquire-Heptio-to-Accelerate-Enterprise-Adoption-of-Kubernetes-On-Premises-and-across-Multi-Cloud-Environments.1645750.html

walidshaari commented 5 years ago

I believe that is what Pivotal PKS does already

mgaruccio commented 5 years ago

There's actually more than one option. PKS does a lot of stuff in addition to runnking k8s, if your looking for something simpler and are using vCloud Director they also have a container service extension that has a feature set somewhat similar to kops - https://github.com/vmware/container-service-extension and there's also some options for using KubeSpray to handle everything except VM provisioning.

pathcl commented 5 years ago

I'd really love to watch this episode. Currenly I'm working towards a solution using terraform+kubespray (k8s 1.12.1) on a gitlab pipeline but the missing part now is vSphere as a cloud provider to have PersistentVolumes. I already fixed some stuff but is not working yet :(

walidshaari commented 5 years ago

I do not have much experience yet with VMware, however, I will be helping a colleague next month test VMware, and Automation. Isn't it terraform with VRealize automation to manage VMware Cloud The Beginner’s Guide to immutable infrastructure with Terraform and vRealize Automation.

would like to learn more about what thoughts and directions VMware+Heptio will have for applications workloads in the Enterprise?

mgaruccio commented 5 years ago

Thats actually the first I've seen that terraform+vra method of running k8s on VMware, and brings the list up to at least 4 different ways to accomplish the same goal. Maybe a show that covers some of the pros/cons of the different options?

walidshaari commented 5 years ago

@mgaruccio 1) terraform +vra, 2) vcloud director + terraform, 3) pks, 4) container service extension 5) kubespray? am I right? what are the different methods?

hygl commented 5 years ago

I also made a poc with Rancher 2.

We had some problems with nsx-t on vxrail, so we switched back to nsx-v. So I am also interested in different network setups.

Another possibility is k8s on vmware integrated Openstack, which lags day2 ops.

Am Mo., 19. Nov. 2018, 16:39 hat Walid notifications@github.com geschrieben:

@mgaruccio https://github.com/mgaruccio 1) terraform +vra, 2) vcloud director + terraform, 3) pks, 4) container service extension 5) kubespray? am I right? what are the different methods?

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/heptio/tgik/issues/146#issuecomment-439936159, or mute the thread https://github.com/notifications/unsubscribe-auth/AAK1UZNbS-RiVbPIvpL1qSShkZxSehSrks5uwtDMgaJpZM4YR04l .

mgaruccio commented 5 years ago

@walidshaari that covers the ones I'm aware of

walidshaari commented 5 years ago

I would love to see 2019 starts with #TGIk PKS advanced features or something around that