gardener / garden-setup

Describes Gardener components for installation of a Gardener landscape using sow
Other
78 stars 55 forks source link

TKGs Support #1121

Open assafsauer opened 1 year ago

assafsauer commented 1 year ago

What would you like to be added: Hello , I'm interested in setting up Gardener on VMware Tanzu Kubernetes Grid (TKGs) which might be similar to a native Kubernetes integration. and I'm currently seeking guidance on how to best approach this.

Here are a some of the questions I have: Is there any official support or documentation for setting up Gardener on TKGs or native Kubernetes? In the acre.yaml configuration file, when specifying the IaaS provider (type: <gcp|aws|azure|openstack|vsphere>), should I select 'vsphere' for a TKGs environment? Could you please clarify if the 'zones' field in the acre.yaml file refers to the Datacenters or Resource pools in vSphere? how do i define the DNS type in Vsphere ? (type: <google-clouddns/aws-route53/azure-dns/openstack-designate/cloudflare-dns/infoblox-dns>)

Any additional documentation, examples, or resources for this setup would be greatly appreciated. Thank you in advance for your time and assistance.

Why is this needed: TKG is a popular K8s platform.

vlerenc commented 1 year ago

Gardener provisions K8s cluster on various cloud providers. TKG by means of the cluster API as well. You cannot set up Gardener via TKG (or vice versa) - this doesn't sound right.

What are you trying to achieve? Gardener supports vSphere, so if that's what you are after, you can do that with TKG and Gardener, but not one with the other.

assafsauer commented 1 year ago

Thank you for your response. To clarify, I'm interested in running Gardener on a Kubernetes cluster that was created with VMware Tanzu Kubernetes Grid (TKGs). I understand that both Gardener and TKGs are tools for managing Kubernetes clusters, but in this case, I'm interested in using TKGs as the underlying platform for my Gardener installation.

Specifically, I'm looking to install Gardener on a TKGs cluster (which would become the "garden" cluster in Gardener terminology), and then use Gardener to create and manage additional Kubernetes clusters (the "seed" and "shoot" clusters in Gardener terminology).

I understand that Gardener supports vSphere as an IaaS provider, which is the underlying platform for TKGs. However, I'm unsure how to configure Gardener and the acre.yaml file for use with a TKGs cluster.

I hope this clarifies my request. Any guidance or resources you can provide would be greatly appreciated. was it ever tested ?

vlerenc commented 1 year ago

Well, this clarifies it and @Diaphteiros is probably the best to answer this question. In general, I would not expect specific problems from your setup as you can use various clusters as garden/seed clusters, also (for local development) kind clusters. In that sense, there is no "special rulebook" for particular Kubernetes cluster providers (besides general prerequisites like the Kubernetes version, etc.).

Diaphteiros commented 1 year ago

Sorry, I completely missed this issue.

Garden-setup doesn't actually care where the base cluster comes from, so it should be possible to use it with a TKGs cluster as base cluster already.

Any specific part of the configuration you are having problems with?