Closed joshrosso closed 2 years ago
joshrosso
commented
2 years ago OVAs used:
$ sha256sum ~/d/ovas/ubuntu-2004-kube-v1.22.5+vmware.1-tkg.2-f838b27ca494fee7083c0340e11ce243.ova
48589b4194d19bef612fa19be420e63a633f7e647d46aa0ca838b950d4b86bd1 /home/josh/d/ovas/ubuntu-2004-kube-v1.22.5+vmware.1-tkg.2-f838b27ca494fee7083c0340e11ce243.ovaOVA was detected:
joshrosso
commented
2 years ago Cluster bootstrapped successfully:
$ tanzu management-cluster create testtest --file /home/josh/.config/tanzu/tkg/clusterconfigs/daoc32q64f.yaml -v 6
compatibility file (/home/josh/.config/tanzu/tkg/compatibility/tkg-compatibility.yaml) already exists, skipping download
BOM files inside /home/josh/.config/tanzu/tkg/bom already exists, skipping download
CEIP Opt-in status: false
Validating the pre-requisites...
Identity Provider not configured. Some authentication features won't work.
WARNING: key is not a string: %!s(int=1)WARNING: key is not a string: %!s(int=1)Checking if VSPHERE_CONTROL_PLANE_ENDPOINT 192.168.52.44 is already in use
SourceFilePath: /home/josh/.kube-tkg/config, ContextName: tkg-mgmt-docker-20220309174206-admin@tkg-mgmt-docker-20220309174206
Namespace: default, Cluster Name: tkg-mgmt-docker-20220309174206
I0309 18:51:26.428894 1963589 request.go:665] Waited for 1.172999563s due to client-side throttling, not priority and fairness, request: GET:https://172.18.0.3:6443/apis/cert-manager.io/v1?timeout=32s
I0309 18:51:36.428896 1963589 request.go:665] Waited for 11.172912736s due to client-side throttling, not priority and fairness, request: GET:https://172.18.0.3:6443/apis/infrastructure.cluster.x-k8s.io/v1alpha3?timeout=32s
Unable to find Network name for context tkg-mgmt-docker-20220309174206-admin@tkg-mgmt-docker-20220309174206. Skipping validation for this context
Setting up management cluster...
Validating configuration...
Using infrastructure provider vsphere:v1.0.2
Generating cluster configuration...
WARNING: key is not a string: %!s(int=1)WARNING: key is not a string: %!s(int=1)Setting up bootstrapper...
Fetching configuration for kind node image...
kindConfig:
&{{Cluster kind.x-k8s.io/v1alpha4} [{ map[] [{/var/run/docker.sock /var/run/docker.sock false false }] [] [] []}] {ipv4 0 100.96.0.0/11 100.64.0.0/13 false } map[] map[] [apiVersion: kubeadm.k8s.io/v1beta2
kind: ClusterConfiguration
imageRepository: projects.registry.vmware.com/tkg
etcd:
local:
imageRepository: projects.registry.vmware.com/tkg
imageTag: v3.5.0_vmware.7
dns:
type: CoreDNS
imageRepository: projects.registry.vmware.com/tkg
imageTag: v1.8.4_vmware.7] [] [] []}
Creating kind cluster: tkg-kind-c8kljags9e9vko9fo7ug
Creating cluster "tkg-kind-c8kljags9e9vko9fo7ug" ...
Ensuring node image (projects-stg.registry.vmware.com/tkg/kind/node:v1.22.5_vmware.1) ...
Image: projects-stg.registry.vmware.com/tkg/kind/node:v1.22.5_vmware.1 present locally
Preparing nodes ...
Writing configuration ...
Starting control-plane ...
Installing CNI ...
Installing StorageClass ...
Waiting 2m0s for control-plane = Ready ...
Ready after 18s
Bootstrapper created. Kubeconfig: /home/josh/.kube-tkg/tmp/config_2UhWVu31
Installing providers on bootstrapper...
Fetching providers
Installing cert-manager Version="v1.5.3"
Waiting for cert-manager to be available...
Installing Provider="cluster-api" Version="v1.0.1" TargetNamespace="capi-system"
Installing Provider="bootstrap-kubeadm" Version="v1.0.1" TargetNamespace="capi-kubeadm-bootstrap-system"
Installing Provider="control-plane-kubeadm" Version="v1.0.1" TargetNamespace="capi-kubeadm-control-plane-system"
Installing Provider="infrastructure-vsphere" Version="v1.0.2" TargetNamespace="capv-system"
installed Component=="cluster-api" Type=="CoreProvider" Version=="v1.0.1"
installed Component=="kubeadm" Type=="BootstrapProvider" Version=="v1.0.1"
installed Component=="kubeadm" Type=="ControlPlaneProvider" Version=="v1.0.1"
installed Component=="vsphere" Type=="InfrastructureProvider" Version=="v1.0.2"
Waiting for provider control-plane-kubeadm
Waiting for provider cluster-api
Waiting for provider bootstrap-kubeadm
Waiting for provider infrastructure-vsphere
Waiting for resource capi-kubeadm-control-plane-controller-manager of type *v1.Deployment to be up and running
pods are not yet running for deployment 'capi-kubeadm-control-plane-controller-manager' in namespace 'capi-kubeadm-control-plane-system', retrying
Waiting for resource capv-controller-manager of type *v1.Deployment to be up and running
pods are not yet running for deployment 'capv-controller-manager' in namespace 'capv-system', retrying
Waiting for resource capi-kubeadm-bootstrap-controller-manager of type *v1.Deployment to be up and running
pods are not yet running for deployment 'capi-kubeadm-bootstrap-controller-manager' in namespace 'capi-kubeadm-bootstrap-system', retrying
Waiting for resource capi-controller-manager of type *v1.Deployment to be up and running
pods are not yet running for deployment 'capi-controller-manager' in namespace 'capi-system', retrying
pods are not yet running for deployment 'capi-kubeadm-control-plane-controller-manager' in namespace 'capi-kubeadm-control-plane-system', retrying
pods are not yet running for deployment 'capv-controller-manager' in namespace 'capv-system', retrying
pods are not yet running for deployment 'capi-kubeadm-bootstrap-controller-manager' in namespace 'capi-kubeadm-bootstrap-system', retrying
Passed waiting on provider cluster-api after 5.206504146s
Passed waiting on provider control-plane-kubeadm after 10.111564395s
pods are not yet running for deployment 'capv-controller-manager' in namespace 'capv-system', retrying
pods are not yet running for deployment 'capi-kubeadm-bootstrap-controller-manager' in namespace 'capi-kubeadm-bootstrap-system', retrying
pods are not yet running for deployment 'capv-controller-manager' in namespace 'capv-system', retrying
Passed waiting on provider bootstrap-kubeadm after 15.126421057s
Passed waiting on provider infrastructure-vsphere after 20.124247974s
Success waiting on all providers.
Start creating management cluster...
patch cluster object with operation status:
{
"metadata": {
"annotations": {
"TKGOperationInfo" : "{\"Operation\":\"Create\",\"OperationStartTimestamp\":\"2022-03-10 01:53:07.367326533 +0000 UTC\",\"OperationTimeout\":1800}",
"TKGOperationLastObservedTimestamp" : "2022-03-10 01:53:07.367326533 +0000 UTC"
}
}
}
[cluster control plane is still being initialized: WaitingForControlPlane, cluster infrastructure is still being provisioned: WaitingForControlPlane]
[cluster control plane is still being initialized: WaitingForControlPlane, cluster infrastructure is still being provisioned: WaitingForControlPlane], retrying
cluster control plane is still being initialized: ScalingUp
cluster control plane is still being initialized: ScalingUp, retrying
cluster control plane is still being initialized: ScalingUp, retrying
cluster control plane is still being initialized: ScalingUp, retrying
cluster control plane is still being initialized: ScalingUp, retrying
cluster control plane is still being initialized: ScalingUp, retrying
cluster control plane is still being initialized: ScalingUp, retrying
cluster control plane is still being initialized: ScalingUp, retrying
cluster control plane is still being initialized: ScalingUp, retrying
cluster control plane is still being initialized: ScalingUp, retrying
cluster control plane is still being initialized: WaitingForKubeadmInit
cluster control plane is still being initialized: WaitingForKubeadmInit, retrying
cluster control plane is still being initialized: WaitingForKubeadmInit, retrying
Getting secret for cluster
Waiting for resource testtest-kubeconfig of type *v1.Secret to be up and running
Saving management cluster kubeconfig into /home/josh/.kube/config
Installing providers on management cluster...
Fetching providers
I0309 18:56:09.757071 1963589 request.go:665] Waited for 1.048087291s due to client-side throttling, not priority and fairness, request: GET:https://192.168.52.44:6443/apis/run.tanzu.vmware.com/v1alpha1?timeout=30s
Installing cert-manager Version="v1.5.3"
Waiting for cert-manager to be available...
Installing Provider="cluster-api" Version="v1.0.1" TargetNamespace="capi-system"
I0309 19:00:59.434487 1963589 request.go:665] Waited for 1.03514117s due to client-side throttling, not priority and fairness, request: GET:https://192.168.52.44:6443/apis/autoscaling/v1?timeout=30s
Installing Provider="bootstrap-kubeadm" Version="v1.0.1" TargetNamespace="capi-kubeadm-bootstrap-system"
Installing Provider="control-plane-kubeadm" Version="v1.0.1" TargetNamespace="capi-kubeadm-control-plane-system"
Installing Provider="infrastructure-vsphere" Version="v1.0.2" TargetNamespace="capv-system"
I0309 19:01:10.121283 1963589 request.go:665] Waited for 1.030111519s due to client-side throttling, not priority and fairness, request: GET:https://192.168.52.44:6443/apis/controlplane.cluster.x-k8s.io/v1alpha3?timeout=30s
installed Component=="cluster-api" Type=="CoreProvider" Version=="v1.0.1"
installed Component=="kubeadm" Type=="BootstrapProvider" Version=="v1.0.1"
installed Component=="kubeadm" Type=="ControlPlaneProvider" Version=="v1.0.1"
installed Component=="vsphere" Type=="InfrastructureProvider" Version=="v1.0.2"
Waiting for provider infrastructure-vsphere
Waiting for provider cluster-api
Waiting for provider control-plane-kubeadm
Waiting for provider bootstrap-kubeadm
Waiting for resource capi-kubeadm-control-plane-controller-manager of type *v1.Deployment to be up and running
Waiting for resource capi-kubeadm-bootstrap-controller-manager of type *v1.Deployment to be up and running
Waiting for resource capv-controller-manager of type *v1.Deployment to be up and running
Waiting for resource capi-controller-manager of type *v1.Deployment to be up and running
pods are not yet running for deployment 'capi-kubeadm-bootstrap-controller-manager' in namespace 'capi-kubeadm-bootstrap-system', retrying
pods are not yet running for deployment 'capv-controller-manager' in namespace 'capv-system', retrying
pods are not yet running for deployment 'capi-kubeadm-control-plane-controller-manager' in namespace 'capi-kubeadm-control-plane-system', retrying
Passed waiting on provider cluster-api after 241.203478ms
Passed waiting on provider bootstrap-kubeadm after 5.199589607s
pods are not yet running for deployment 'capv-controller-manager' in namespace 'capv-system', retrying
Passed waiting on provider control-plane-kubeadm after 5.200415883s
Passed waiting on provider infrastructure-vsphere after 10.198444088s
Success waiting on all providers.
Waiting for the management cluster to get ready for move...
Waiting for resource testtest of type *v1beta1.Cluster to be up and running
Waiting for resources type *v1beta1.KubeadmControlPlaneList to be up and running
Waiting for resources type *v1beta1.MachineDeploymentList to be up and running
Waiting for resources type *v1beta1.MachineList to be up and running
Waiting for addons installation...
Waiting for resources type *v1beta1.ClusterResourceSetList to be up and running
Waiting for resource antrea-controller of type *v1.Deployment to be up and running
Moving all Cluster API objects from bootstrap cluster to management cluster...
Performing move...
Discovering Cluster API objects
Moving Cluster API objects Clusters=1
Creating objects in the target cluster
Deleting objects from the source cluster
Waiting for additional components to be up and running...
Waiting for resource tanzu-addons-controller-manager of type *v1.Deployment to be up and running
Waiting for resource kapp-controller of type *v1.Deployment to be up and running
Waiting for resource tkr-controller-manager of type *v1.Deployment to be up and running
Waiting for packages to be up and running...
Waiting for package: tanzu-core-management-plugins
Waiting for package: antrea
Waiting for package: metrics-server
Waiting for package: secretgen-controller
Waiting for package: tanzu-addons-manager
Waiting for package: vsphere-cpi
Waiting for package: vsphere-csi
Waiting for resource tanzu-core-management-plugins of type *v1alpha1.PackageInstall to be up and running
Waiting for resource antrea of type *v1alpha1.PackageInstall to be up and running
Waiting for resource secretgen-controller of type *v1alpha1.PackageInstall to be up and running
Waiting for resource vsphere-csi of type *v1alpha1.PackageInstall to be up and running
Waiting for resource metrics-server of type *v1alpha1.PackageInstall to be up and running
Waiting for resource vsphere-cpi of type *v1alpha1.PackageInstall to be up and running
Waiting for resource tanzu-addons-manager of type *v1alpha1.PackageInstall to be up and running
packageinstalls.packaging.carvel.dev "metrics-server" not found, retrying
packageinstalls.packaging.carvel.dev "secretgen-controller" not found, retrying
packageinstalls.packaging.carvel.dev "vsphere-csi" not found, retrying
packageinstalls.packaging.carvel.dev "antrea" not found, retrying
packageinstalls.packaging.carvel.dev "vsphere-cpi" not found, retrying
Successfully reconciled package: tanzu-addons-manager
package reconciliation failed: , retrying
packageinstalls.packaging.carvel.dev "vsphere-csi" not found, retrying
packageinstalls.packaging.carvel.dev "metrics-server" not found, retrying
packageinstalls.packaging.carvel.dev "antrea" not found, retrying
packageinstalls.packaging.carvel.dev "vsphere-cpi" not found, retrying
packageinstalls.packaging.carvel.dev "secretgen-controller" not found, retrying
package reconciliation failed: , retrying
packageinstalls.packaging.carvel.dev "secretgen-controller" not found, retrying
packageinstalls.packaging.carvel.dev "vsphere-cpi" not found, retrying
packageinstalls.packaging.carvel.dev "vsphere-csi" not found, retrying
packageinstalls.packaging.carvel.dev "antrea" not found, retrying
packageinstalls.packaging.carvel.dev "metrics-server" not found, retrying
package reconciliation failed: , retrying
package reconciliation failed: , retrying
packageinstalls.packaging.carvel.dev "vsphere-cpi" not found, retrying
packageinstalls.packaging.carvel.dev "secretgen-controller" not found, retrying
packageinstalls.packaging.carvel.dev "metrics-server" not found, retrying
packageinstalls.packaging.carvel.dev "vsphere-csi" not found, retrying
packageinstalls.packaging.carvel.dev "antrea" not found, retrying
waiting for 'secretgen-controller' Package to be installed, retrying
package reconciliation failed: , retrying
waiting for 'antrea' Package to be installed, retrying
waiting for 'vsphere-cpi' Package to be installed, retrying
waiting for 'vsphere-csi' Package to be installed, retrying
waiting for 'metrics-server' Package to be installed, retrying
waiting for 'vsphere-cpi' Package to be installed, retrying
waiting for 'secretgen-controller' Package to be installed, retrying
waiting for 'metrics-server' Package to be installed, retrying
waiting for 'vsphere-csi' Package to be installed, retrying
waiting for 'antrea' Package to be installed, retrying
package reconciliation failed: , retrying
waiting for 'vsphere-cpi' Package to be installed, retrying
waiting for 'metrics-server' Package to be installed, retrying
waiting for 'vsphere-csi' Package to be installed, retrying
waiting for 'secretgen-controller' Package to be installed, retrying
waiting for 'antrea' Package to be installed, retrying
package reconciliation failed: , retrying
waiting for 'secretgen-controller' Package to be installed, retrying
waiting for 'vsphere-cpi' Package to be installed, retrying
waiting for 'antrea' Package to be installed, retrying
waiting for 'metrics-server' Package to be installed, retrying
package reconciliation failed: , retrying
waiting for 'vsphere-csi' Package to be installed, retrying
Successfully reconciled package: secretgen-controller
package reconciliation failed: , retrying
waiting for 'vsphere-cpi' Package to be installed, retrying
waiting for 'metrics-server' Package to be installed, retrying
waiting for 'antrea' Package to be installed, retrying
waiting for 'vsphere-csi' Package to be installed, retrying
waiting for 'metrics-server' Package to be installed, retrying
waiting for 'vsphere-cpi' Package to be installed, retrying
package reconciliation failed: , retrying
waiting for 'vsphere-csi' Package to be installed, retrying
waiting for 'antrea' Package to be installed, retrying
waiting for 'vsphere-csi' Package to be installed, retrying
waiting for 'antrea' Package to be installed, retrying
package reconciliation failed: , retrying
waiting for 'vsphere-cpi' Package to be installed, retrying
waiting for 'metrics-server' Package to be installed, retrying
waiting for 'vsphere-cpi' Package to be installed, retrying
waiting for 'metrics-server' Package to be installed, retrying
package reconciliation failed: , retrying
waiting for 'antrea' Package to be installed, retrying
package reconciliation failed: I0310 02:02:21.001477 267 request.go:665] Waited for 1.046035706s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/cluster.x-k8s.io/v1alpha3?timeout=32s
I0310 02:02:31.004112 267 request.go:665] Waited for 4.995377394s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/cluster.x-k8s.io/v1alpha4/machinesets?labelSelector=kapp.k14s.io%2Fapp%3D1646877739901143309
I0310 02:02:41.038053 267 request.go:665] Waited for 1.876637149s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/controlplane.cluster.x-k8s.io/v1alpha4?timeout=32s
I0310 02:02:51.087480 267 request.go:665] Waited for 5.501192229s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/cert-manager.io/v1beta1?timeout=32s
I0310 02:03:05.555808 267 request.go:665] Waited for 1.037923509s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/infrastructure.cluster.x-k8s.io/v1alpha4?timeout=32s
I0310 02:03:15.905244 267 request.go:665] Waited for 1.038643154s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/events.k8s.io/v1beta1?timeout=32s
kapp: Error: Timed out waiting after 30s, retrying
waiting for 'vsphere-cpi' Package to be installed, retrying
package reconciliation failed: I0310 02:02:21.001477 267 request.go:665] Waited for 1.046035706s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/cluster.x-k8s.io/v1alpha3?timeout=32s
I0310 02:02:31.004112 267 request.go:665] Waited for 4.995377394s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/cluster.x-k8s.io/v1alpha4/machinesets?labelSelector=kapp.k14s.io%2Fapp%3D1646877739901143309
I0310 02:02:41.038053 267 request.go:665] Waited for 1.876637149s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/controlplane.cluster.x-k8s.io/v1alpha4?timeout=32s
I0310 02:02:51.087480 267 request.go:665] Waited for 5.501192229s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/cert-manager.io/v1beta1?timeout=32s
I0310 02:03:05.555808 267 request.go:665] Waited for 1.037923509s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/infrastructure.cluster.x-k8s.io/v1alpha4?timeout=32s
I0310 02:03:15.905244 267 request.go:665] Waited for 1.038643154s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/events.k8s.io/v1beta1?timeout=32s
kapp: Error: Timed out waiting after 30s, retrying
package reconciliation failed: I0310 02:02:21.769121 281 request.go:665] Waited for 1.042507822s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/stats.antrea.tanzu.vmware.com/v1alpha1?timeout=32s
I0310 02:02:31.772488 281 request.go:665] Waited for 4.996889137s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/crd.antrea.io/v1beta1/antreaagentinfos?labelSelector=kapp.k14s.io%2Fapp%3D1646877740668447320
I0310 02:02:43.582035 281 request.go:665] Waited for 1.006488135s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/secretgen.carvel.dev/v1alpha1?timeout=32s
I0310 02:02:53.932211 281 request.go:665] Waited for 1.041613602s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/admissionregistration.k8s.io/v1?timeout=32s
I0310 02:03:03.932849 281 request.go:665] Waited for 3.248217567s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/infrastructure.cluster.x-k8s.io/v1beta1?timeout=32s
I0310 02:03:14.582411 281 request.go:665] Waited for 1.01503632s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/crd.antrea.io/v1alpha1?timeout=32s
kapp: Error: Timed out waiting after 30s, retrying
waiting for 'antrea' Package to be installed, retrying
package reconciliation failed: , retrying
package reconciliation failed: I0310 02:02:21.001477 267 request.go:665] Waited for 1.046035706s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/cluster.x-k8s.io/v1alpha3?timeout=32s
I0310 02:02:31.004112 267 request.go:665] Waited for 4.995377394s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/cluster.x-k8s.io/v1alpha4/machinesets?labelSelector=kapp.k14s.io%2Fapp%3D1646877739901143309
I0310 02:02:41.038053 267 request.go:665] Waited for 1.876637149s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/controlplane.cluster.x-k8s.io/v1alpha4?timeout=32s
I0310 02:02:51.087480 267 request.go:665] Waited for 5.501192229s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/cert-manager.io/v1beta1?timeout=32s
I0310 02:03:05.555808 267 request.go:665] Waited for 1.037923509s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/infrastructure.cluster.x-k8s.io/v1alpha4?timeout=32s
I0310 02:03:15.905244 267 request.go:665] Waited for 1.038643154s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/events.k8s.io/v1beta1?timeout=32s
kapp: Error: Timed out waiting after 30s, retrying
waiting for 'vsphere-cpi' Package to be installed, retrying
package reconciliation failed: I0310 02:02:21.769121 281 request.go:665] Waited for 1.042507822s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/stats.antrea.tanzu.vmware.com/v1alpha1?timeout=32s
I0310 02:02:31.772488 281 request.go:665] Waited for 4.996889137s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/crd.antrea.io/v1beta1/antreaagentinfos?labelSelector=kapp.k14s.io%2Fapp%3D1646877740668447320
I0310 02:02:43.582035 281 request.go:665] Waited for 1.006488135s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/secretgen.carvel.dev/v1alpha1?timeout=32s
I0310 02:02:53.932211 281 request.go:665] Waited for 1.041613602s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/admissionregistration.k8s.io/v1?timeout=32s
I0310 02:03:03.932849 281 request.go:665] Waited for 3.248217567s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/infrastructure.cluster.x-k8s.io/v1beta1?timeout=32s
I0310 02:03:14.582411 281 request.go:665] Waited for 1.01503632s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/crd.antrea.io/v1alpha1?timeout=32s
kapp: Error: Timed out waiting after 30s, retrying
package reconciliation failed: , retrying
waiting for 'antrea' Package to be installed, retrying
package reconciliation failed: , retrying
waiting for 'antrea' Package to be installed, retrying
package reconciliation failed: I0310 02:02:21.769121 281 request.go:665] Waited for 1.042507822s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/stats.antrea.tanzu.vmware.com/v1alpha1?timeout=32s
I0310 02:02:31.772488 281 request.go:665] Waited for 4.996889137s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/crd.antrea.io/v1beta1/antreaagentinfos?labelSelector=kapp.k14s.io%2Fapp%3D1646877740668447320
I0310 02:02:43.582035 281 request.go:665] Waited for 1.006488135s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/secretgen.carvel.dev/v1alpha1?timeout=32s
I0310 02:02:53.932211 281 request.go:665] Waited for 1.041613602s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/admissionregistration.k8s.io/v1?timeout=32s
I0310 02:03:03.932849 281 request.go:665] Waited for 3.248217567s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/infrastructure.cluster.x-k8s.io/v1beta1?timeout=32s
I0310 02:03:14.582411 281 request.go:665] Waited for 1.01503632s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/crd.antrea.io/v1alpha1?timeout=32s
kapp: Error: Timed out waiting after 30s, retrying
waiting for 'vsphere-cpi' Package to be installed, retrying
package reconciliation failed: I0310 02:02:21.001477 267 request.go:665] Waited for 1.046035706s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/cluster.x-k8s.io/v1alpha3?timeout=32s
I0310 02:02:31.004112 267 request.go:665] Waited for 4.995377394s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/cluster.x-k8s.io/v1alpha4/machinesets?labelSelector=kapp.k14s.io%2Fapp%3D1646877739901143309
I0310 02:02:41.038053 267 request.go:665] Waited for 1.876637149s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/controlplane.cluster.x-k8s.io/v1alpha4?timeout=32s
I0310 02:02:51.087480 267 request.go:665] Waited for 5.501192229s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/cert-manager.io/v1beta1?timeout=32s
I0310 02:03:05.555808 267 request.go:665] Waited for 1.037923509s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/infrastructure.cluster.x-k8s.io/v1alpha4?timeout=32s
I0310 02:03:15.905244 267 request.go:665] Waited for 1.038643154s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/events.k8s.io/v1beta1?timeout=32s
kapp: Error: Timed out waiting after 30s, retrying
waiting for 'antrea' Package to be installed, retrying
package reconciliation failed: I0310 02:02:21.769121 281 request.go:665] Waited for 1.042507822s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/stats.antrea.tanzu.vmware.com/v1alpha1?timeout=32s
I0310 02:02:31.772488 281 request.go:665] Waited for 4.996889137s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/crd.antrea.io/v1beta1/antreaagentinfos?labelSelector=kapp.k14s.io%2Fapp%3D1646877740668447320
I0310 02:02:43.582035 281 request.go:665] Waited for 1.006488135s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/secretgen.carvel.dev/v1alpha1?timeout=32s
I0310 02:02:53.932211 281 request.go:665] Waited for 1.041613602s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/admissionregistration.k8s.io/v1?timeout=32s
I0310 02:03:03.932849 281 request.go:665] Waited for 3.248217567s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/infrastructure.cluster.x-k8s.io/v1beta1?timeout=32s
I0310 02:03:14.582411 281 request.go:665] Waited for 1.01503632s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/crd.antrea.io/v1alpha1?timeout=32s
kapp: Error: Timed out waiting after 30s, retrying
package reconciliation failed: , retrying
package reconciliation failed: I0310 02:02:21.001477 267 request.go:665] Waited for 1.046035706s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/cluster.x-k8s.io/v1alpha3?timeout=32s
I0310 02:02:31.004112 267 request.go:665] Waited for 4.995377394s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/cluster.x-k8s.io/v1alpha4/machinesets?labelSelector=kapp.k14s.io%2Fapp%3D1646877739901143309
I0310 02:02:41.038053 267 request.go:665] Waited for 1.876637149s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/controlplane.cluster.x-k8s.io/v1alpha4?timeout=32s
I0310 02:02:51.087480 267 request.go:665] Waited for 5.501192229s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/cert-manager.io/v1beta1?timeout=32s
I0310 02:03:05.555808 267 request.go:665] Waited for 1.037923509s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/infrastructure.cluster.x-k8s.io/v1alpha4?timeout=32s
I0310 02:03:15.905244 267 request.go:665] Waited for 1.038643154s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/events.k8s.io/v1beta1?timeout=32s
kapp: Error: Timed out waiting after 30s, retrying
package reconciliation failed: I0310 02:02:46.795606 327 request.go:665] Waited for 1.008132297s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/secretgen.carvel.dev/v1alpha1?timeout=32s
I0310 02:02:57.144822 327 request.go:665] Waited for 1.04755201s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/secretgen.carvel.dev/v1alpha1?timeout=32s
I0310 02:03:07.153373 327 request.go:665] Waited for 7.227703377s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/acme.cert-manager.io/v1alpha2/challenges?labelSelector=kapp.k14s.io%2Fapp%3D1646877765693625654
I0310 02:03:17.169644 327 request.go:665] Waited for 1.715754301s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/controlplane.cluster.x-k8s.io/v1alpha3?timeout=32s
I0310 02:03:28.870105 327 request.go:665] Waited for 1.037997633s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/bootstrap.cluster.x-k8s.io/v1beta1?timeout=32s
I0310 02:03:39.719933 327 request.go:665] Waited for 1.048315106s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/admissionregistration.k8s.io/v1?timeout=32s
I0310 02:03:49.719976 327 request.go:665] Waited for 3.147598693s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/controlplane.cluster.x-k8s.io/v1beta1?timeout=32s
kapp: Error: Timed out waiting after 30s, retrying
waiting for 'antrea' Package to be installed, retrying
package reconciliation failed: , retrying
package reconciliation failed: I0310 02:02:21.001477 267 request.go:665] Waited for 1.046035706s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/cluster.x-k8s.io/v1alpha3?timeout=32s
I0310 02:02:31.004112 267 request.go:665] Waited for 4.995377394s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/cluster.x-k8s.io/v1alpha4/machinesets?labelSelector=kapp.k14s.io%2Fapp%3D1646877739901143309
I0310 02:02:41.038053 267 request.go:665] Waited for 1.876637149s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/controlplane.cluster.x-k8s.io/v1alpha4?timeout=32s
I0310 02:02:51.087480 267 request.go:665] Waited for 5.501192229s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/cert-manager.io/v1beta1?timeout=32s
I0310 02:03:05.555808 267 request.go:665] Waited for 1.037923509s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/infrastructure.cluster.x-k8s.io/v1alpha4?timeout=32s
I0310 02:03:15.905244 267 request.go:665] Waited for 1.038643154s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/events.k8s.io/v1beta1?timeout=32s
kapp: Error: Timed out waiting after 30s, retrying
package reconciliation failed: I0310 02:02:21.769121 281 request.go:665] Waited for 1.042507822s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/stats.antrea.tanzu.vmware.com/v1alpha1?timeout=32s
I0310 02:02:31.772488 281 request.go:665] Waited for 4.996889137s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/crd.antrea.io/v1beta1/antreaagentinfos?labelSelector=kapp.k14s.io%2Fapp%3D1646877740668447320
I0310 02:02:43.582035 281 request.go:665] Waited for 1.006488135s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/secretgen.carvel.dev/v1alpha1?timeout=32s
I0310 02:02:53.932211 281 request.go:665] Waited for 1.041613602s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/admissionregistration.k8s.io/v1?timeout=32s
I0310 02:03:03.932849 281 request.go:665] Waited for 3.248217567s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/infrastructure.cluster.x-k8s.io/v1beta1?timeout=32s
I0310 02:03:14.582411 281 request.go:665] Waited for 1.01503632s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/crd.antrea.io/v1alpha1?timeout=32s
kapp: Error: Timed out waiting after 30s, retrying
package reconciliation failed: I0310 02:02:46.795606 327 request.go:665] Waited for 1.008132297s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/secretgen.carvel.dev/v1alpha1?timeout=32s
I0310 02:02:57.144822 327 request.go:665] Waited for 1.04755201s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/secretgen.carvel.dev/v1alpha1?timeout=32s
I0310 02:03:07.153373 327 request.go:665] Waited for 7.227703377s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/acme.cert-manager.io/v1alpha2/challenges?labelSelector=kapp.k14s.io%2Fapp%3D1646877765693625654
I0310 02:03:17.169644 327 request.go:665] Waited for 1.715754301s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/controlplane.cluster.x-k8s.io/v1alpha3?timeout=32s
I0310 02:03:28.870105 327 request.go:665] Waited for 1.037997633s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/bootstrap.cluster.x-k8s.io/v1beta1?timeout=32s
I0310 02:03:39.719933 327 request.go:665] Waited for 1.048315106s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/admissionregistration.k8s.io/v1?timeout=32s
I0310 02:03:49.719976 327 request.go:665] Waited for 3.147598693s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/controlplane.cluster.x-k8s.io/v1beta1?timeout=32s
kapp: Error: Timed out waiting after 30s, retrying
package reconciliation failed: I0310 02:02:46.795606 327 request.go:665] Waited for 1.008132297s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/secretgen.carvel.dev/v1alpha1?timeout=32s
I0310 02:02:57.144822 327 request.go:665] Waited for 1.04755201s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/secretgen.carvel.dev/v1alpha1?timeout=32s
I0310 02:03:07.153373 327 request.go:665] Waited for 7.227703377s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/acme.cert-manager.io/v1alpha2/challenges?labelSelector=kapp.k14s.io%2Fapp%3D1646877765693625654
I0310 02:03:17.169644 327 request.go:665] Waited for 1.715754301s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/controlplane.cluster.x-k8s.io/v1alpha3?timeout=32s
I0310 02:03:28.870105 327 request.go:665] Waited for 1.037997633s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/bootstrap.cluster.x-k8s.io/v1beta1?timeout=32s
I0310 02:03:39.719933 327 request.go:665] Waited for 1.048315106s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/admissionregistration.k8s.io/v1?timeout=32s
I0310 02:03:49.719976 327 request.go:665] Waited for 3.147598693s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/controlplane.cluster.x-k8s.io/v1beta1?timeout=32s
kapp: Error: Timed out waiting after 30s, retrying
package reconciliation failed: , retrying
Successfully reconciled package: antrea
package reconciliation failed: I0310 02:02:21.769121 281 request.go:665] Waited for 1.042507822s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/stats.antrea.tanzu.vmware.com/v1alpha1?timeout=32s
I0310 02:02:31.772488 281 request.go:665] Waited for 4.996889137s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/crd.antrea.io/v1beta1/antreaagentinfos?labelSelector=kapp.k14s.io%2Fapp%3D1646877740668447320
I0310 02:02:43.582035 281 request.go:665] Waited for 1.006488135s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/secretgen.carvel.dev/v1alpha1?timeout=32s
I0310 02:02:53.932211 281 request.go:665] Waited for 1.041613602s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/admissionregistration.k8s.io/v1?timeout=32s
I0310 02:03:03.932849 281 request.go:665] Waited for 3.248217567s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/infrastructure.cluster.x-k8s.io/v1beta1?timeout=32s
I0310 02:03:14.582411 281 request.go:665] Waited for 1.01503632s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/crd.antrea.io/v1alpha1?timeout=32s
kapp: Error: Timed out waiting after 30s, retrying
Successfully reconciled package: vsphere-csi
Successfully reconciled package: vsphere-cpi
Successfully reconciled package: metrics-server
package reconciliation failed: , retrying
package reconciliation failed: , retrying
package reconciliation failed: , retrying
package reconciliation failed: , retrying
package reconciliation failed: , retrying
package reconciliation failed: , retrying
package reconciliation failed: , retrying
package reconciliation failed: , retrying
package reconciliation failed: , retrying
package reconciliation failed: , retrying
package reconciliation failed: , retrying
package reconciliation failed: , retrying
package reconciliation failed: , retrying
package reconciliation failed: , retrying
package reconciliation failed: , retrying
package reconciliation failed: , retrying
package reconciliation failed: , retrying
package reconciliation failed: , retrying
package reconciliation failed: , retrying
package reconciliation failed: , retrying
package reconciliation failed: , retrying
package reconciliation failed: , retrying
package reconciliation failed: , retrying
package reconciliation failed: , retrying
package reconciliation failed: , retrying
package reconciliation failed: , retrying
package reconciliation failed: , retrying
package reconciliation failed: , retrying
package reconciliation failed: , retrying
package reconciliation failed: , retrying
package reconciliation failed: , retrying
package reconciliation failed: , retrying
package reconciliation failed: , retrying
package reconciliation failed: , retrying
package reconciliation failed: , retrying
package reconciliation failed: , retrying
package reconciliation failed: , retrying
package reconciliation failed: , retrying
package reconciliation failed: , retrying
package reconciliation failed: , retrying
package reconciliation failed: , retrying
package reconciliation failed: , retrying
package reconciliation failed: , retrying
package reconciliation failed: , retrying
Failure while waiting for package 'tanzu-core-management-plugins'
Warning: Management cluster is created successfully, but some packages are failing. Failure while waiting for packages to be installed: package reconciliation failed:
You can now access the management cluster testtest by running 'kubectl config use-context testtest-admin@testtest'
Deleting kind cluster: tkg-kind-c8kljags9e9vko9fo7ug
Management cluster created!
You can now create your first workload cluster by running the following:
tanzu cluster create [name] -f [file]
Some addons might be getting installed! Check their status by running the following:
kubectl get apps -A
Checking for required plugins...
All required plugins are already installed and up-to-dateValidated that annotations are present
josh @ tugboat (~/d/community-edition) [main]
$ kubectl get cluster -A -o yaml | rg edition
edition: tce
josh @ tugboat (~/d/community-edition) [main]
$ kubectl get cluster -A -o yaml | rg TKGVERSION
TKGVERSION: v1.5.1-tf-v0.11.2cluster creation succeeded:
$ tanzu cluster create beepboop --file /home/josh/.config/tanzu/tkg/clusterconfigs/daoc32q64f.yaml -v 6
compatibility file (/home/josh/.config/tanzu/tkg/compatibility/tkg-compatibility.yaml) already exists, skipping download
BOM files inside /home/josh/.config/tanzu/tkg/bom already exists, skipping download
Using namespace from config:
Validating configuration...
Waiting for resource pinniped-info of type *v1.ConfigMap to be up and running
configmaps "pinniped-info" not found, retrying
configmaps "pinniped-info" not found, retrying
configmaps "pinniped-info" not found, retrying
configmaps "pinniped-info" not found, retrying
configmaps "pinniped-info" not found, retrying
configmaps "pinniped-info" not found, retrying
configmaps "pinniped-info" not found, retrying
Warning: Pinniped configuration not found. Skipping pinniped configuration in workload cluster. Please refer to the documentation to check if you can configure pinniped on workload cluster manually
Creating workload cluster 'beepboop'...
patch cluster object with operation status:
{
"metadata": {
"annotations": {
"TKGOperationInfo" : "{\"Operation\":\"Create\",\"OperationStartTimestamp\":\"2022-03-10 02:15:06.627814546 +0000 UTC\",\"OperationTimeout\":1800}",
"TKGOperationLastObservedTimestamp" : "2022-03-10 02:15:06.627814546 +0000 UTC"
}
}
}
Waiting for cluster to be initialized...
cluster control plane is still being initialized: WaitingForControlPlane
cluster control plane is still being initialized: WaitingForControlPlane, retrying
cluster control plane is still being initialized: ScalingUp
cluster control plane is still being initialized: ScalingUp, retrying
cluster control plane is still being initialized: ScalingUp, retrying
cluster control plane is still being initialized: ScalingUp, retrying
cluster control plane is still being initialized: ScalingUp, retrying
cluster control plane is still being initialized: ScalingUp, retrying
cluster control plane is still being initialized: ScalingUp, retrying
cluster control plane is still being initialized: ScalingUp, retrying
cluster control plane is still being initialized: ScalingUp, retrying
cluster control plane is still being initialized: ScalingUp, retrying
Getting secret for cluster
Waiting for resource beepboop-kubeconfig of type *v1.Secret to be up and running
Waiting for cluster nodes to be available...
Waiting for resource beepboop of type *v1beta1.Cluster to be up and running
Waiting for resources type *v1beta1.KubeadmControlPlaneList to be up and running
control-plane is still creating replicas, DesiredReplicas=1 Replicas=1 ReadyReplicas=0 UpdatedReplicas=1, retrying
control-plane is still creating replicas, DesiredReplicas=1 Replicas=1 ReadyReplicas=0 UpdatedReplicas=1, retrying
control-plane is still creating replicas, DesiredReplicas=1 Replicas=1 ReadyReplicas=0 UpdatedReplicas=1, retrying
control-plane is still creating replicas, DesiredReplicas=1 Replicas=1 ReadyReplicas=0 UpdatedReplicas=1, retrying
control-plane is still creating replicas, DesiredReplicas=1 Replicas=1 ReadyReplicas=0 UpdatedReplicas=1, retrying
control-plane is still creating replicas, DesiredReplicas=1 Replicas=1 ReadyReplicas=0 UpdatedReplicas=1, retrying
control-plane is still creating replicas, DesiredReplicas=1 Replicas=1 ReadyReplicas=0 UpdatedReplicas=1, retrying
control-plane is still creating replicas, DesiredReplicas=1 Replicas=1 ReadyReplicas=0 UpdatedReplicas=1, retrying
control-plane is still creating replicas, DesiredReplicas=1 Replicas=1 ReadyReplicas=0 UpdatedReplicas=1, retrying
control-plane is still creating replicas, DesiredReplicas=1 Replicas=1 ReadyReplicas=0 UpdatedReplicas=1, retrying
control-plane is still creating replicas, DesiredReplicas=1 Replicas=1 ReadyReplicas=0 UpdatedReplicas=1, retrying
control-plane is still creating replicas, DesiredReplicas=1 Replicas=1 ReadyReplicas=0 UpdatedReplicas=1, retrying
control-plane is still creating replicas, DesiredReplicas=1 Replicas=1 ReadyReplicas=0 UpdatedReplicas=1, retrying
control-plane is still creating replicas, DesiredReplicas=1 Replicas=1 ReadyReplicas=0 UpdatedReplicas=1, retrying
control-plane is still creating replicas, DesiredReplicas=1 Replicas=1 ReadyReplicas=0 UpdatedReplicas=1, retrying
control-plane is still creating replicas, DesiredReplicas=1 Replicas=1 ReadyReplicas=0 UpdatedReplicas=1, retrying
control-plane is still creating replicas, DesiredReplicas=1 Replicas=1 ReadyReplicas=0 UpdatedReplicas=1, retrying
control-plane is still creating replicas, DesiredReplicas=1 Replicas=1 ReadyReplicas=0 UpdatedReplicas=1, retrying
control-plane is still creating replicas, DesiredReplicas=1 Replicas=1 ReadyReplicas=0 UpdatedReplicas=1, retrying
control-plane is still creating replicas, DesiredReplicas=1 Replicas=1 ReadyReplicas=0 UpdatedReplicas=1, retrying
control-plane is still creating replicas, DesiredReplicas=1 Replicas=1 ReadyReplicas=0 UpdatedReplicas=1, retrying
control-plane is still creating replicas, DesiredReplicas=1 Replicas=1 ReadyReplicas=0 UpdatedReplicas=1, retrying
control-plane is still creating replicas, DesiredReplicas=1 Replicas=1 ReadyReplicas=0 UpdatedReplicas=1, retrying
control-plane is still creating replicas, DesiredReplicas=1 Replicas=1 ReadyReplicas=0 UpdatedReplicas=1, retrying
Waiting for resources type *v1beta1.MachineDeploymentList to be up and running
Waiting for resources type *v1beta1.MachineList to be up and running
Waiting for addons installation...
Waiting for resources type *v1beta1.ClusterResourceSetList to be up and running
Waiting for resource antrea-controller of type *v1.Deployment to be up and running
I0309 19:21:38.096430 2052346 request.go:665] Waited for 1.151131352s due to client-side throttling, not priority and fairness, request: GET:https://192.168.52.77:6443/apis/crd.antrea.io/v1beta1?timeout=32s
Waiting for packages to be up and running...
Waiting for package: antrea
Waiting for package: metrics-server
Waiting for package: secretgen-controller
Waiting for package: vsphere-cpi
Waiting for package: vsphere-csi
Waiting for resource antrea of type *v1alpha1.PackageInstall to be up and running
Waiting for resource vsphere-csi of type *v1alpha1.PackageInstall to be up and running
Waiting for resource metrics-server of type *v1alpha1.PackageInstall to be up and running
Waiting for resource secretgen-controller of type *v1alpha1.PackageInstall to be up and running
Waiting for resource vsphere-cpi of type *v1alpha1.PackageInstall to be up and running
waiting for 'vsphere-csi' Package to be installed, retrying
waiting for 'metrics-server' Package to be installed, retrying
package reconciliation failed: I0310 02:20:07.562569 96 request.go:665] Waited for 1.048214817s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/admissionregistration.k8s.io/v1?timeout=32s
I0310 02:20:25.367649 96 request.go:665] Waited for 1.027102137s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/controlplane.antrea.tanzu.vmware.com/v1beta1?timeout=32s
I0310 02:20:35.367948 96 request.go:665] Waited for 1.647457109s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/crd.antrea.io/v1alpha2?timeout=32s
I0310 02:20:46.517559 96 request.go:665] Waited for 1.035196188s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/packaging.carvel.dev/v1alpha1?timeout=32s
I0310 02:20:57.618400 96 request.go:665] Waited for 1.014316132s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/data.packaging.carvel.dev/v1alpha1?timeout=32s
kapp: Error: Timed out waiting after 30s, retrying
Successfully reconciled package: vsphere-cpi
waiting for 'secretgen-controller' Package to be installed, retrying
waiting for 'metrics-server' Package to be installed, retrying
waiting for 'secretgen-controller' Package to be installed, retrying
package reconciliation failed: I0310 02:20:39.863411 168 request.go:665] Waited for 1.03542812s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/metrics.k8s.io/v1beta1?timeout=32s
I0310 02:20:49.867486 168 request.go:665] Waited for 1.710227661s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/apps/v1/controllerrevisions?labelSelector=kapp.k14s.io%2Fapp%3D1646878838676925244
I0310 02:21:00.852018 168 request.go:665] Waited for 1.047201802s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/storage.k8s.io/v1beta1?timeout=32s
I0310 02:21:14.452709 168 request.go:665] Waited for 1.031389002s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/stats.antrea.io/v1alpha1?timeout=32s
I0310 02:21:24.952652 168 request.go:665] Waited for 1.022607872s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/controlplane.antrea.tanzu.vmware.com/v1beta2?timeout=32s
I0310 02:21:35.652754 168 request.go:665] Waited for 1.023271755s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/secretgen.k14s.io/v1alpha1?timeout=32s
kapp: Error: Timed out waiting after 30s, retrying
package reconciliation failed: I0310 02:20:07.562569 96 request.go:665] Waited for 1.048214817s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/admissionregistration.k8s.io/v1?timeout=32s
I0310 02:20:25.367649 96 request.go:665] Waited for 1.027102137s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/controlplane.antrea.tanzu.vmware.com/v1beta1?timeout=32s
I0310 02:20:35.367948 96 request.go:665] Waited for 1.647457109s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/crd.antrea.io/v1alpha2?timeout=32s
I0310 02:20:46.517559 96 request.go:665] Waited for 1.035196188s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/packaging.carvel.dev/v1alpha1?timeout=32s
I0310 02:20:57.618400 96 request.go:665] Waited for 1.014316132s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/data.packaging.carvel.dev/v1alpha1?timeout=32s
kapp: Error: Timed out waiting after 30s, retrying
package reconciliation failed: I0310 02:21:07.388146 225 request.go:665] Waited for 1.045860863s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/discovery.k8s.io/v1?timeout=32s
I0310 02:21:17.391807 225 request.go:665] Waited for 1.747878288s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/crd.antrea.tanzu.vmware.com/v1alpha1/tierentitlements?labelSelector=kapp.k14s.io%2Fapp%3D1646878808723395175
I0310 02:21:28.131508 225 request.go:665] Waited for 1.041777841s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/admissionregistration.k8s.io/v1?timeout=32s
I0310 02:21:38.704654 225 request.go:665] Waited for 1.027777641s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/discovery.k8s.io/v1beta1?timeout=32s
I0310 02:21:48.706744 225 request.go:665] Waited for 1.14882043s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/scheduling.k8s.io/v1?timeout=32s
kapp: Error: Timed out waiting after 30s, retrying
waiting for 'antrea' Package to be installed, retrying
package reconciliation failed: I0310 02:20:39.863411 168 request.go:665] Waited for 1.03542812s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/metrics.k8s.io/v1beta1?timeout=32s
I0310 02:20:49.867486 168 request.go:665] Waited for 1.710227661s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/apps/v1/controllerrevisions?labelSelector=kapp.k14s.io%2Fapp%3D1646878838676925244
I0310 02:21:00.852018 168 request.go:665] Waited for 1.047201802s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/storage.k8s.io/v1beta1?timeout=32s
I0310 02:21:14.452709 168 request.go:665] Waited for 1.031389002s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/stats.antrea.io/v1alpha1?timeout=32s
I0310 02:21:24.952652 168 request.go:665] Waited for 1.022607872s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/controlplane.antrea.tanzu.vmware.com/v1beta2?timeout=32s
I0310 02:21:35.652754 168 request.go:665] Waited for 1.023271755s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/secretgen.k14s.io/v1alpha1?timeout=32s
kapp: Error: Timed out waiting after 30s, retrying
Successfully reconciled package: secretgen-controller
package reconciliation failed: I0310 02:21:07.388146 225 request.go:665] Waited for 1.045860863s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/discovery.k8s.io/v1?timeout=32s
I0310 02:21:17.391807 225 request.go:665] Waited for 1.747878288s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/crd.antrea.tanzu.vmware.com/v1alpha1/tierentitlements?labelSelector=kapp.k14s.io%2Fapp%3D1646878808723395175
I0310 02:21:28.131508 225 request.go:665] Waited for 1.041777841s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/admissionregistration.k8s.io/v1?timeout=32s
I0310 02:21:38.704654 225 request.go:665] Waited for 1.027777641s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/discovery.k8s.io/v1beta1?timeout=32s
I0310 02:21:48.706744 225 request.go:665] Waited for 1.14882043s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/scheduling.k8s.io/v1?timeout=32s
kapp: Error: Timed out waiting after 30s, retrying
Successfully reconciled package: antrea
package reconciliation failed: I0310 02:20:39.863411 168 request.go:665] Waited for 1.03542812s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/metrics.k8s.io/v1beta1?timeout=32s
I0310 02:20:49.867486 168 request.go:665] Waited for 1.710227661s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/apps/v1/controllerrevisions?labelSelector=kapp.k14s.io%2Fapp%3D1646878838676925244
I0310 02:21:00.852018 168 request.go:665] Waited for 1.047201802s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/storage.k8s.io/v1beta1?timeout=32s
I0310 02:21:14.452709 168 request.go:665] Waited for 1.031389002s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/stats.antrea.io/v1alpha1?timeout=32s
I0310 02:21:24.952652 168 request.go:665] Waited for 1.022607872s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/controlplane.antrea.tanzu.vmware.com/v1beta2?timeout=32s
I0310 02:21:35.652754 168 request.go:665] Waited for 1.023271755s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/secretgen.k14s.io/v1alpha1?timeout=32s
kapp: Error: Timed out waiting after 30s, retrying
Successfully reconciled package: vsphere-csi
package reconciliation failed: I0310 02:21:07.388146 225 request.go:665] Waited for 1.045860863s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/discovery.k8s.io/v1?timeout=32s
I0310 02:21:17.391807 225 request.go:665] Waited for 1.747878288s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/crd.antrea.tanzu.vmware.com/v1alpha1/tierentitlements?labelSelector=kapp.k14s.io%2Fapp%3D1646878808723395175
I0310 02:21:28.131508 225 request.go:665] Waited for 1.041777841s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/admissionregistration.k8s.io/v1?timeout=32s
I0310 02:21:38.704654 225 request.go:665] Waited for 1.027777641s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/discovery.k8s.io/v1beta1?timeout=32s
I0310 02:21:48.706744 225 request.go:665] Waited for 1.14882043s due to client-side throttling, not priority and fairness, request: GET:https://100.64.0.1:443/apis/scheduling.k8s.io/v1?timeout=32s
kapp: Error: Timed out waiting after 30s, retrying
Successfully reconciled package: metrics-server
Workload cluster 'beepboop' created
stmcginnis
commented
2 years ago Built off of HEAD today:
$ tanzu version
version: v0.11.2
buildDate: 2022-03-10
sha: 6431d1dCreated management cluster on my vSphere 7 environment. Deployment successful:
$ k get nodes
NAME STATUS ROLES AGE VERSION
test-control-plane-mrs2d Ready control-plane,master 63m v1.22.5+vmware.1
test-md-0-68677c4db9-l8lrs Ready <none> 61m v1.22.5+vmware.1Checked annotations:
$ k get cluster -A -o yaml | rg "edition|TKGVERSION"
TKGVERSION: v1.5.1-tf-v0.11.2
edition: tceConfigured cluster settings:
$ cat ~/vsphere.yaml
CLUSTER_CIDR: 100.97.0.0/11
CLUSTER_PLAN: dev
ENABLE_CEIP_PARTICIPATION: "false"
ENABLE_MHC: "true"
IDENTITY_MANAGEMENT_TYPE: none
INFRASTRUCTURE_PROVIDER: vsphere
SERVICE_CIDR: 100.65.0.0/13
TKG_HTTP_PROXY_ENABLED: "false"
VSPHERE_CONTROL_PLANE_DISK_GIB: "40"
VSPHERE_CONTROL_PLANE_ENDPOINT: 192.168.1.212
VSPHERE_CONTROL_PLANE_MEM_MIB: "8192"
VSPHERE_CONTROL_PLANE_NUM_CPUS: "2"
VSPHERE_DATACENTER: /Tanzu Lab
VSPHERE_DATASTORE: /Tanzu Lab/datastore/VMData
VSPHERE_FOLDER: /Tanzu Lab/vm
VSPHERE_NETWORK: VM Network
VSPHERE_PASSWORD: xxx
VSPHERE_RESOURCE_POOL: /Tanzu Lab/host/192.168.1.201/Resources
VSPHERE_SERVER: 192.168.1.202
VSPHERE_SSH_AUTHORIZED_KEY: xxx
VSPHERE_TLS_THUMBPRINT: 7E:60:19:0D:D8:93:6A:B8:69:F9:63:5C:28:B6:9D:52:C3:A3:A8:1D
VSPHERE_USERNAME: administrator@tanzu.local
VSPHERE_WORKER_DISK_GIB: "40"
VSPHERE_WORKER_MEM_MIB: "8192"
VSPHERE_WORKER_NUM_CPUS: "2"Deployed successfully with known garbage output:
$ tanzu cluster create vfoo -f ~/vsphere.yaml
Validating configuration...
Warning: Pinniped configuration not found. Skipping pinniped configuration in workload cluster. Please refer to the documentation to check if you can configure pinniped on workload cluster manually
Setting config variable "VSPHERE_NETWORK" to value "/Tanzu Lab/network/VM Network"
Creating workload cluster 'vfoo'...
Waiting for cluster to be initialized...
cluster control plane is still being initialized: WaitingForControlPlane
cluster control plane is still being initialized: ScalingUp
cluster control plane is still being initialized: WaitingForKubeadmInit
Waiting for cluster nodes to be available...
Waiting for addons installation...
I0310 12:57:09.896070 1726477 request.go:665] Waited for 1.180166824s due to client-side throttling, not priority and fairness, request: GET:https://192.168.1.212:6443/apis/crd.antrea.io/v1alpha1?timeout=32s
Waiting for packages to be up and running...
Workload cluster 'vfoo' createdCluster working:
$ k get nodes
NAME STATUS ROLES AGE VERSION
vfoo-control-plane-ckfv5 Ready control-plane,master 33m v1.22.5+vmware.1
vfoo-md-0-75f47dc6dc-mwcgc Ready <none> 9m33s v1.22.5+vmware.1
$ k get pods -A
NAMESPACE NAME READY STATUS RESTARTS AGE
kube-system antrea-agent-fszbv 2/2 Running 0 9m36s
kube-system antrea-agent-whrlr 2/2 Running 0 29m
kube-system antrea-controller-674b8df659-n9z92 1/1 Running 0 29m
kube-system coredns-6765cf8944-h7589 1/1 Running 0 33m
kube-system coredns-6765cf8944-qrnfm 1/1 Running 0 33m
kube-system etcd-vfoo-control-plane-ckfv5 1/1 Running 0 33m
kube-system kube-apiserver-vfoo-control-plane-ckfv5 1/1 Running 0 33m
kube-system kube-controller-manager-vfoo-control-plane-ckfv5 1/1 Running 3 (28m ago) 33m
kube-system kube-proxy-9jtgt 1/1 Running 0 9m36s
kube-system kube-proxy-h77tm 1/1 Running 0 33m
kube-system kube-scheduler-vfoo-control-plane-ckfv5 1/1 Running 3 (28m ago) 33m
kube-system kube-vip-vfoo-control-plane-ckfv5 1/1 Running 0 33m
kube-system metrics-server-59546775c4-wxrjr 1/1 Running 0 30m
kube-system vsphere-cloud-controller-manager-jblxk 1/1 Running 2 (28m ago) 31m
kube-system vsphere-csi-controller-55ffc66b47-nrxtv 6/6 Running 0 30m
kube-system vsphere-csi-node-9n2vb 3/3 Running 0 9m36s
kube-system vsphere-csi-node-xwhxr 3/3 Running 5 (27m ago) 30m
tanzu-system secretgen-controller-774764f69b-tx5vd 1/1 Running 0 30m
tkg-system kapp-controller-5d97cd4c68-nkm4f 1/1 Running 0 33m
tkg-system tanzu-capabilities-controller-manager-75889b7f-r7glp 1/1 Running 0 33m
This is a tracking issue with notes on validating v0.11.0 against vsphere
this validation occurred from
fce1955a52c47c689f3220dfca29035dba5cc279