karuppiah7890 / tce-e2e-test

Apache License 2.0
1 stars 1 forks source link

Cert-manager E2E test hooking in Cluster lifecycle tests logs #37

Open aman556 opened 2 years ago

aman556 commented 2 years ago
2022-06-24T08:07:32Z    INFO    docker/docker.go:29 Checking docker CLI and Docker Engine installation
2022-06-24T08:07:32Z    INFO    docker/docker.go:44 docker CLI is available at path: /usr/bin/docker
2022-06-24T08:07:32Z    INFO    docker/docker.go:45 E2E test Docker client's API version: 1.41
2022-06-24T08:07:32Z    INFO    docker/docker.go:46 Docker Engine's API version: 1.41
2022-06-24T08:07:32Z    INFO    docker/docker.go:47 Docker Engine's version: 20.10.14
2022-06-24T08:07:32Z    INFO    utils/common.go:56  Checking kubectl CLI installation
2022-06-24T08:07:32Z    INFO    utils/common.go:62  kubectl CLI is available at path: /usr/local/bin/kubectl

2022-06-24T08:07:32Z    INFO    testutils/common.go:17  Checking required environment variables
2022-06-24T08:07:32Z    INFO    utils/cluster_test_runner.go:58 Management Cluster Name : test-mgmt-1656058052
2022-06-24T08:07:32Z    INFO    utils/cluster_test_runner.go:59 Workload Cluster Name : test-wkld-1656058052
2022-06-24T08:07:32Z    INFO    clirunner/run.go:24 Running the command `/usr/local/bin/tanzu management-cluster create test-mgmt-1656058052`
2022-06-24T08:07:32Z    ERROR   io/io.go:425    
Validating the pre-requisites...

2022-06-24T08:07:32Z    ERROR   io/io.go:425    Identity Provider not configured. Some authentication features won't work.

2022-06-24T08:07:32Z    ERROR   io/io.go:425    Using default value for CONTROL_PLANE_MACHINE_COUNT = 1. Reason: CONTROL_PLANE_MACHINE_COUNT variable is not set

2022-06-24T08:07:32Z    ERROR   io/io.go:425    Using default value for WORKER_MACHINE_COUNT = 1. Reason: WORKER_MACHINE_COUNT variable is not set

2022-06-24T08:07:32Z    ERROR   io/io.go:425    
Setting up management cluster...

2022-06-24T08:07:32Z    ERROR   io/io.go:425    Validating configuration...

2022-06-24T08:07:33Z    ERROR   io/io.go:425    Using infrastructure provider docker:v1.0.1
Generating cluster configuration...

2022-06-24T08:07:33Z    ERROR   io/io.go:425    Using default value for CONTROL_PLANE_MACHINE_COUNT = 1. Reason: CONTROL_PLANE_MACHINE_COUNT variable is not set
Using default value for WORKER_MACHINE_COUNT = 1. Reason: WORKER_MACHINE_COUNT variable is not set

2022-06-24T08:07:35Z    ERROR   io/io.go:425    Setting up bootstrapper...

2022-06-24T08:08:34Z    ERROR   io/io.go:425    Bootstrapper created. Kubeconfig: /home/ubuntu/.kube-tkg/tmp/config_54e4rH4f

2022-06-24T08:08:34Z    ERROR   io/io.go:425    Installing providers on bootstrapper...

2022-06-24T08:08:34Z    ERROR   io/io.go:425    Fetching providers

2022-06-24T08:08:34Z    ERROR   io/io.go:425    Installing cert-manager Version="v1.5.3"

2022-06-24T08:08:36Z    ERROR   io/io.go:425    Waiting for cert-manager to be available...

2022-06-24T08:08:51Z    ERROR   io/io.go:425    Installing Provider="cluster-api" Version="v1.0.1" TargetNamespace="capi-system"

2022-06-24T08:08:52Z    ERROR   io/io.go:425    Installing Provider="bootstrap-kubeadm" Version="v1.0.1" TargetNamespace="capi-kubeadm-bootstrap-system"

2022-06-24T08:08:53Z    ERROR   io/io.go:425    Installing Provider="control-plane-kubeadm" Version="v1.0.1" TargetNamespace="capi-kubeadm-control-plane-system"

2022-06-24T08:08:54Z    ERROR   io/io.go:425    Installing Provider="infrastructure-docker" Version="v1.0.1" TargetNamespace="capd-system"

2022-06-24T08:09:04Z    ERROR   io/io.go:425    Start creating management cluster...

2022-06-24T08:09:07Z    ERROR   io/io.go:425    [cluster control plane is still being initialized: WaitingForControlPlane, cluster infrastructure is still being provisioned: WaitingForControlPlane]

2022-06-24T08:09:22Z    ERROR   io/io.go:425    cluster control plane is still being initialized: ScalingUp

2022-06-24T08:10:07Z    ERROR   io/io.go:425    Saving management cluster kubeconfig into /home/ubuntu/.kube/config

2022-06-24T08:10:07Z    ERROR   io/io.go:425    Installing providers on management cluster...

2022-06-24T08:10:07Z    ERROR   io/io.go:425    Fetching providers

2022-06-24T08:10:08Z    ERROR   io/io.go:425    Installing cert-manager Version="v1.5.3"

2022-06-24T08:10:12Z    ERROR   io/io.go:425    Waiting for cert-manager to be available...

2022-06-24T08:14:54Z    ERROR   io/io.go:425    Installing Provider="cluster-api" Version="v1.0.1" TargetNamespace="capi-system"

2022-06-24T08:14:56Z    ERROR   io/io.go:425    I0624 08:14:56.062215  737181 request.go:665] Waited for 1.012870153s due to client-side throttling, not priority and fairness, request: GET:https://172.29.0.6:6443/apis/data.packaging.carvel.dev/v1alpha1?timeout=30s

2022-06-24T08:14:58Z    ERROR   io/io.go:425    Installing Provider="bootstrap-kubeadm" Version="v1.0.1" TargetNamespace="capi-kubeadm-bootstrap-system"

2022-06-24T08:15:01Z    ERROR   io/io.go:425    Installing Provider="control-plane-kubeadm" Version="v1.0.1" TargetNamespace="capi-kubeadm-control-plane-system"

2022-06-24T08:15:05Z    ERROR   io/io.go:425    Installing Provider="infrastructure-docker" Version="v1.0.1" TargetNamespace="capd-system"

2022-06-24T08:15:06Z    ERROR   io/io.go:425    I0624 08:15:06.558633  737181 request.go:665] Waited for 1.016166598s due to client-side throttling, not priority and fairness, request: GET:https://172.29.0.6:6443/apis/security.antrea.tanzu.vmware.com/v1alpha1?timeout=30s

2022-06-24T08:15:18Z    ERROR   io/io.go:425    Waiting for the management cluster to get ready for move...

2022-06-24T08:15:18Z    ERROR   io/io.go:425    Waiting for addons installation...

2022-06-24T08:15:19Z    ERROR   io/io.go:425    Moving all Cluster API objects from bootstrap cluster to management cluster...

2022-06-24T08:15:19Z    ERROR   io/io.go:425    Performing move...

2022-06-24T08:15:19Z    ERROR   io/io.go:425    Discovering Cluster API objects

2022-06-24T08:15:20Z    ERROR   io/io.go:425    Moving Cluster API objects Clusters=1

2022-06-24T08:15:20Z    ERROR   io/io.go:425    Creating objects in the target cluster

2022-06-24T08:15:23Z    ERROR   io/io.go:425    Deleting objects from the source cluster

2022-06-24T08:15:25Z    ERROR   io/io.go:425    Waiting for additional components to be up and running...

2022-06-24T08:15:30Z    ERROR   io/io.go:425    Waiting for packages to be up and running...

2022-06-24T08:23:10Z    ERROR   io/io.go:425    You can now access the management cluster test-mgmt-1656058052 by running 'kubectl config use-context test-mgmt-1656058052-admin@test-mgmt-1656058052'

2022-06-24T08:23:11Z    ERROR   io/io.go:425    
Management cluster created!

You can now create your first workload cluster by running the following:

  tanzu cluster create [name] -f [file]

Some addons might be getting installed! Check their status by running the following:

  kubectl get apps -A

2022-06-24T08:23:11Z    ERROR   io/io.go:425    Checking for required plugins...

2022-06-24T08:23:11Z    ERROR   io/io.go:425    All required plugins are already installed and up-to-date

2022-06-24T08:23:11Z    INFO    clirunner/run.go:24 Running the command `/usr/local/bin/tanzu management-cluster kubeconfig get test-mgmt-1656058052 --admin`
2022-06-24T08:23:12Z    ERROR   io/io.go:425    Credentials of cluster 'test-mgmt-1656058052' have been saved 
You can now access the cluster by running 'kubectl config use-context test-mgmt-1656058052-admin@test-mgmt-1656058052'

2022-06-24T08:23:12Z    INFO    utils/common.go:271 Management Cluster test-mgmt-1656058052 Information: 
2022-06-24T08:23:12Z    INFO    utils/cluster_test_runner.go:150    Kubernetes API server version is v1.22.8+vmware.1
2022-06-24T08:23:12Z    INFO    utils/cluster_test_runner.go:162    Pod Name    Pod Namespace   Pod Phase
2022-06-24T08:23:12Z    INFO    utils/cluster_test_runner.go:165    capd-controller-manager-757ccd469f-v5ntf    capd-system Running
2022-06-24T08:23:12Z    INFO    utils/cluster_test_runner.go:165    capi-kubeadm-bootstrap-controller-manager-8df76564d-m47q5   capi-kubeadm-bootstrap-system   Running
2022-06-24T08:23:12Z    INFO    utils/cluster_test_runner.go:165    capi-kubeadm-control-plane-controller-manager-5b9577cd5c-dqwlx  capi-kubeadm-control-plane-system   Running
2022-06-24T08:23:12Z    INFO    utils/cluster_test_runner.go:165    capi-controller-manager-9b5fc4874-nfw5s capi-system Running
2022-06-24T08:23:12Z    INFO    utils/cluster_test_runner.go:165    cert-manager-654fc8bbbc-j7sdp   cert-manager    Running
2022-06-24T08:23:12Z    INFO    utils/cluster_test_runner.go:165    cert-manager-cainjector-6c6d94f8c8-9nmln    cert-manager    Running
2022-06-24T08:23:12Z    INFO    utils/cluster_test_runner.go:165    cert-manager-webhook-5fcdb7665c-mgg7v   cert-manager    Running
2022-06-24T08:23:12Z    INFO    utils/cluster_test_runner.go:165    antrea-agent-btt8g  kube-system Running
2022-06-24T08:23:12Z    INFO    utils/cluster_test_runner.go:165    antrea-agent-xjfqx  kube-system Running
2022-06-24T08:23:12Z    INFO    utils/cluster_test_runner.go:165    antrea-controller-5488447cdb-mxnh5  kube-system Running
2022-06-24T08:23:12Z    INFO    utils/cluster_test_runner.go:165    coredns-67c8559bb6-kxkjr    kube-system Running
2022-06-24T08:23:12Z    INFO    utils/cluster_test_runner.go:165    coredns-67c8559bb6-vk4bv    kube-system Running
2022-06-24T08:23:12Z    INFO    utils/cluster_test_runner.go:165    etcd-test-mgmt-1656058052-control-plane-spksf   kube-system Running
2022-06-24T08:23:12Z    INFO    utils/cluster_test_runner.go:165    kube-apiserver-test-mgmt-1656058052-control-plane-spksf kube-system Running
2022-06-24T08:23:12Z    INFO    utils/cluster_test_runner.go:165    kube-controller-manager-test-mgmt-1656058052-control-plane-spksf    kube-system Running
2022-06-24T08:23:12Z    INFO    utils/cluster_test_runner.go:165    kube-proxy-bjh4v    kube-system Running
2022-06-24T08:23:12Z    INFO    utils/cluster_test_runner.go:165    kube-proxy-nr6nv    kube-system Running
2022-06-24T08:23:12Z    INFO    utils/cluster_test_runner.go:165    kube-scheduler-test-mgmt-1656058052-control-plane-spksf kube-system Running
2022-06-24T08:23:12Z    INFO    utils/cluster_test_runner.go:165    metrics-server-f846d4f5d-8t9rm  kube-system Running
2022-06-24T08:23:12Z    INFO    utils/cluster_test_runner.go:165    secretgen-controller-f69fd7d84-tb482    tanzu-system    Running
2022-06-24T08:23:12Z    INFO    utils/cluster_test_runner.go:165    kapp-controller-8547dd46f9-xl2ht    tkg-system  Running
2022-06-24T08:23:12Z    INFO    utils/cluster_test_runner.go:165    tanzu-addons-controller-manager-5975747ff8-qkg4l    tkg-system  Running
2022-06-24T08:23:12Z    INFO    utils/cluster_test_runner.go:165    tanzu-capabilities-controller-manager-798c4d557c-ns7zk  tkg-system  Running
2022-06-24T08:23:12Z    INFO    utils/cluster_test_runner.go:165    tanzu-featuregates-controller-manager-66d8cccf9d-dp6bg  tkg-system  Running
2022-06-24T08:23:12Z    INFO    utils/cluster_test_runner.go:165    tkr-controller-manager-c945bcfd7-d6mq9  tkr-system  Running
2022-06-24T08:23:12Z    INFO    utils/cluster_test_runner.go:173    

Node Name   Node Phase
2022-06-24T08:23:12Z    INFO    utils/cluster_test_runner.go:176    test-mgmt-1656058052-control-plane-spksf    
2022-06-24T08:23:12Z    INFO    utils/cluster_test_runner.go:176    test-mgmt-1656058052-md-0-5bfb5b4b44-77jxm  
2022-06-24T08:23:12Z    INFO    clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster create test-wkld-1656058052`
2022-06-24T08:23:12Z    ERROR   io/io.go:425    Validating configuration...

2022-06-24T08:23:37Z    ERROR   io/io.go:425    Warning: Pinniped configuration not found. Skipping pinniped configuration in workload cluster. Please refer to the documentation to check if you can configure pinniped on workload cluster manually

2022-06-24T08:23:39Z    ERROR   io/io.go:425    Creating workload cluster 'test-wkld-1656058052'...

2022-06-24T08:23:42Z    ERROR   io/io.go:425    Waiting for cluster to be initialized...

2022-06-24T08:23:42Z    ERROR   io/io.go:425    [cluster control plane is still being initialized: WaitingForControlPlane, cluster infrastructure is still being provisioned: WaitingForControlPlane]

2022-06-24T08:23:57Z    ERROR   io/io.go:425    cluster control plane is still being initialized: WaitingForKubeadmInit

2022-06-24T08:24:27Z    ERROR   io/io.go:425    cluster control plane is still being initialized: Bootstrapping @ Machine/test-wkld-1656058052-control-plane-d7hpb

2022-06-24T08:24:42Z    ERROR   io/io.go:425    Waiting for cluster nodes to be available...

2022-06-24T08:26:02Z    ERROR   io/io.go:425    Waiting for addons installation...

2022-06-24T08:26:03Z    ERROR   io/io.go:425    I0624 08:26:03.743859  781162 request.go:665] Waited for 1.167337027s due to client-side throttling, not priority and fairness, request: GET:https://172.29.0.2:6443/apis/apiextensions.k8s.io/v1?timeout=32s

2022-06-24T08:26:04Z    ERROR   io/io.go:425    Waiting for packages to be up and running...

2022-06-24T08:26:34Z    ERROR   io/io.go:425    
Workload cluster 'test-wkld-1656058052' created

2022-06-24T08:26:34Z    INFO    clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-24T08:26:34Z    INFO    utils/cluster_test_runner.go:210    Workload cluster test-wkld-1656058052 is running successfully

2022-06-24T08:26:34Z    INFO    clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster kubeconfig get test-wkld-1656058052 --admin`
2022-06-24T08:26:34Z    ERROR   io/io.go:425    Credentials of cluster 'test-wkld-1656058052' have been saved 
You can now access the cluster by running 'kubectl config use-context test-wkld-1656058052-admin@test-wkld-1656058052'

2022-06-24T08:26:34Z    INFO    utils/common.go:300 Workload Cluster test-wkld-1656058052 Information: 
2022-06-24T08:26:34Z    INFO    utils/cluster_test_runner.go:150    Kubernetes API server version is v1.22.8+vmware.1
2022-06-24T08:26:34Z    INFO    utils/cluster_test_runner.go:162    Pod Name    Pod Namespace   Pod Phase
2022-06-24T08:26:34Z    INFO    utils/cluster_test_runner.go:165    antrea-agent-g2bps  kube-system Running
2022-06-24T08:26:34Z    INFO    utils/cluster_test_runner.go:165    antrea-agent-ht9xc  kube-system Running
2022-06-24T08:26:34Z    INFO    utils/cluster_test_runner.go:165    antrea-controller-58cd4d7f4d-fvgrk  kube-system Running
2022-06-24T08:26:34Z    INFO    utils/cluster_test_runner.go:165    coredns-67c8559bb6-kqkgq    kube-system Running
2022-06-24T08:26:34Z    INFO    utils/cluster_test_runner.go:165    coredns-67c8559bb6-rbb8q    kube-system Running
2022-06-24T08:26:34Z    INFO    utils/cluster_test_runner.go:165    etcd-test-wkld-1656058052-control-plane-d7hpb   kube-system Running
2022-06-24T08:26:34Z    INFO    utils/cluster_test_runner.go:165    kube-apiserver-test-wkld-1656058052-control-plane-d7hpb kube-system Running
2022-06-24T08:26:34Z    INFO    utils/cluster_test_runner.go:165    kube-controller-manager-test-wkld-1656058052-control-plane-d7hpb    kube-system Running
2022-06-24T08:26:34Z    INFO    utils/cluster_test_runner.go:165    kube-proxy-62q2x    kube-system Running
2022-06-24T08:26:34Z    INFO    utils/cluster_test_runner.go:165    kube-proxy-p8h47    kube-system Running
2022-06-24T08:26:34Z    INFO    utils/cluster_test_runner.go:165    kube-scheduler-test-wkld-1656058052-control-plane-d7hpb kube-system Running
2022-06-24T08:26:34Z    INFO    utils/cluster_test_runner.go:165    metrics-server-fbb87b855-5ntxr  kube-system Running
2022-06-24T08:26:34Z    INFO    utils/cluster_test_runner.go:165    secretgen-controller-57778b8d59-lll6d   tanzu-system    Running
2022-06-24T08:26:34Z    INFO    utils/cluster_test_runner.go:165    kapp-controller-7597956cc6-mc72g    tkg-system  Running
2022-06-24T08:26:34Z    INFO    utils/cluster_test_runner.go:165    tanzu-capabilities-controller-manager-798c4d557c-g5kn5  tkg-system  Running
2022-06-24T08:26:34Z    INFO    utils/cluster_test_runner.go:173    

Node Name   Node Phase
2022-06-24T08:26:34Z    INFO    utils/cluster_test_runner.go:176    test-wkld-1656058052-control-plane-d7hpb    
2022-06-24T08:26:34Z    INFO    utils/cluster_test_runner.go:176    test-wkld-1656058052-md-0-769fcbf49-fnnpp   
2022-06-24T08:26:34Z    INFO    clirunner/run.go:24 Running the command `/usr/bin/make e2e-test`
2022-06-24T08:26:34Z    INFO    io/io.go:425    CGO_ENABLED=0 go run github.com/onsi/ginkgo/ginkgo -v e2e

2022-06-24T08:26:35Z    INFO    io/io.go:425    Running Suite: cert-manager Package E2E Test Suite
==================================================
Random Seed: 1656059195
Will run 1 of 1 specs

2022-06-24T08:26:35Z    INFO    io/io.go:425    STEP: installing cert-manager package
+ tanzu package available list -o json

2022-06-24T08:26:35Z    INFO    io/io.go:425    Error: Get "https://127.0.0.1:38225/api?timeout=32s": dial tcp 127.0.0.1:38225: connect: connection refused
Error: exit status 1

2022-06-24T08:26:35Z    INFO    io/io.go:425    Failure [0.141 seconds]
[BeforeSuite] BeforeSuite 
/home/ubuntu/tce-e2e-test/community-edition/addons/packages/cert-manager/1.8.0/test/e2e/cert_manager_suite_test.go:47

2022-06-24T08:26:35Z    INFO    io/io.go:425      Unexpected error:
      <*errors.errorString | 0xc000054030>: {
          s: "Error: Get \"https://127.0.0.1:38225/api?timeout=32s\": dial tcp 127.0.0.1:38225: connect: connection refused\nError: exit status 1\n\nexit status: 1",
      }
      Error: Get "https://127.0.0.1:38225/api?timeout=32s": dial tcp 127.0.0.1:38225: connect: connection refused
      Error: exit status 1

      exit status: 1
  occurred

  /home/ubuntu/tce-e2e-test/community-edition/addons/packages/test/pkg/utils/package_plugin.go:16
------------------------------
STEP: validating the cert-manager package install no longer exists
+ kubectl -n default get packageinstall cert-manager

2022-06-24T08:26:35Z    INFO    io/io.go:425    The connection to the server 127.0.0.1:38225 was refused - did you specify the right host or port?

2022-06-24T08:26:40Z    INFO    io/io.go:425    + kubectl -n default get packageinstall cert-manager

2022-06-24T08:26:41Z    INFO    io/io.go:425    The connection to the server 127.0.0.1:38225 was refused - did you specify the right host or port?

2022-06-24T08:26:46Z    INFO    io/io.go:425    + kubectl -n default get packageinstall cert-manager

2022-06-24T08:26:46Z    INFO    io/io.go:425    The connection to the server 127.0.0.1:38225 was refused - did you specify the right host or port?

2022-06-24T08:26:51Z    INFO    io/io.go:425    + kubectl -n default get packageinstall cert-manager

2022-06-24T08:26:51Z    INFO    io/io.go:425    The connection to the server 127.0.0.1:38225 was refused - did you specify the right host or port?

2022-06-24T08:26:56Z    INFO    io/io.go:425    + kubectl -n default get packageinstall cert-manager

2022-06-24T08:26:56Z    INFO    io/io.go:425    The connection to the server 127.0.0.1:38225 was refused - did you specify the right host or port?

2022-06-24T08:27:01Z    INFO    io/io.go:425    + kubectl -n default get packageinstall cert-manager

2022-06-24T08:27:01Z    INFO    io/io.go:425    The connection to the server 127.0.0.1:38225 was refused - did you specify the right host or port?

2022-06-24T08:27:06Z    INFO    io/io.go:425    + kubectl -n default get packageinstall cert-manager

2022-06-24T08:27:06Z    INFO    io/io.go:425    The connection to the server 127.0.0.1:38225 was refused - did you specify the right host or port?

2022-06-24T08:27:11Z    INFO    io/io.go:425    + kubectl -n default get packageinstall cert-manager

2022-06-24T08:27:11Z    INFO    io/io.go:425    The connection to the server 127.0.0.1:38225 was refused - did you specify the right host or port?

2022-06-24T08:27:16Z    INFO    io/io.go:425    + kubectl -n default get packageinstall cert-manager

2022-06-24T08:27:16Z    INFO    io/io.go:425    The connection to the server 127.0.0.1:38225 was refused - did you specify the right host or port?

2022-06-24T08:27:21Z    INFO    io/io.go:425    + kubectl -n default get packageinstall cert-manager

2022-06-24T08:27:21Z    INFO    io/io.go:425    The connection to the server 127.0.0.1:38225 was refused - did you specify the right host or port?

2022-06-24T08:27:26Z    INFO    io/io.go:425    + kubectl -n default get packageinstall cert-manager

2022-06-24T08:27:26Z    INFO    io/io.go:425    The connection to the server 127.0.0.1:38225 was refused - did you specify the right host or port?

2022-06-24T08:27:31Z    INFO    io/io.go:425    + kubectl -n default get packageinstall cert-manager

2022-06-24T08:27:31Z    INFO    io/io.go:425    The connection to the server 127.0.0.1:38225 was refused - did you specify the right host or port?

2022-06-24T08:27:36Z    INFO    io/io.go:425    + kubectl -n default get packageinstall cert-manager

2022-06-24T08:27:36Z    INFO    io/io.go:425    The connection to the server 127.0.0.1:38225 was refused - did you specify the right host or port?

2022-06-24T08:27:41Z    INFO    io/io.go:425    + kubectl -n default get packageinstall cert-manager

2022-06-24T08:27:41Z    INFO    io/io.go:425    The connection to the server 127.0.0.1:38225 was refused - did you specify the right host or port?

2022-06-24T08:27:46Z    INFO    io/io.go:425    + kubectl -n default get packageinstall cert-manager

2022-06-24T08:27:46Z    INFO    io/io.go:425    The connection to the server 127.0.0.1:38225 was refused - did you specify the right host or port?

2022-06-24T08:27:51Z    INFO    io/io.go:425    + kubectl -n default get packageinstall cert-manager

2022-06-24T08:27:51Z    INFO    io/io.go:425    The connection to the server 127.0.0.1:38225 was refused - did you specify the right host or port?

2022-06-24T08:27:56Z    INFO    io/io.go:425    + kubectl -n default get packageinstall cert-manager

2022-06-24T08:27:56Z    INFO    io/io.go:425    The connection to the server 127.0.0.1:38225 was refused - did you specify the right host or port?

2022-06-24T08:28:01Z    INFO    io/io.go:425    + kubectl -n default get packageinstall cert-manager

2022-06-24T08:28:01Z    INFO    io/io.go:425    The connection to the server 127.0.0.1:38225 was refused - did you specify the right host or port?

2022-06-24T08:28:06Z    INFO    io/io.go:425    + kubectl -n default get packageinstall cert-manager

2022-06-24T08:28:06Z    INFO    io/io.go:425    The connection to the server 127.0.0.1:38225 was refused - did you specify the right host or port?

2022-06-24T08:28:11Z    INFO    io/io.go:425    + kubectl -n default get packageinstall cert-manager

2022-06-24T08:28:12Z    INFO    io/io.go:425    The connection to the server 127.0.0.1:38225 was refused - did you specify the right host or port?

2022-06-24T08:28:17Z    INFO    io/io.go:425    + kubectl -n default get packageinstall cert-manager

2022-06-24T08:28:17Z    INFO    io/io.go:425    The connection to the server 127.0.0.1:38225 was refused - did you specify the right host or port?

2022-06-24T08:28:22Z    INFO    io/io.go:425    + kubectl -n default get packageinstall cert-manager

2022-06-24T08:28:22Z    INFO    io/io.go:425    The connection to the server 127.0.0.1:38225 was refused - did you specify the right host or port?

2022-06-24T08:28:27Z    INFO    io/io.go:425    + kubectl -n default get packageinstall cert-manager

2022-06-24T08:28:27Z    INFO    io/io.go:425    The connection to the server 127.0.0.1:38225 was refused - did you specify the right host or port?

2022-06-24T08:28:32Z    INFO    io/io.go:425    + kubectl -n default get packageinstall cert-manager

2022-06-24T08:28:32Z    INFO    io/io.go:425    The connection to the server 127.0.0.1:38225 was refused - did you specify the right host or port?

2022-06-24T08:28:35Z    INFO    io/io.go:425    Failure [120.004 seconds]
[AfterSuite] AfterSuite 
/home/ubuntu/tce-e2e-test/community-edition/addons/packages/cert-manager/1.8.0/test/e2e/cert_manager_suite_test.go:68

  Timed out after 120.003s.
  default/cert-manager packageinstall was never deleted
  Expected
      <*errors.errorString | 0xc000054aa0>: {
          s: "The connection to the server 127.0.0.1:38225 was refused - did you specify the right host or port?\n\nexit status: 1",
      }
  to match error
      <*matchers.OrMatcher | 0xc000282210>: {
          Matchers: [
              <*matchers.ContainSubstringMatcher | 0xc0002821b0>{
                  Substr: "packageinstalls.packaging.carvel.dev \"cert-manager\" not found",
                  Args: nil,
              },
              <*matchers.ContainSubstringMatcher | 0xc0002821e0>{
                  Substr: "namespaces \"default\" not found",
                  Args: nil,
              },
          ],
          firstSuccessfulMatcher: nil,
      }

  /home/ubuntu/tce-e2e-test/community-edition/addons/packages/cert-manager/1.8.0/test/e2e/cert_manager_suite_test.go:79
------------------------------

2022-06-24T08:28:35Z    INFO    io/io.go:425    
Ran 1 of 0 Specs in 120.145 seconds
FAIL! -- 0 Passed | 1 Failed | 0 Pending | 0 Skipped
--- FAIL: Test (120.15s)
FAIL

2022-06-24T08:28:35Z    INFO    io/io.go:425    
Ginkgo ran 1 suite in 2m0.751342319s
Test Suite Failed

2022-06-24T08:28:35Z    ERROR   io/io.go:425    exit status 1

2022-06-24T08:28:35Z    ERROR   io/io.go:425    make: *** [Makefile:25: e2e-test] Error 1

2022-06-24T08:28:35Z    INFO    clirunner/run.go:29 Error occurred while running the command `/usr/bin/make e2e-test`: exit status 2
2022-06-24T08:28:35Z    ERROR   utils/common.go:333 Error occurred while E2E test for cert-manager. Exit code: 2. Error: exit status 2
2022-06-24T08:28:35Z    INFO    clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster delete test-wkld-1656058052 --yes`
2022-06-24T08:28:36Z    ERROR   io/io.go:425    Workload cluster 'test-wkld-1656058052' is being deleted 

2022-06-24T08:28:36Z    INFO    clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-24T08:28:36Z    INFO    utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-24T08:28:46Z    INFO    clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-24T08:28:46Z    INFO    utils/cluster_test_runner.go:267    Workload cluster test-wkld-1656058052 successfully deleted

2022-06-24T08:28:46Z    INFO    clirunner/run.go:24 Running the command `/usr/local/bin/tanzu management-cluster delete test-mgmt-1656058052 --yes`
2022-06-24T08:28:47Z    ERROR   io/io.go:425    Verifying management cluster...

2022-06-24T08:28:47Z    ERROR   io/io.go:425    Setting up cleanup cluster...

2022-06-24T08:29:45Z    ERROR   io/io.go:425    Installing providers to cleanup cluster...

2022-06-24T08:29:45Z    ERROR   io/io.go:425    Fetching providers

2022-06-24T08:29:46Z    ERROR   io/io.go:425    Installing cert-manager Version="v1.5.3"

2022-06-24T08:29:47Z    ERROR   io/io.go:425    Waiting for cert-manager to be available...

2022-06-24T08:30:03Z    ERROR   io/io.go:425    Installing Provider="cluster-api" Version="v1.0.1" TargetNamespace="capi-system"

2022-06-24T08:30:04Z    ERROR   io/io.go:425    Installing Provider="bootstrap-kubeadm" Version="v1.0.1" TargetNamespace="capi-kubeadm-bootstrap-system"

2022-06-24T08:30:04Z    ERROR   io/io.go:425    Installing Provider="control-plane-kubeadm" Version="v1.0.1" TargetNamespace="capi-kubeadm-control-plane-system"

2022-06-24T08:30:06Z    ERROR   io/io.go:425    Installing Provider="infrastructure-docker" Version="v1.0.1" TargetNamespace="capd-system"

2022-06-24T08:30:17Z    ERROR   io/io.go:425    Moving Cluster API objects from management cluster to cleanup cluster...

2022-06-24T08:30:17Z    ERROR   io/io.go:425    Performing move...

2022-06-24T08:30:17Z    ERROR   io/io.go:425    Discovering Cluster API objects

2022-06-24T08:30:18Z    ERROR   io/io.go:425    Moving Cluster API objects Clusters=1

2022-06-24T08:30:18Z    ERROR   io/io.go:425    Creating objects in the target cluster

2022-06-24T08:30:21Z    ERROR   io/io.go:425    Deleting objects from the source cluster

2022-06-24T08:30:24Z    ERROR   io/io.go:425    Waiting for the Cluster API objects to get ready after move...

2022-06-24T08:30:34Z    ERROR   io/io.go:425    Deleting management cluster...

2022-06-24T08:30:44Z    ERROR   io/io.go:425    Management cluster 'test-mgmt-1656058052' deleted.
Deleting the management cluster context from the kubeconfig file '/home/ubuntu/.kube/config'

2022-06-24T08:30:46Z    ERROR   io/io.go:425    
Management cluster deleted!

ubuntu@ip-10-0-0-128:~/tce-e2e-test/2022-06-24-logs$ 
aman556 commented 2 years ago

Cert-manager E2E test passed after hooking in cluster lifecycle test on azure environment. Here are the logs.

2022-06-27T11:05:35Z    INFO   utils/common.go:41  Checking tanzu CLI installation
2022-06-27T11:05:35Z    INFO   utils/common.go:47  tanzu CLI is available at path: /usr/local/bin/tanzu
2022-06-27T11:05:35Z    INFO   utils/common.go:62  Checking tanzu management cluster plugin CLI installation
2022-06-27T11:05:35Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu management-cluster version`
2022-06-27T11:05:36Z    INFO   io/io.go:425    v0.11.4

2022-06-27T11:05:36Z    INFO   utils/common.go:62  Checking tanzu management cluster plugin CLI installation
2022-06-27T11:05:36Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster version`
2022-06-27T11:05:36Z    INFO   io/io.go:425    v0.11.4

2022-06-27T11:05:36Z    INFO   docker/docker.go:29 Checking docker CLI and Docker Engine installation
2022-06-27T11:05:37Z    INFO   docker/docker.go:44 docker CLI is available at path: /usr/local/bin/docker
2022-06-27T11:05:37Z    INFO   docker/docker.go:45 E2E test Docker client's API version: 1.41
2022-06-27T11:05:37Z    INFO   docker/docker.go:46 Docker Engine's API version: 1.41
2022-06-27T11:05:37Z    INFO   docker/docker.go:47 Docker Engine's version: 20.10.5
2022-06-27T11:05:37Z    INFO   utils/common.go:52  Checking kubectl CLI installation
2022-06-27T11:05:37Z    INFO   utils/common.go:58  kubectl CLI is available at path: /usr/local/bin/kubectl

2022-06-27T11:05:37Z    INFO   testutils/common.go:17  Checking required environment variables
2022-06-27T11:05:37Z    INFO   testutils/common.go:17  Checking required environment variables
2022-06-27T11:05:37Z    INFO   azure/secrets.go:27 Extracting Azure test secrets from environment variables
2022-06-27T11:05:37Z    INFO   testutils/common.go:17  Checking required environment variables
2022-06-27T11:05:37Z    INFO   azure/secrets.go:27 Extracting Azure test secrets from environment variables
2022-06-27T11:05:37Z    INFO   azure/login.go:13   Logging into Azure
2022-06-27T11:05:37Z    INFO   utils/cluster_test_runner.go:58 Management Cluster Name : test-mgmt-1656327937
2022-06-27T11:05:37Z    INFO   utils/cluster_test_runner.go:59 Workload Cluster Name : test-wkld-1656327937
2022-06-27T11:05:37Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu management-cluster create test-mgmt-1656327937 --dry-run`
2022-06-27T11:05:37Z    ERROR  io/io.go:425    
Validating the pre-requisites...

2022-06-27T11:05:39Z    ERROR  io/io.go:425    Identity Provider not configured. Some authentication features won't work.

2022-06-27T11:05:39Z    ERROR  io/io.go:425    Using default value for CONTROL_PLANE_MACHINE_COUNT = 1. Reason: CONTROL_PLANE_MACHINE_COUNT variable is not set

2022-06-27T11:05:39Z    ERROR  io/io.go:425    Using default value for WORKER_MACHINE_COUNT = 1. Reason: WORKER_MACHINE_COUNT variable is not set

2022-06-27T11:05:41Z    ERROR  io/io.go:425    Using default value for CONTROL_PLANE_MACHINE_COUNT = 1. Reason: CONTROL_PLANE_MACHINE_COUNT variable is not set

2022-06-27T11:05:43Z    ERROR  io/io.go:425    Checking for required plugins...

2022-06-27T11:05:48Z    ERROR  io/io.go:425    unable to list plugin from discovery 'default-test-mgmt-1656045827': unable to get client: Failed to invoke API on cluster : Get "https://127.0.0.1:55071/version?timeout=32s": dial tcp 127.0.0.1:55071: connect: connection refused

2022-06-27T11:05:48Z    ERROR  io/io.go:425    All required plugins are already installed and up-to-date

2022-06-27T11:05:48Z    INFO   azure/marketplace_image.go:49   Getting marketplace terms for Azure VM image
2022-06-27T11:05:54Z    INFO   azure/marketplace_image.go:71   Azure VM image agreement terms are already accepted
2022-06-27T11:05:54Z    INFO   azure/marketplace_image.go:49   Getting marketplace terms for Azure VM image
2022-06-27T11:05:59Z    INFO   azure/marketplace_image.go:71   Azure VM image agreement terms are already accepted
2022-06-27T11:05:59Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu management-cluster create test-mgmt-1656327937`
2022-06-27T11:05:59Z    ERROR  io/io.go:425    
Validating the pre-requisites...

2022-06-27T11:06:00Z    ERROR  io/io.go:425    Identity Provider not configured. Some authentication features won't work.

2022-06-27T11:06:00Z    ERROR  io/io.go:425    Using default value for CONTROL_PLANE_MACHINE_COUNT = 1. Reason: CONTROL_PLANE_MACHINE_COUNT variable is not set

2022-06-27T11:06:00Z    ERROR  io/io.go:425    Using default value for WORKER_MACHINE_COUNT = 1. Reason: WORKER_MACHINE_COUNT variable is not set

2022-06-27T11:06:02Z    ERROR  io/io.go:425    
Setting up management cluster...

2022-06-27T11:06:02Z    ERROR  io/io.go:425    Validating configuration...

2022-06-27T11:06:03Z    ERROR  io/io.go:425    Using infrastructure provider azure:v1.0.2
Generating cluster configuration...

2022-06-27T11:06:03Z    ERROR  io/io.go:425    Using default value for CONTROL_PLANE_MACHINE_COUNT = 1. Reason: CONTROL_PLANE_MACHINE_COUNT variable is not set

2022-06-27T11:06:06Z    ERROR  io/io.go:425    Setting up bootstrapper...

2022-06-27T11:14:02Z    ERROR  io/io.go:425    Bootstrapper created. Kubeconfig: /Users/amansha/.kube-tkg/tmp/config_RHAUcVkt

2022-06-27T11:14:03Z    ERROR  io/io.go:425    Installing providers on bootstrapper...

2022-06-27T11:14:08Z    ERROR  io/io.go:425    Fetching providers

2022-06-27T11:14:26Z    ERROR  io/io.go:425    Installing cert-manager Version="v1.5.3"

2022-06-27T11:14:50Z    ERROR  io/io.go:425    Waiting for cert-manager to be available...

2022-06-27T11:19:13Z    ERROR  io/io.go:425    Installing Provider="cluster-api" Version="v1.0.1" TargetNamespace="capi-system"

2022-06-27T11:19:44Z    ERROR  io/io.go:425    Installing Provider="bootstrap-kubeadm" Version="v1.0.1" TargetNamespace="capi-kubeadm-bootstrap-system"

2022-06-27T11:20:20Z    ERROR  io/io.go:425    Installing Provider="control-plane-kubeadm" Version="v1.0.1" TargetNamespace="capi-kubeadm-control-plane-system"

2022-06-27T11:20:24Z    ERROR  io/io.go:425    Installing Provider="infrastructure-azure" Version="v1.0.2" TargetNamespace="capz-system"

2022-06-27T11:29:30Z    ERROR  io/io.go:425    Start creating management cluster...

2022-06-27T11:30:17Z    ERROR  io/io.go:425    [cluster control plane is still being initialized: WaitingForControlPlane, cluster infrastructure is still being provisioned: WaitingForControlPlane]

2022-06-27T11:32:02Z    ERROR  io/io.go:425    cluster control plane is still being initialized: WaitingForControlPlane

2022-06-27T11:32:17Z    ERROR  io/io.go:425    cluster control plane is still being initialized: WaitingForKubeadmInit

2022-06-27T11:32:32Z    ERROR  io/io.go:425    cluster control plane is still being initialized: WaitingForInfrastructure @ Machine/test-mgmt-1656327937-control-plane-zfvkm

2022-06-27T11:34:02Z    ERROR  io/io.go:425    cluster control plane is still being initialized: VMUpdating @ Machine/test-mgmt-1656327937-control-plane-zfvkm

2022-06-27T11:34:32Z    ERROR  io/io.go:425    Saving management cluster kubeconfig into /Users/amansha/.kube/config

2022-06-27T11:34:33Z    ERROR  io/io.go:425    Installing providers on management cluster...

2022-06-27T11:34:37Z    ERROR  io/io.go:425    Fetching providers

2022-06-27T11:34:41Z    ERROR  io/io.go:425    Installing cert-manager Version="v1.5.3"

2022-06-27T11:35:43Z    ERROR  io/io.go:425    Waiting for cert-manager to be available...

2022-06-27T11:37:44Z    ERROR  io/io.go:425    Installing Provider="cluster-api" Version="v1.0.1" TargetNamespace="capi-system"

2022-06-27T11:38:06Z    ERROR  io/io.go:425    Installing Provider="bootstrap-kubeadm" Version="v1.0.1" TargetNamespace="capi-kubeadm-bootstrap-system"

2022-06-27T11:38:19Z    ERROR  io/io.go:425    Installing Provider="control-plane-kubeadm" Version="v1.0.1" TargetNamespace="capi-kubeadm-control-plane-system"

2022-06-27T11:38:34Z    ERROR  io/io.go:425    Installing Provider="infrastructure-azure" Version="v1.0.2" TargetNamespace="capz-system"

2022-06-27T11:39:20Z    ERROR  io/io.go:425    Waiting for the management cluster to get ready for move...

2022-06-27T11:39:20Z    ERROR  io/io.go:425    Waiting for addons installation...

2022-06-27T11:39:20Z    ERROR  io/io.go:425    Moving all Cluster API objects from bootstrap cluster to management cluster...

2022-06-27T11:39:23Z    ERROR  io/io.go:425    Performing move...

2022-06-27T11:39:24Z    ERROR  io/io.go:425    Discovering Cluster API objects

2022-06-27T11:39:25Z    ERROR  io/io.go:425    Moving Cluster API objects Clusters=1

2022-06-27T11:39:26Z    ERROR  io/io.go:425    Creating objects in the target cluster

2022-06-27T11:40:11Z    ERROR  io/io.go:425    Deleting objects from the source cluster

2022-06-27T11:40:17Z    ERROR  io/io.go:425    Waiting for additional components to be up and running...

2022-06-27T11:40:17Z    ERROR  io/io.go:425    Waiting for packages to be up and running...

2022-06-27T11:41:27Z    ERROR  io/io.go:425    You can now access the management cluster test-mgmt-1656327937 by running 'kubectl config use-context test-mgmt-1656327937-admin@test-mgmt-1656327937'

2022-06-27T11:43:14Z    ERROR  io/io.go:425    
Management cluster created!

2022-06-27T11:43:14Z    ERROR  io/io.go:425    
You can now create your first workload cluster by running the following:

  tanzu cluster create [name] -f [file]

Some addons might be getting installed! Check their status by running the following:

  kubectl get apps -A

2022-06-27T11:43:14Z    ERROR  io/io.go:425    Checking for required plugins...

2022-06-27T11:43:17Z    ERROR  io/io.go:425    All required plugins are already installed and up-to-date

2022-06-27T11:43:17Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu management-cluster kubeconfig get test-mgmt-1656327937 --admin`
2022-06-27T11:43:21Z    ERROR  io/io.go:425    Credentials of cluster 'test-mgmt-1656327937' have been saved 
You can now access the cluster by running 'kubectl config use-context test-mgmt-1656327937-admin@test-mgmt-1656327937'

2022-06-27T11:43:22Z    INFO   utils/common.go:267 Management Cluster test-mgmt-1656327937 Information: 
2022-06-27T11:43:22Z    INFO   utils/cluster_test_runner.go:150    Kubernetes API server version is v1.22.8+vmware.1
2022-06-27T11:43:22Z    INFO   utils/cluster_test_runner.go:162    Pod Name    Pod Namespace   Pod Phase
2022-06-27T11:43:22Z    INFO   utils/cluster_test_runner.go:165    capi-kubeadm-bootstrap-controller-manager-79b888f8b9-rmhsh  capi-kubeadm-bootstrap-system   Running
2022-06-27T11:43:22Z    INFO   utils/cluster_test_runner.go:165    capi-kubeadm-control-plane-controller-manager-84b9bd7564-x6wz8  capi-kubeadm-control-plane-system   Running
2022-06-27T11:43:22Z    INFO   utils/cluster_test_runner.go:165    capi-controller-manager-69d6d968ff-r6rq4    capi-system Running
2022-06-27T11:43:22Z    INFO   utils/cluster_test_runner.go:165    capz-controller-manager-964bb45f-fc65s  capz-system Running
2022-06-27T11:43:22Z    INFO   utils/cluster_test_runner.go:165    capz-nmi-rdkbq  capz-system Running
2022-06-27T11:43:22Z    INFO   utils/cluster_test_runner.go:165    cert-manager-84bb9684d6-jj82z   cert-manager    Running
2022-06-27T11:43:22Z    INFO   utils/cluster_test_runner.go:165    cert-manager-cainjector-6767468f75-b88gd    cert-manager    Running
2022-06-27T11:43:22Z    INFO   utils/cluster_test_runner.go:165    cert-manager-webhook-588bb4546d-p5v4m   cert-manager    Running
2022-06-27T11:43:22Z    INFO   utils/cluster_test_runner.go:165    antrea-agent-lg5nv  kube-system Running
2022-06-27T11:43:22Z    INFO   utils/cluster_test_runner.go:165    antrea-agent-n4ssl  kube-system Running
2022-06-27T11:43:22Z    INFO   utils/cluster_test_runner.go:165    antrea-controller-678444b576-crm54  kube-system Running
2022-06-27T11:43:22Z    INFO   utils/cluster_test_runner.go:165    coredns-67c8559bb6-cpsvm    kube-system Running
2022-06-27T11:43:22Z    INFO   utils/cluster_test_runner.go:165    coredns-67c8559bb6-p7v9k    kube-system Running
2022-06-27T11:43:22Z    INFO   utils/cluster_test_runner.go:165    etcd-test-mgmt-1656327937-control-plane-c6z6d   kube-system Running
2022-06-27T11:43:22Z    INFO   utils/cluster_test_runner.go:165    kube-apiserver-test-mgmt-1656327937-control-plane-c6z6d kube-system Running
2022-06-27T11:43:22Z    INFO   utils/cluster_test_runner.go:165    kube-controller-manager-test-mgmt-1656327937-control-plane-c6z6d    kube-system Running
2022-06-27T11:43:22Z    INFO   utils/cluster_test_runner.go:165    kube-proxy-bsdz7    kube-system Running
2022-06-27T11:43:22Z    INFO   utils/cluster_test_runner.go:165    kube-proxy-zcqc4    kube-system Running
2022-06-27T11:43:22Z    INFO   utils/cluster_test_runner.go:165    kube-scheduler-test-mgmt-1656327937-control-plane-c6z6d kube-system Running
2022-06-27T11:43:22Z    INFO   utils/cluster_test_runner.go:165    metrics-server-56dc4c89f4-g8z7j kube-system Running
2022-06-27T11:43:22Z    INFO   utils/cluster_test_runner.go:165    secretgen-controller-6c48968f65-hkgwv   tanzu-system    Running
2022-06-27T11:43:22Z    INFO   utils/cluster_test_runner.go:165    kapp-controller-6dfdb867b5-g45sq    tkg-system  Running
2022-06-27T11:43:22Z    INFO   utils/cluster_test_runner.go:165    tanzu-addons-controller-manager-87bfc4468-vzx98 tkg-system  Running
2022-06-27T11:43:22Z    INFO   utils/cluster_test_runner.go:165    tanzu-capabilities-controller-manager-757c67756-mx2rs   tkg-system  Running
2022-06-27T11:43:22Z    INFO   utils/cluster_test_runner.go:165    tanzu-featuregates-controller-manager-69d94697d4-6nbbf  tkg-system  Running
2022-06-27T11:43:22Z    INFO   utils/cluster_test_runner.go:165    tkr-controller-manager-9b77f4678-sjph8  tkr-system  Running
2022-06-27T11:43:23Z    INFO   utils/cluster_test_runner.go:173    

Node Name   Node Phase
2022-06-27T11:43:23Z    INFO   utils/cluster_test_runner.go:176    test-mgmt-1656327937-control-plane-c6z6d    
2022-06-27T11:43:23Z    INFO   utils/cluster_test_runner.go:176    test-mgmt-1656327937-md-0-px7tk 
2022-06-27T11:43:23Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster create test-wkld-1656327937 --dry-run`
2022-06-27T11:43:51Z    ERROR  io/io.go:425    Warning: Pinniped configuration not found. Skipping pinniped configuration in workload cluster. Please refer to the documentation to check if you can configure pinniped on workload cluster manually

2022-06-27T11:43:58Z    INFO   azure/marketplace_image.go:49   Getting marketplace terms for Azure VM image
2022-06-27T11:44:02Z    INFO   azure/marketplace_image.go:71   Azure VM image agreement terms are already accepted
2022-06-27T11:44:02Z    INFO   azure/marketplace_image.go:49   Getting marketplace terms for Azure VM image
2022-06-27T11:44:07Z    INFO   azure/marketplace_image.go:71   Azure VM image agreement terms are already accepted
2022-06-27T11:44:07Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster create test-wkld-1656327937`
2022-06-27T11:44:08Z    ERROR  io/io.go:425    Validating configuration...

2022-06-27T11:44:35Z    ERROR  io/io.go:425    Warning: Pinniped configuration not found. Skipping pinniped configuration in workload cluster. Please refer to the documentation to check if you can configure pinniped on workload cluster manually

2022-06-27T11:44:40Z    ERROR  io/io.go:425    Creating workload cluster 'test-wkld-1656327937'...

2022-06-27T11:44:56Z    ERROR  io/io.go:425    Waiting for cluster to be initialized...

2022-06-27T11:44:57Z    ERROR  io/io.go:425    [cluster control plane is still being initialized: WaitingForControlPlane, cluster infrastructure is still being provisioned: WaitingForControlPlane]

2022-06-27T11:45:43Z    ERROR  io/io.go:425    cluster control plane is still being initialized: WaitingForKubeadmInit

2022-06-27T11:46:13Z    ERROR  io/io.go:425    cluster control plane is still being initialized: WaitingForInfrastructure @ Machine/test-wkld-1656327937-control-plane-r5xzr

2022-06-27T11:46:43Z    ERROR  io/io.go:425    cluster control plane is still being initialized: VMUpdating @ Machine/test-wkld-1656327937-control-plane-r5xzr

2022-06-27T11:47:28Z    ERROR  io/io.go:425    Waiting for cluster nodes to be available...

2022-06-27T11:49:00Z    ERROR  io/io.go:425    Waiting for addons installation...

2022-06-27T11:49:02Z    ERROR  io/io.go:425    Waiting for packages to be up and running...

2022-06-27T11:49:42Z    ERROR  io/io.go:425    
Workload cluster 'test-wkld-1656327937' created

2022-06-27T11:49:42Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-27T11:49:45Z    INFO   utils/cluster_test_runner.go:210    Workload cluster test-wkld-1656327937 is running successfully

2022-06-27T11:49:45Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster kubeconfig get test-wkld-1656327937 --admin`
2022-06-27T11:49:48Z    ERROR  io/io.go:425    Credentials of cluster 'test-wkld-1656327937' have been saved 
You can now access the cluster by running 'kubectl config use-context test-wkld-1656327937-admin@test-wkld-1656327937'

2022-06-27T11:49:48Z    INFO   utils/common.go:296 Workload Cluster test-wkld-1656327937 Information: 
2022-06-27T11:49:49Z    INFO   utils/cluster_test_runner.go:150    Kubernetes API server version is v1.22.8+vmware.1
2022-06-27T11:49:49Z    INFO   utils/cluster_test_runner.go:162    Pod Name    Pod Namespace   Pod Phase
2022-06-27T11:49:49Z    INFO   utils/cluster_test_runner.go:165    antrea-agent-6r6cr  kube-system Running
2022-06-27T11:49:49Z    INFO   utils/cluster_test_runner.go:165    antrea-agent-z9p26  kube-system Running
2022-06-27T11:49:49Z    INFO   utils/cluster_test_runner.go:165    antrea-controller-7599f8cbb9-vm8pt  kube-system Running
2022-06-27T11:49:49Z    INFO   utils/cluster_test_runner.go:165    coredns-67c8559bb6-dqlkc    kube-system Running
2022-06-27T11:49:49Z    INFO   utils/cluster_test_runner.go:165    coredns-67c8559bb6-rgs2k    kube-system Running
2022-06-27T11:49:49Z    INFO   utils/cluster_test_runner.go:165    etcd-test-wkld-1656327937-control-plane-cjh9r   kube-system Running
2022-06-27T11:49:49Z    INFO   utils/cluster_test_runner.go:165    kube-apiserver-test-wkld-1656327937-control-plane-cjh9r kube-system Running
2022-06-27T11:49:49Z    INFO   utils/cluster_test_runner.go:165    kube-controller-manager-test-wkld-1656327937-control-plane-cjh9r    kube-system Running
2022-06-27T11:49:49Z    INFO   utils/cluster_test_runner.go:165    kube-proxy-cbwhd    kube-system Running
2022-06-27T11:49:49Z    INFO   utils/cluster_test_runner.go:165    kube-proxy-ttlcs    kube-system Running
2022-06-27T11:49:49Z    INFO   utils/cluster_test_runner.go:165    kube-scheduler-test-wkld-1656327937-control-plane-cjh9r kube-system Running
2022-06-27T11:49:49Z    INFO   utils/cluster_test_runner.go:165    metrics-server-5d7f9dfcf6-vf7mg kube-system Running
2022-06-27T11:49:49Z    INFO   utils/cluster_test_runner.go:165    secretgen-controller-6dc5459dbb-8vckx   tanzu-system    Running
2022-06-27T11:49:49Z    INFO   utils/cluster_test_runner.go:165    kapp-controller-fb65bd6d6-2v7w8 tkg-system  Running
2022-06-27T11:49:49Z    INFO   utils/cluster_test_runner.go:165    tanzu-capabilities-controller-manager-757c67756-6zlqf   tkg-system  Running
2022-06-27T11:49:50Z    INFO   utils/cluster_test_runner.go:173    

Node Name   Node Phase
2022-06-27T11:49:50Z    INFO   utils/cluster_test_runner.go:176    test-wkld-1656327937-control-plane-cjh9r    
2022-06-27T11:49:50Z    INFO   utils/cluster_test_runner.go:176    test-wkld-1656327937-md-0-7fm4f 
2022-06-27T11:49:50Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/kubectl config use-context test-wkld-1656327937-admin@test-wkld-1656327937`
2022-06-27T11:49:50Z    INFO   io/io.go:425    Switched to context "test-wkld-1656327937-admin@test-wkld-1656327937".

2022-06-27T11:49:50Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu package repository add tce-repo --url projects.registry.vmware.com/tce/main:0.12.0 --namespace tanzu-package-repo-global`
2022-06-27T11:49:52Z    ERROR  io/io.go:425    I0627 17:19:52.772879   13834 request.go:665] Waited for 1.002023186s due to client-side throttling, not priority and fairness, request: GET:https://test-wkld-1656327937-c765f4ad.australiaeast.cloudapp.azure.com:6443/apis/secretgen.k14s.io/v1alpha1?timeout=32s

2022-06-27T11:50:09Z    ERROR  io/io.go:425    Added package repository 'tce-repo' in namespace 'tanzu-package-repo-global'

2022-06-27T11:50:09Z    INFO   clirunner/run.go:24 Running the command `/usr/bin/make e2e-test`
2022-06-27T11:50:09Z    INFO   io/io.go:425    CGO_ENABLED=0 go run github.com/onsi/ginkgo/ginkgo -v e2e

2022-06-27T11:50:13Z    INFO   io/io.go:425    Running Suite: cert-manager Package E2E Test Suite
==================================================
Random Seed: 1656330611
Will run 1 of 1 specs

2022-06-27T11:50:13Z    INFO   io/io.go:425    STEP: installing cert-manager package

2022-06-27T11:50:13Z    INFO   io/io.go:425    + tanzu package available list -o json

2022-06-27T11:50:22Z    INFO   io/io.go:425    [
  {
    "display-name": "App-Toolkit package for TCE",
    "latest-version": "0.2.0",
    "name": "app-toolkit.community.tanzu.vmware.com",
    "short-description": "Kubernetes-native toolkit to support application lifecycle"
  },
  {
    "display-name": "Cartographer Catalog",
    "latest-version": "0.3.0",
    "name": "cartographer-catalog.community.tanzu.vmware.com",
    "short-description": "Reusable Cartographer blueprints"
  },
  {
    "display-name": "Cartographer",
    "latest-version": "0.3.0",
    "name": "cartographer.community.tanzu.vmware.com",
    "short-description": "Kubernetes native Supply Chain Choreographer."
  },
  {
    "display-name": "cert-injection-webhook",
    "latest-version": "0.1.1",
    "name": "cert-injection-webhook.community.tanzu.vmware.com",
    "short-description": "The Cert Injection Webhook injects CA certificates and proxy environment variables into pods"
  },
  {
    "display-name": "cert-manager",
    "latest-version": "1.8.0",
    "name": "cert-manager.community.tanzu.vmware.com",
    "short-description": "Certificate management"
  },
  {
    "display-name": "contour",
    "latest-version": "1.20.1",
    "name": "contour.community.tanzu.vmware.com",
    "short-description": "An ingress controller"
  },
  {
    "display-name": "external-dns",
    "latest-version": "0.10.0",
    "name": "external-dns.community.tanzu.vmware.com",
    "short-description": "This package provides DNS synchronization functionality."
  },
  {
    "display-name": "fluent-bit",
    "latest-version": "1.7.5",
    "name": "fluent-bit.community.tanzu.vmware.com",
    "short-description": "Fluent Bit is a fast Log Processor and Forwarder"
  },
  {
    "display-name": "Flux Source Controller",
    "latest-version": "0.21.5",
    "name": "fluxcd-source-controller.community.tanzu.vmware.com",
    "short-description": "The source-controller is a Kubernetes operator, specialised in artifacts acquisition from external sources such as Git, Helm repositories and S3 buckets."
  },
  {
    "display-name": "gatekeeper",
    "latest-version": "3.7.1",
    "name": "gatekeeper.community.tanzu.vmware.com",
    "short-description": "policy management"
  },
  {
    "display-name": "grafana",
    "latest-version": "7.5.11",
    "name": "grafana.community.tanzu.vmware.com",
    "short-description": "Visualization and analytics software"
  },
  {
    "display-name": "harbor",
    "latest-version": "2.4.2",
    "name": "harbor.community.tanzu.vmware.com",
    "short-description": "OCI Registry"
  },
  {
    "display-name": "Flux Helm Controller",
    "latest-version": "0.17.2",
    "name": "helm-controller.fluxcd.community.tanzu.vmware.com",
    "short-description": "The Helm Controller is a Kubernetes operator, allowing one to declaratively manage Helm chart releases with Kubernetes manifests."
  },
  {
    "display-name": "knative-serving",
    "latest-version": "1.0.0",
    "name": "knative-serving.community.tanzu.vmware.com",
    "short-description": "Knative Serving builds on Kubernetes to support deploying and serving of applications and functions as serverless containers"
  },
  {
    "display-name": "kpack dependencies",
    "latest-version": "0.0.27",
    "name": "kpack-dependencies.community.tanzu.vmware.com",
    "short-description": "Dependencies in the form of Buildpacks and Stacks for the kpack package"
  },
  {
    "display-name": "kpack",
    "latest-version": "0.5.3",
    "name": "kpack.community.tanzu.vmware.com",
    "short-description": "kpack builds application source code into OCI compliant images using Cloud Native Buildpacks"
  },
  {
    "display-name": "Flux Kustomize Controller",
    "latest-version": "0.21.1",
    "name": "kustomize-controller.fluxcd.community.tanzu.vmware.com",
    "short-description": "Kustomize controller is one of the components in GitOps toolkit."
  },
  {
    "display-name": "local-path-storage",
    "latest-version": "0.0.22",
    "name": "local-path-storage.community.tanzu.vmware.com",
    "short-description": "This package provides local path node storage and primarily supports RWO AccessMode."
  },
  {
    "display-name": "multus-cni",
    "latest-version": "3.8.0",
    "name": "multus-cni.community.tanzu.vmware.com",
    "short-description": "This package provides the ability for enabling attaching multiple network interfaces to pods in Kubernetes"
  },
  {
    "display-name": "prometheus",
    "latest-version": "2.27.0-1",
    "name": "prometheus.community.tanzu.vmware.com",
    "short-description": "A time series database for your metrics"
  },
  {
    "display-name": "velero",
    "latest-version": "1.8.0",
    "name": "velero.community.tanzu.vmware.com",
    "short-description": "Disaster recovery capabilities"
  },
  {
    "display-name": "whereabouts",
    "latest-version": "0.5.1",
    "name": "whereabouts.community.tanzu.vmware.com",
    "short-description": "A CNI IPAM plugin that assigns IP addresses cluster-wide"
  }
]

2022-06-27T11:50:22Z    INFO   io/io.go:425    + tanzu package available list cert-manager.community.tanzu.vmware.com -o json

2022-06-27T11:50:25Z    INFO   io/io.go:425    [
  {
    "name": "cert-manager.community.tanzu.vmware.com",
    "released-at": "2021-08-23 22:52:51 +0530 IST",
    "version": "1.5.4"
  },
  {
    "name": "cert-manager.community.tanzu.vmware.com",
    "released-at": "2021-08-23 22:52:51 +0530 IST",
    "version": "1.5.5"
  },
  {
    "name": "cert-manager.community.tanzu.vmware.com",
    "released-at": "2021-10-29 17:30:00 +0530 IST",
    "version": "1.6.1"
  },
  {
    "name": "cert-manager.community.tanzu.vmware.com",
    "released-at": "2021-10-29 17:30:00 +0530 IST",
    "version": "1.6.3"
  },
  {
    "name": "cert-manager.community.tanzu.vmware.com",
    "released-at": "2021-10-29 17:30:00 +0530 IST",
    "version": "1.7.2"
  },
  {
    "name": "cert-manager.community.tanzu.vmware.com",
    "released-at": "2021-10-29 17:30:00 +0530 IST",
    "version": "1.8.0"
  }
]

2022-06-27T11:50:25Z    INFO   io/io.go:425    + tanzu package install cert-manager --poll-interval 10s --poll-timeout 20m --namespace default --package-name cert-manager.community.tanzu.vmware.com --version 1.8.0 --values-file fixtures/values.yaml

2022-06-27T11:51:09Z    INFO   io/io.go:425    
STEP: validating cert-manager package is reconciled

2022-06-27T11:51:09Z    INFO   io/io.go:425    + kubectl -n default get packageinstalls cert-manager -o jsonpath={.status.conditions[?(@.type == 'ReconcileSucceeded')].status}

2022-06-27T11:51:13Z    INFO   io/io.go:425    True
STEP: wait for cert-manager to be ready

2022-06-27T11:51:13Z    INFO   io/io.go:425    + kubectl get validatingwebhookconfigurations.admissionregistration.k8s.io cert-manager-webhook -o jsonpath={.webhooks[].clientConfig.caBundle}

2022-06-27T11:51:16Z    INFO   io/io.go:425    LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUJ3VENDQVVlZ0F3SUJBZ0lRVkNOeHZJN1ZXTE9BZkxwbkw1aVJVekFLQmdncWhrak9QUVFEQXpBaU1TQXcKSGdZRFZRUURFeGRqWlhKMExXMWhibUZuWlhJdGQyVmlhRzl2YXkxallUQWVGdzB5TWpBMk1qY3hNVFV4TWpOYQpGdzB5TXpBMk1qY3hNVFV4TWpOYU1DSXhJREFlQmdOVkJBTVRGMk5sY25RdGJXRnVZV2RsY2kxM1pXSm9iMjlyCkxXTmhNSFl3RUFZSEtvWkl6ajBDQVFZRks0RUVBQ0lEWWdBRWQvOHJBeHhrbUlCWFd4UTQ2b01vRVJPVzViYjIKZzY1MGQ2NWRmSEZQQ2ZreUFpb1NhL2NZYTdwUWJiT0tBS0dUdXM0QlB5NzVDTnl0U0F0M25pMmIybkRiUVNuOQo4dW1Od2p5MGpNdmJjanFEbXAxWDdjeWlDb2R5QUxqcmhSWk1vMEl3UURBT0JnTlZIUThCQWY4RUJBTUNBcVF3CkR3WURWUjBUQVFIL0JBVXdBd0VCL3pBZEJnTlZIUTRFRmdRVTZ3NE1MdnA4bXRrZXljbnNKYXQ0VVFnUmtla3cKQ2dZSUtvWkl6ajBFQXdNRGFBQXdaUUl4QVBlbi9wYlBjdnlWbDhLYk14VzRQUWswUlhKN2xYaS9CT1prS3pGZwpsMUlHV2NiYUlSRjRHM0dxT3dVK0RoWXpPd0l3WTZYQ2V5VWdldHFFRlN0WlpmZVhvbnZpNis1KzVoc09oV0FnClNvNWNVQlJiVlBJUFVqMmVxVW5pNXIzdkFBREUKLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=
LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUJ3VENDQVVlZ0F3SUJBZ0lRVkNOeHZJN1ZXTE9BZkxwbkw1aVJVekFLQmdncWhrak9QUVFEQXpBaU1TQXcKSGdZRFZRUURFeGRqWlhKMExXMWhibUZuWlhJdGQyVmlhRzl2YXkxallUQWVGdzB5TWpBMk1qY3hNVFV4TWpOYQpGdzB5TXpBMk1qY3hNVFV4TWpOYU1DSXhJREFlQmdOVkJBTVRGMk5sY25RdGJXRnVZV2RsY2kxM1pXSm9iMjlyCkxXTmhNSFl3RUFZSEtvWkl6ajBDQVFZRks0RUVBQ0lEWWdBRWQvOHJBeHhrbUlCWFd4UTQ2b01vRVJPVzViYjIKZzY1MGQ2NWRmSEZQQ2ZreUFpb1NhL2NZYTdwUWJiT0tBS0dUdXM0QlB5NzVDTnl0U0F0M25pMmIybkRiUVNuOQo4dW1Od2p5MGpNdmJjanFEbXAxWDdjeWlDb2R5QUxqcmhSWk1vMEl3UURBT0JnTlZIUThCQWY4RUJBTUNBcVF3CkR3WURWUjBUQVFIL0JBVXdBd0VCL3pBZEJnTlZIUTRFRmdRVTZ3NE1MdnA4bXRrZXljbnNKYXQ0VVFnUmtla3cKQ2dZSUtvWkl6ajBFQXdNRGFBQXdaUUl4QVBlbi9wYlBjdnlWbDhLYk14VzRQUWswUlhKN2xYaS9CT1prS3pGZwpsMUlHV2NiYUlSRjRHM0dxT3dVK0RoWXpPd0l3WTZYQ2V5VWdldHFFRlN0WlpmZVhvbnZpNis1KzVoc09oV0FnClNvNWNVQlJiVlBJUFVqMmVxVW5pNXIzdkFBREUKLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=

2022-06-27T11:51:16Z    INFO   io/io.go:425    cert-manager Package E2E Test 
  works
  /Users/amansha/go/src/github.com/tce-e2e-test/community-edition/addons/packages/cert-manager/1.8.0/test/e2e/cert_manager_test.go:31
+ kubectl apply -f fixtures/cert-manager-resources.yaml

2022-06-27T11:51:20Z    INFO   io/io.go:425    namespace/cert-manager-test created
issuer.cert-manager.io/test-selfsigned created
certificate.cert-manager.io/selfsigned-cert created

+ kubectl delete namespace cert-manager-test

2022-06-27T11:51:26Z    INFO   io/io.go:425    namespace "cert-manager-test" deleted

2022-06-27T11:51:26Z    INFO   io/io.go:425    
• [SLOW TEST:9.829 seconds]
cert-manager Package E2E Test
/Users/amansha/go/src/github.com/tce-e2e-test/community-edition/addons/packages/cert-manager/1.8.0/test/e2e/cert_manager_test.go:16
  works
  /Users/amansha/go/src/github.com/tce-e2e-test/community-edition/addons/packages/cert-manager/1.8.0/test/e2e/cert_manager_test.go:31
------------------------------

2022-06-27T11:51:26Z    INFO   io/io.go:425    STEP: cleaning up cert-manager package
+ tanzu package installed delete cert-manager --poll-interval 10s --poll-timeout 20m --namespace default --yes

2022-06-27T11:51:39Z    INFO   io/io.go:425    
STEP: validating the cert-manager package install no longer exists

2022-06-27T11:51:39Z    INFO   io/io.go:425    + kubectl -n default get packageinstall cert-manager

2022-06-27T11:51:40Z    INFO   io/io.go:425    Error from server (NotFound): packageinstalls.packaging.carvel.dev "cert-manager" not found

2022-06-27T11:51:40Z    INFO   io/io.go:425    STEP: cleaning up cert-manager namespace
+ kubectl delete namespace cert-manager

2022-06-27T11:51:41Z    INFO   io/io.go:425    Error from server (NotFound): namespaces "cert-manager" not found

2022-06-27T11:51:41Z    INFO   io/io.go:425    
Ran 1 of 1 Specs in 87.767 seconds
SUCCESS! -- 1 Passed | 0 Failed | 0 Pending | 0 Skipped
PASS

2022-06-27T11:51:41Z    INFO   io/io.go:425    
Ginkgo ran 1 suite in 1m29.241607207s
Test Suite Passed

2022-06-27T11:51:41Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster delete test-wkld-1656327937 --yes`
2022-06-27T11:51:45Z    ERROR  io/io.go:425    Workload cluster 'test-wkld-1656327937' is being deleted 

2022-06-27T11:51:45Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-27T11:51:48Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-27T11:51:58Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-27T11:52:01Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-27T11:52:11Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-27T11:52:14Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-27T11:52:24Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-27T11:52:27Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-27T11:52:37Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-27T11:52:40Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-27T11:52:50Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-27T11:52:52Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-27T11:53:02Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-27T11:53:05Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-27T11:53:15Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-27T11:53:18Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-27T11:53:28Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-27T11:53:31Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-27T11:53:41Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-27T11:53:44Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-27T11:53:54Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-27T11:53:57Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-27T11:54:07Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-27T11:54:10Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-27T11:54:20Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-27T11:54:23Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-27T11:54:33Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-27T11:54:36Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-27T11:54:46Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-27T11:54:48Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-27T11:54:58Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-27T11:55:01Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-27T11:55:11Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-27T11:55:14Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-27T11:55:24Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-27T11:55:27Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-27T11:55:37Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-27T11:55:40Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-27T11:55:50Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-27T11:55:57Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-27T11:56:07Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-27T11:56:09Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-27T11:56:19Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-27T11:56:22Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-27T11:56:32Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-27T11:56:35Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-27T11:56:45Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-27T11:56:48Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-27T11:56:58Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-27T11:57:01Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-27T11:57:11Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-27T11:57:15Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-27T11:57:25Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-27T11:57:28Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-27T11:57:38Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-27T11:57:42Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-27T11:57:52Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-27T11:57:55Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-27T11:58:05Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-27T11:58:08Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-27T11:58:18Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-27T11:58:21Z    INFO   utils/cluster_test_runner.go:267    Workload cluster test-wkld-1656327937 successfully deleted

2022-06-27T11:58:21Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu management-cluster delete test-mgmt-1656327937 --yes`
2022-06-27T11:58:24Z    ERROR  io/io.go:425    Verifying management cluster...

2022-06-27T11:58:28Z    ERROR  io/io.go:425    Setting up cleanup cluster...

2022-06-27T12:00:40Z    ERROR  io/io.go:425    Installing providers to cleanup cluster...

2022-06-27T12:00:41Z    ERROR  io/io.go:425    Fetching providers

2022-06-27T12:00:41Z    ERROR  io/io.go:425    Installing cert-manager Version="v1.5.3"

2022-06-27T12:00:45Z    ERROR  io/io.go:425    Waiting for cert-manager to be available...

2022-06-27T12:04:18Z    ERROR  io/io.go:425    Installing Provider="cluster-api" Version="v1.0.1" TargetNamespace="capi-system"

2022-06-27T12:04:20Z    ERROR  io/io.go:425    Installing Provider="bootstrap-kubeadm" Version="v1.0.1" TargetNamespace="capi-kubeadm-bootstrap-system"

2022-06-27T12:04:21Z    ERROR  io/io.go:425    Installing Provider="control-plane-kubeadm" Version="v1.0.1" TargetNamespace="capi-kubeadm-control-plane-system"

2022-06-27T12:04:23Z    ERROR  io/io.go:425    Installing Provider="infrastructure-azure" Version="v1.0.2" TargetNamespace="capz-system"

2022-06-27T12:08:38Z    ERROR  io/io.go:425    Moving Cluster API objects from management cluster to cleanup cluster...

2022-06-27T12:09:17Z    ERROR  io/io.go:425    Performing move...

2022-06-27T12:09:22Z    ERROR  io/io.go:425    Discovering Cluster API objects

2022-06-27T12:09:48Z    ERROR  io/io.go:425    Moving Cluster API objects Clusters=1

2022-06-27T12:09:49Z    ERROR  io/io.go:425    Creating objects in the target cluster

2022-06-27T12:10:34Z    ERROR  io/io.go:425    Deleting objects from the source cluster

2022-06-27T12:11:28Z    ERROR  io/io.go:425    Waiting for the Cluster API objects to get ready after move...

2022-06-27T12:12:08Z    ERROR  io/io.go:425    Deleting management cluster...

2022-06-27T12:38:58Z    ERROR  io/io.go:425    Management cluster 'test-mgmt-1656327937' deleted.

2022-06-27T12:38:58Z    ERROR  io/io.go:425    Deleting the management cluster context from the kubeconfig file '/Users/amansha/.kube/config'

2022-06-27T12:43:09Z    ERROR  io/io.go:425    
Management cluster deleted!
aman556 commented 2 years ago

local-path-storage E2E test passing logs inside cluster lifecycle E2E test.

2022-06-28T03:16:29Z    INFO   utils/common.go:41  Checking tanzu CLI installation
2022-06-28T03:16:29Z    INFO   utils/common.go:47  tanzu CLI is available at path: /usr/local/bin/tanzu
2022-06-28T03:16:29Z    INFO   utils/common.go:62  Checking tanzu management cluster plugin CLI installation
2022-06-28T03:16:29Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu management-cluster version`
2022-06-28T03:16:31Z    INFO   io/io.go:425    v0.11.4

2022-06-28T03:16:31Z    INFO   utils/common.go:62  Checking tanzu management cluster plugin CLI installation
2022-06-28T03:16:31Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster version`
2022-06-28T03:16:31Z    INFO   io/io.go:425    v0.11.4

2022-06-28T03:16:31Z    INFO   docker/docker.go:29 Checking docker CLI and Docker Engine installation
2022-06-28T03:16:32Z    INFO   docker/docker.go:44 docker CLI is available at path: /usr/local/bin/docker
2022-06-28T03:16:32Z    INFO   docker/docker.go:45 E2E test Docker client's API version: 1.41
2022-06-28T03:16:32Z    INFO   docker/docker.go:46 Docker Engine's API version: 1.41
2022-06-28T03:16:32Z    INFO   docker/docker.go:47 Docker Engine's version: 20.10.5
2022-06-28T03:16:32Z    INFO   utils/common.go:52  Checking kubectl CLI installation
2022-06-28T03:16:32Z    INFO   utils/common.go:58  kubectl CLI is available at path: /usr/local/bin/kubectl

2022-06-28T03:16:32Z    INFO   testutils/common.go:17  Checking required environment variables
2022-06-28T03:16:32Z    INFO   testutils/common.go:17  Checking required environment variables
2022-06-28T03:16:32Z    INFO   azure/secrets.go:27 Extracting Azure test secrets from environment variables
2022-06-28T03:16:32Z    INFO   testutils/common.go:17  Checking required environment variables
2022-06-28T03:16:32Z    INFO   azure/secrets.go:27 Extracting Azure test secrets from environment variables
2022-06-28T03:16:32Z    INFO   azure/login.go:13   Logging into Azure
2022-06-28T03:16:32Z    INFO   utils/cluster_test_runner.go:58 Management Cluster Name : test-mgmt-1656386192
2022-06-28T03:16:32Z    INFO   utils/cluster_test_runner.go:59 Workload Cluster Name : test-wkld-1656386192
2022-06-28T03:16:32Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu management-cluster create test-mgmt-1656386192 --dry-run`
2022-06-28T03:16:32Z    ERROR  io/io.go:425    
Validating the pre-requisites...

2022-06-28T03:16:34Z    ERROR  io/io.go:425    Identity Provider not configured. Some authentication features won't work.

2022-06-28T03:16:34Z    ERROR  io/io.go:425    Using default value for CONTROL_PLANE_MACHINE_COUNT = 1. Reason: CONTROL_PLANE_MACHINE_COUNT variable is not set
Using default value for WORKER_MACHINE_COUNT = 1. Reason: WORKER_MACHINE_COUNT variable is not set

2022-06-28T03:16:36Z    ERROR  io/io.go:425    Using default value for CONTROL_PLANE_MACHINE_COUNT = 1. Reason: CONTROL_PLANE_MACHINE_COUNT variable is not set

2022-06-28T03:16:38Z    INFO   azure/marketplace_image.go:49   Getting marketplace terms for Azure VM image
2022-06-28T03:16:48Z    INFO   azure/marketplace_image.go:71   Azure VM image agreement terms are already accepted
2022-06-28T03:16:48Z    INFO   azure/marketplace_image.go:49   Getting marketplace terms for Azure VM image
2022-06-28T03:16:53Z    INFO   azure/marketplace_image.go:71   Azure VM image agreement terms are already accepted
2022-06-28T03:16:53Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu management-cluster create test-mgmt-1656386192`
2022-06-28T03:16:59Z    ERROR  io/io.go:425    
Validating the pre-requisites...

2022-06-28T03:17:04Z    ERROR  io/io.go:425    Identity Provider not configured. Some authentication features won't work.

2022-06-28T03:17:04Z    ERROR  io/io.go:425    Using default value for CONTROL_PLANE_MACHINE_COUNT = 1. Reason: CONTROL_PLANE_MACHINE_COUNT variable is not set

2022-06-28T03:17:04Z    ERROR  io/io.go:425    Using default value for WORKER_MACHINE_COUNT = 1. Reason: WORKER_MACHINE_COUNT variable is not set

2022-06-28T03:17:10Z    ERROR  io/io.go:425    
Setting up management cluster...

2022-06-28T03:17:10Z    ERROR  io/io.go:425    Validating configuration...

2022-06-28T03:17:13Z    ERROR  io/io.go:425    Using infrastructure provider azure:v1.0.2
Generating cluster configuration...

2022-06-28T03:17:13Z    ERROR  io/io.go:425    Using default value for CONTROL_PLANE_MACHINE_COUNT = 1. Reason: CONTROL_PLANE_MACHINE_COUNT variable is not set

2022-06-28T03:17:17Z    ERROR  io/io.go:425    Setting up bootstrapper...

2022-06-28T03:20:55Z    ERROR  io/io.go:425    Bootstrapper created. Kubeconfig: /Users/amansha/.kube-tkg/tmp/config_0V5d6le2

2022-06-28T03:20:55Z    ERROR  io/io.go:425    Installing providers on bootstrapper...

2022-06-28T03:20:55Z    ERROR  io/io.go:425    Fetching providers

2022-06-28T03:20:57Z    ERROR  io/io.go:425    Installing cert-manager Version="v1.5.3"

2022-06-28T03:21:21Z    ERROR  io/io.go:425    Waiting for cert-manager to be available...

2022-06-28T03:22:55Z    ERROR  io/io.go:425    E0628 08:52:55.580590   43291 request.go:1085] Unexpected error when reading response body: context deadline exceeded (Client.Timeout or context cancellation while reading body)
E0628 08:52:55.581398   43291 request.go:1085] Unexpected error when reading response body: net/http: request canceled (Client.Timeout or context cancellation while reading body)
E0628 08:52:55.591337   43291 request.go:1085] Unexpected error when reading response body: context deadline exceeded (Client.Timeout or context cancellation while reading body)
E0628 08:52:55.639882   43291 request.go:1085] Unexpected error when reading response body: context deadline exceeded (Client.Timeout or context cancellation while reading body)

2022-06-28T03:27:19Z    ERROR  io/io.go:425    Installing Provider="cluster-api" Version="v1.0.1" TargetNamespace="capi-system"

2022-06-28T03:27:23Z    ERROR  io/io.go:425    Installing Provider="bootstrap-kubeadm" Version="v1.0.1" TargetNamespace="capi-kubeadm-bootstrap-system"

2022-06-28T03:27:27Z    ERROR  io/io.go:425    Installing Provider="control-plane-kubeadm" Version="v1.0.1" TargetNamespace="capi-kubeadm-control-plane-system"

2022-06-28T03:27:33Z    ERROR  io/io.go:425    Installing Provider="infrastructure-azure" Version="v1.0.2" TargetNamespace="capz-system"

2022-06-28T03:32:13Z    ERROR  io/io.go:425    Start creating management cluster...

2022-06-28T03:33:39Z    ERROR  io/io.go:425    [cluster control plane is still being initialized: WaitingForControlPlane, cluster infrastructure is still being provisioned: WaitingForControlPlane]

2022-06-28T03:35:09Z    ERROR  io/io.go:425    cluster control plane is still being initialized: WaitingForControlPlane

2022-06-28T03:35:39Z    ERROR  io/io.go:425    cluster control plane is still being initialized: ScalingUp

2022-06-28T03:37:24Z    ERROR  io/io.go:425    Saving management cluster kubeconfig into /Users/amansha/.kube/config

2022-06-28T03:37:25Z    ERROR  io/io.go:425    Installing providers on management cluster...

2022-06-28T03:37:32Z    ERROR  io/io.go:425    Fetching providers

2022-06-28T03:37:40Z    ERROR  io/io.go:425    I0628 09:07:40.576286   43291 request.go:665] Waited for 1.011102121s due to client-side throttling, not priority and fairness, request: GET:https://test-mgmt-1656386192-44da4613.australiaeast.cloudapp.azure.com:6443/apis/crd.antrea.io/v1alpha1?timeout=30s

2022-06-28T03:37:40Z    ERROR  io/io.go:425    Installing cert-manager Version="v1.5.3"

2022-06-28T03:38:49Z    ERROR  io/io.go:425    Waiting for cert-manager to be available...

2022-06-28T03:41:27Z    ERROR  io/io.go:425    Installing Provider="cluster-api" Version="v1.0.1" TargetNamespace="capi-system"

2022-06-28T03:41:50Z    ERROR  io/io.go:425    Installing Provider="bootstrap-kubeadm" Version="v1.0.1" TargetNamespace="capi-kubeadm-bootstrap-system"

2022-06-28T03:42:04Z    ERROR  io/io.go:425    Installing Provider="control-plane-kubeadm" Version="v1.0.1" TargetNamespace="capi-kubeadm-control-plane-system"

2022-06-28T03:42:19Z    ERROR  io/io.go:425    Installing Provider="infrastructure-azure" Version="v1.0.2" TargetNamespace="capz-system"

2022-06-28T03:43:05Z    ERROR  io/io.go:425    Waiting for the management cluster to get ready for move...

2022-06-28T03:43:05Z    ERROR  io/io.go:425    Waiting for addons installation...

2022-06-28T03:43:05Z    ERROR  io/io.go:425    Moving all Cluster API objects from bootstrap cluster to management cluster...

2022-06-28T03:43:08Z    ERROR  io/io.go:425    Performing move...

2022-06-28T03:43:10Z    ERROR  io/io.go:425    Discovering Cluster API objects

2022-06-28T03:43:14Z    ERROR  io/io.go:425    Moving Cluster API objects Clusters=1

2022-06-28T03:43:15Z    ERROR  io/io.go:425    Creating objects in the target cluster

2022-06-28T03:44:11Z    ERROR  io/io.go:425    Deleting objects from the source cluster

2022-06-28T03:44:33Z    ERROR  io/io.go:425    Waiting for additional components to be up and running...

2022-06-28T03:44:33Z    ERROR  io/io.go:425    Waiting for packages to be up and running...

2022-06-28T03:45:24Z    ERROR  io/io.go:425    You can now access the management cluster test-mgmt-1656386192 by running 'kubectl config use-context test-mgmt-1656386192-admin@test-mgmt-1656386192'

2022-06-28T03:48:29Z    ERROR  io/io.go:425    
Management cluster created!

2022-06-28T03:48:29Z    ERROR  io/io.go:425    
You can now create your first workload cluster by running the following:

  tanzu cluster create [name] -f [file]

Some addons might be getting installed! Check their status by running the following:

  kubectl get apps -A

2022-06-28T03:48:29Z    ERROR  io/io.go:425    Checking for required plugins...

2022-06-28T03:48:32Z    ERROR  io/io.go:425    All required plugins are already installed and up-to-date

2022-06-28T03:48:32Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu management-cluster kubeconfig get test-mgmt-1656386192 --admin`
2022-06-28T03:48:35Z    ERROR  io/io.go:425    Credentials of cluster 'test-mgmt-1656386192' have been saved 
You can now access the cluster by running 'kubectl config use-context test-mgmt-1656386192-admin@test-mgmt-1656386192'

2022-06-28T03:48:35Z    INFO   utils/common.go:267 Management Cluster test-mgmt-1656386192 Information: 
2022-06-28T03:48:36Z    INFO   utils/cluster_test_runner.go:150    Kubernetes API server version is v1.22.8+vmware.1
2022-06-28T03:48:36Z    INFO   utils/cluster_test_runner.go:162    Pod Name    Pod Namespace   Pod Phase
2022-06-28T03:48:36Z    INFO   utils/cluster_test_runner.go:165    capi-kubeadm-bootstrap-controller-manager-79b888f8b9-bssxb  capi-kubeadm-bootstrap-system   Running
2022-06-28T03:48:36Z    INFO   utils/cluster_test_runner.go:165    capi-kubeadm-control-plane-controller-manager-84b9bd7564-lwbvp  capi-kubeadm-control-plane-system   Running
2022-06-28T03:48:36Z    INFO   utils/cluster_test_runner.go:165    capi-controller-manager-69d6d968ff-zxc5l    capi-system Running
2022-06-28T03:48:36Z    INFO   utils/cluster_test_runner.go:165    capz-controller-manager-964bb45f-rlncw  capz-system Running
2022-06-28T03:48:36Z    INFO   utils/cluster_test_runner.go:165    capz-nmi-86t4b  capz-system Running
2022-06-28T03:48:36Z    INFO   utils/cluster_test_runner.go:165    cert-manager-84bb9684d6-znwtd   cert-manager    Running
2022-06-28T03:48:36Z    INFO   utils/cluster_test_runner.go:165    cert-manager-cainjector-6767468f75-nsnkm    cert-manager    Running
2022-06-28T03:48:36Z    INFO   utils/cluster_test_runner.go:165    cert-manager-webhook-588bb4546d-4v945   cert-manager    Running
2022-06-28T03:48:36Z    INFO   utils/cluster_test_runner.go:165    antrea-agent-9kz72  kube-system Running
2022-06-28T03:48:36Z    INFO   utils/cluster_test_runner.go:165    antrea-agent-kstct  kube-system Running
2022-06-28T03:48:36Z    INFO   utils/cluster_test_runner.go:165    antrea-controller-75fd8c88f7-brtg2  kube-system Running
2022-06-28T03:48:36Z    INFO   utils/cluster_test_runner.go:165    coredns-67c8559bb6-ft6rj    kube-system Running
2022-06-28T03:48:36Z    INFO   utils/cluster_test_runner.go:165    coredns-67c8559bb6-wvk4j    kube-system Running
2022-06-28T03:48:36Z    INFO   utils/cluster_test_runner.go:165    etcd-test-mgmt-1656386192-control-plane-56jds   kube-system Running
2022-06-28T03:48:36Z    INFO   utils/cluster_test_runner.go:165    kube-apiserver-test-mgmt-1656386192-control-plane-56jds kube-system Running
2022-06-28T03:48:36Z    INFO   utils/cluster_test_runner.go:165    kube-controller-manager-test-mgmt-1656386192-control-plane-56jds    kube-system Running
2022-06-28T03:48:36Z    INFO   utils/cluster_test_runner.go:165    kube-proxy-fcn8s    kube-system Running
2022-06-28T03:48:36Z    INFO   utils/cluster_test_runner.go:165    kube-proxy-w9ljb    kube-system Running
2022-06-28T03:48:36Z    INFO   utils/cluster_test_runner.go:165    kube-scheduler-test-mgmt-1656386192-control-plane-56jds kube-system Running
2022-06-28T03:48:36Z    INFO   utils/cluster_test_runner.go:165    metrics-server-55656b749b-nmgjj kube-system Running
2022-06-28T03:48:36Z    INFO   utils/cluster_test_runner.go:165    secretgen-controller-85f4995f98-vnx4l   tanzu-system    Running
2022-06-28T03:48:36Z    INFO   utils/cluster_test_runner.go:165    kapp-controller-6dfdb867b5-rng89    tkg-system  Running
2022-06-28T03:48:36Z    INFO   utils/cluster_test_runner.go:165    tanzu-addons-controller-manager-78f7667d84-5h2ft    tkg-system  Running
2022-06-28T03:48:36Z    INFO   utils/cluster_test_runner.go:165    tanzu-capabilities-controller-manager-757c67756-tb7q8   tkg-system  Running
2022-06-28T03:48:36Z    INFO   utils/cluster_test_runner.go:165    tanzu-featuregates-controller-manager-55f6cb68b8-7rsrq  tkg-system  Running
2022-06-28T03:48:36Z    INFO   utils/cluster_test_runner.go:165    tkr-controller-manager-9b77f4678-w7h7j  tkr-system  Running
2022-06-28T03:48:36Z    INFO   utils/cluster_test_runner.go:173    

Node Name   Node Phase
2022-06-28T03:48:36Z    INFO   utils/cluster_test_runner.go:176    test-mgmt-1656386192-control-plane-56jds    
2022-06-28T03:48:36Z    INFO   utils/cluster_test_runner.go:176    test-mgmt-1656386192-md-0-8ng9w 
2022-06-28T03:48:36Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster create test-wkld-1656386192 --dry-run`
2022-06-28T03:49:06Z    ERROR  io/io.go:425    Warning: Pinniped configuration not found. Skipping pinniped configuration in workload cluster. Please refer to the documentation to check if you can configure pinniped on workload cluster manually

2022-06-28T03:49:12Z    INFO   azure/marketplace_image.go:49   Getting marketplace terms for Azure VM image
2022-06-28T03:49:17Z    INFO   azure/marketplace_image.go:71   Azure VM image agreement terms are already accepted
2022-06-28T03:49:17Z    INFO   azure/marketplace_image.go:49   Getting marketplace terms for Azure VM image
2022-06-28T03:49:22Z    INFO   azure/marketplace_image.go:71   Azure VM image agreement terms are already accepted
2022-06-28T03:49:22Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster create test-wkld-1656386192`
2022-06-28T03:49:24Z    ERROR  io/io.go:425    Validating configuration...

2022-06-28T03:49:51Z    ERROR  io/io.go:425    Warning: Pinniped configuration not found. Skipping pinniped configuration in workload cluster. Please refer to the documentation to check if you can configure pinniped on workload cluster manually

2022-06-28T03:49:55Z    ERROR  io/io.go:425    Creating workload cluster 'test-wkld-1656386192'...

2022-06-28T03:50:10Z    ERROR  io/io.go:425    Waiting for cluster to be initialized...

2022-06-28T03:50:11Z    ERROR  io/io.go:425    [cluster control plane is still being initialized: WaitingForControlPlane, cluster infrastructure is still being provisioned: WaitingForControlPlane]

2022-06-28T03:50:57Z    ERROR  io/io.go:425    cluster control plane is still being initialized: WaitingForControlPlane

2022-06-28T03:51:12Z    ERROR  io/io.go:425    cluster control plane is still being initialized: ScalingUp

2022-06-28T03:56:57Z    ERROR  io/io.go:425    Waiting for cluster nodes to be available...

2022-06-28T04:01:09Z    ERROR  io/io.go:425    Waiting for addons installation...

2022-06-28T04:01:11Z    ERROR  io/io.go:425    Waiting for packages to be up and running...

2022-06-28T04:01:42Z    ERROR  io/io.go:425    
Workload cluster 'test-wkld-1656386192' created

2022-06-28T04:01:42Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-28T04:01:45Z    INFO   utils/cluster_test_runner.go:210    Workload cluster test-wkld-1656386192 is running successfully

2022-06-28T04:01:45Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster kubeconfig get test-wkld-1656386192 --admin`
2022-06-28T04:01:47Z    ERROR  io/io.go:425    Credentials of cluster 'test-wkld-1656386192' have been saved 
You can now access the cluster by running 'kubectl config use-context test-wkld-1656386192-admin@test-wkld-1656386192'

2022-06-28T04:01:47Z    INFO   utils/common.go:296 Workload Cluster test-wkld-1656386192 Information: 
2022-06-28T04:01:48Z    INFO   utils/cluster_test_runner.go:150    Kubernetes API server version is v1.22.8+vmware.1
2022-06-28T04:01:48Z    INFO   utils/cluster_test_runner.go:162    Pod Name    Pod Namespace   Pod Phase
2022-06-28T04:01:48Z    INFO   utils/cluster_test_runner.go:165    antrea-agent-j548m  kube-system Running
2022-06-28T04:01:48Z    INFO   utils/cluster_test_runner.go:165    antrea-agent-ppgwh  kube-system Running
2022-06-28T04:01:48Z    INFO   utils/cluster_test_runner.go:165    antrea-controller-584d6f8448-r5kzk  kube-system Running
2022-06-28T04:01:48Z    INFO   utils/cluster_test_runner.go:165    coredns-67c8559bb6-6zzlr    kube-system Running
2022-06-28T04:01:48Z    INFO   utils/cluster_test_runner.go:165    coredns-67c8559bb6-djcgj    kube-system Running
2022-06-28T04:01:48Z    INFO   utils/cluster_test_runner.go:165    etcd-test-wkld-1656386192-control-plane-qpbrm   kube-system Running
2022-06-28T04:01:48Z    INFO   utils/cluster_test_runner.go:165    kube-apiserver-test-wkld-1656386192-control-plane-qpbrm kube-system Running
2022-06-28T04:01:48Z    INFO   utils/cluster_test_runner.go:165    kube-controller-manager-test-wkld-1656386192-control-plane-qpbrm    kube-system Running
2022-06-28T04:01:48Z    INFO   utils/cluster_test_runner.go:165    kube-proxy-blb64    kube-system Running
2022-06-28T04:01:48Z    INFO   utils/cluster_test_runner.go:165    kube-proxy-plj4f    kube-system Running
2022-06-28T04:01:48Z    INFO   utils/cluster_test_runner.go:165    kube-scheduler-test-wkld-1656386192-control-plane-qpbrm kube-system Running
2022-06-28T04:01:48Z    INFO   utils/cluster_test_runner.go:165    metrics-server-7785fb5987-kn6wx kube-system Running
2022-06-28T04:01:48Z    INFO   utils/cluster_test_runner.go:165    secretgen-controller-5c8b68bcbc-qvl4r   tanzu-system    Running
2022-06-28T04:01:48Z    INFO   utils/cluster_test_runner.go:165    kapp-controller-6456897f75-cv922    tkg-system  Running
2022-06-28T04:01:48Z    INFO   utils/cluster_test_runner.go:165    tanzu-capabilities-controller-manager-757c67756-5d9qv   tkg-system  Running
2022-06-28T04:01:48Z    INFO   utils/cluster_test_runner.go:173    

Node Name   Node Phase
2022-06-28T04:01:48Z    INFO   utils/cluster_test_runner.go:176    test-wkld-1656386192-control-plane-qpbrm    
2022-06-28T04:01:48Z    INFO   utils/cluster_test_runner.go:176    test-wkld-1656386192-md-0-bbnkz 
2022-06-28T04:01:48Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/kubectl config use-context test-wkld-1656386192-admin@test-wkld-1656386192`
2022-06-28T04:01:49Z    INFO   io/io.go:425    Switched to context "test-wkld-1656386192-admin@test-wkld-1656386192".

2022-06-28T04:01:49Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu package repository add tce-repo --url projects.registry.vmware.com/tce/main:0.12.0 --namespace tanzu-package-repo-global`
2022-06-28T04:01:51Z    ERROR  io/io.go:425    I0628 09:31:51.481626   63227 request.go:665] Waited for 1.000202481s due to client-side throttling, not priority and fairness, request: GET:https://test-wkld-1656386192-93f77739.australiaeast.cloudapp.azure.com:6443/apis/crd.antrea.io/v1beta1?timeout=32s

2022-06-28T04:02:04Z    ERROR  io/io.go:425    Added package repository 'tce-repo' in namespace 'tanzu-package-repo-global'

2022-06-28T04:02:04Z    INFO   clirunner/run.go:24 Running the command `/usr/bin/make e2e-test`
2022-06-28T04:02:04Z    INFO   io/io.go:425    CGO_ENABLED=0 go run github.com/onsi/ginkgo/ginkgo -v e2e

2022-06-28T04:02:08Z    INFO   io/io.go:425    Running Suite: local-path-storage Package E2E Test Suite
========================================================
Random Seed: 1656388926
Will run 1 of 1 specs

2022-06-28T04:02:08Z    INFO   io/io.go:425    STEP: installing local-path-storage package
+ tanzu package available list -o json

2022-06-28T04:02:17Z    INFO   io/io.go:425    [
  {
    "display-name": "App-Toolkit package for TCE",
    "latest-version": "0.2.0",
    "name": "app-toolkit.community.tanzu.vmware.com",
    "short-description": "Kubernetes-native toolkit to support application lifecycle"
  },
  {
    "display-name": "Cartographer Catalog",
    "latest-version": "0.3.0",
    "name": "cartographer-catalog.community.tanzu.vmware.com",
    "short-description": "Reusable Cartographer blueprints"
  },
  {
    "display-name": "Cartographer",
    "latest-version": "0.3.0",
    "name": "cartographer.community.tanzu.vmware.com",
    "short-description": "Kubernetes native Supply Chain Choreographer."
  },
  {
    "display-name": "cert-injection-webhook",
    "latest-version": "0.1.1",
    "name": "cert-injection-webhook.community.tanzu.vmware.com",
    "short-description": "The Cert Injection Webhook injects CA certificates and proxy environment variables into pods"
  },
  {
    "display-name": "cert-manager",
    "latest-version": "1.8.0",
    "name": "cert-manager.community.tanzu.vmware.com",
    "short-description": "Certificate management"
  },
  {
    "display-name": "contour",
    "latest-version": "1.20.1",
    "name": "contour.community.tanzu.vmware.com",
    "short-description": "An ingress controller"
  },
  {
    "display-name": "external-dns",
    "latest-version": "0.10.0",
    "name": "external-dns.community.tanzu.vmware.com",
    "short-description": "This package provides DNS synchronization functionality."
  },
  {
    "display-name": "fluent-bit",
    "latest-version": "1.7.5",
    "name": "fluent-bit.community.tanzu.vmware.com",
    "short-description": "Fluent Bit is a fast Log Processor and Forwarder"
  },
  {
    "display-name": "Flux Source Controller",
    "latest-version": "0.21.5",
    "name": "fluxcd-source-controller.community.tanzu.vmware.com",
    "short-description": "The source-controller is a Kubernetes operator, specialised in artifacts acquisition from external sources such as Git, Helm repositories and S3 buckets."
  },
  {
    "display-name": "gatekeeper",
    "latest-version": "3.7.1",
    "name": "gatekeeper.community.tanzu.vmware.com",
    "short-description": "policy management"
  },
  {
    "display-name": "grafana",
    "latest-version": "7.5.11",
    "name": "grafana.community.tanzu.vmware.com",
    "short-description": "Visualization and analytics software"
  },
  {
    "display-name": "harbor",
    "latest-version": "2.4.2",
    "name": "harbor.community.tanzu.vmware.com",
    "short-description": "OCI Registry"
  },
  {
    "display-name": "Flux Helm Controller",
    "latest-version": "0.17.2",
    "name": "helm-controller.fluxcd.community.tanzu.vmware.com",
    "short-description": "The Helm Controller is a Kubernetes operator, allowing one to declaratively manage Helm chart releases with Kubernetes manifests."
  },
  {
    "display-name": "knative-serving",
    "latest-version": "1.0.0",
    "name": "knative-serving.community.tanzu.vmware.com",
    "short-description": "Knative Serving builds on Kubernetes to support deploying and serving of applications and functions as serverless containers"
  },
  {
    "display-name": "kpack dependencies",
    "latest-version": "0.0.27",
    "name": "kpack-dependencies.community.tanzu.vmware.com",
    "short-description": "Dependencies in the form of Buildpacks and Stacks for the kpack package"
  },
  {
    "display-name": "kpack",
    "latest-version": "0.5.3",
    "name": "kpack.community.tanzu.vmware.com",
    "short-description": "kpack builds application source code into OCI compliant images using Cloud Native Buildpacks"
  },
  {
    "display-name": "Flux Kustomize Controller",
    "latest-version": "0.21.1",
    "name": "kustomize-controller.fluxcd.community.tanzu.vmware.com",
    "short-description": "Kustomize controller is one of the components in GitOps toolkit."
  },
  {
    "display-name": "local-path-storage",
    "latest-version": "0.0.22",
    "name": "local-path-storage.community.tanzu.vmware.com",
    "short-description": "This package provides local path node storage and primarily supports RWO AccessMode."
  },
  {
    "display-name": "multus-cni",
    "latest-version": "3.8.0",
    "name": "multus-cni.community.tanzu.vmware.com",
    "short-description": "This package provides the ability for enabling attaching multiple network interfaces to pods in Kubernetes"
  },
  {
    "display-name": "prometheus",
    "latest-version": "2.27.0-1",
    "name": "prometheus.community.tanzu.vmware.com",
    "short-description": "A time series database for your metrics"
  },
  {
    "display-name": "velero",
    "latest-version": "1.8.0",
    "name": "velero.community.tanzu.vmware.com",
    "short-description": "Disaster recovery capabilities"
  },
  {
    "display-name": "whereabouts",
    "latest-version": "0.5.1",
    "name": "whereabouts.community.tanzu.vmware.com",
    "short-description": "A CNI IPAM plugin that assigns IP addresses cluster-wide"
  }
]

2022-06-28T04:02:17Z    INFO   io/io.go:425    + tanzu package available list local-path-storage.community.tanzu.vmware.com -o json

2022-06-28T04:02:20Z    INFO   io/io.go:425    [
  {
    "name": "local-path-storage.community.tanzu.vmware.com",
    "released-at": "2021-09-15 05:30:00 +0530 IST",
    "version": "0.0.19"
  },
  {
    "name": "local-path-storage.community.tanzu.vmware.com",
    "released-at": "2021-09-15 05:30:00 +0530 IST",
    "version": "0.0.20"
  },
  {
    "name": "local-path-storage.community.tanzu.vmware.com",
    "released-at": "2021-09-15 05:30:00 +0530 IST",
    "version": "0.0.22"
  }
]

2022-06-28T04:02:20Z    INFO   io/io.go:425    + tanzu package install local-path-storage --poll-interval 10s --poll-timeout 20m --namespace default --package-name local-path-storage.community.tanzu.vmware.com --version 0.0.22 --values-file fixtures/values.yaml

2022-06-28T04:02:54Z    INFO   io/io.go:425    
STEP: validating local-path-storage package is reconciled

2022-06-28T04:02:54Z    INFO   io/io.go:425    + kubectl -n default get packageinstalls local-path-storage -o jsonpath={.status.conditions[?(@.type == 'ReconcileSucceeded')].status}

2022-06-28T04:02:57Z    INFO   io/io.go:425    True

2022-06-28T04:02:57Z    INFO   io/io.go:425    local-path-storage Package E2E Test 
  works
  /Users/amansha/go/src/github.com/tce-e2e-test/community-edition/addons/packages/local-path-storage/0.0.22/test/e2e/local_path_storage_test.go:28
+ kubectl get StorageClass local-path

2022-06-28T04:02:58Z    INFO   io/io.go:425    NAME                   PROVISIONER             RECLAIMPOLICY   VOLUMEBINDINGMODE      ALLOWVOLUMEEXPANSION   AGE
local-path (default)   rancher.io/local-path   Delete          WaitForFirstConsumer   false                  25s

2022-06-28T04:02:58Z    INFO   io/io.go:425    •STEP: cleaning up local-path-storage package
+ tanzu package installed delete local-path-storage --poll-interval 10s --poll-timeout 20m --namespace default --yes

2022-06-28T04:03:41Z    INFO   io/io.go:425    
STEP: validating the local-path-storage package install no longer exists
+ kubectl -n default get packageinstall local-path-storage

2022-06-28T04:03:43Z    INFO   io/io.go:425    Error from server (NotFound): packageinstalls.packaging.carvel.dev "local-path-storage" not found

2022-06-28T04:03:43Z    INFO   io/io.go:425    
Ran 1 of 1 Specs in 94.321 seconds
SUCCESS! -- 1 Passed | 0 Failed | 0 Pending | 0 Skipped
PASS

2022-06-28T04:03:43Z    INFO   io/io.go:425    
Ginkgo ran 1 suite in 1m36.031970759s
Test Suite Passed

2022-06-28T04:03:43Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster delete test-wkld-1656386192 --yes`
2022-06-28T04:03:46Z    ERROR  io/io.go:425    Workload cluster 'test-wkld-1656386192' is being deleted 

2022-06-28T04:03:46Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-28T04:03:51Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-28T04:04:01Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-28T04:04:04Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-28T04:04:14Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-28T04:04:17Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-28T04:04:27Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-28T04:04:30Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-28T04:04:40Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-28T04:04:43Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-28T04:04:53Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-28T04:04:56Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-28T04:05:06Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-28T04:05:10Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-28T04:05:20Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-28T04:05:22Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-28T04:05:32Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-28T04:05:35Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-28T04:05:45Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-28T04:05:49Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-28T04:05:59Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-28T04:06:02Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-28T04:06:12Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-28T04:06:16Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-28T04:06:26Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-28T04:06:29Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-28T04:06:39Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-28T04:06:42Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-28T04:06:52Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-28T04:06:55Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-28T04:07:05Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-28T04:07:08Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-28T04:07:18Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-28T04:07:21Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-28T04:07:31Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-28T04:07:34Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-28T04:07:44Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-28T04:07:46Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-28T04:07:56Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-28T04:07:59Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-28T04:08:09Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-28T04:08:13Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-28T04:08:23Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-28T04:08:26Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-28T04:08:36Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-28T04:08:39Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-28T04:08:49Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-28T04:08:53Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-28T04:09:03Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-28T04:09:06Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-28T04:09:16Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-28T04:09:19Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-28T04:09:29Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-28T04:09:32Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-28T04:09:42Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-28T04:09:44Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-28T04:09:54Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-28T04:09:58Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-28T04:10:08Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-28T04:10:12Z    INFO   utils/cluster_test_runner.go:265    Waiting for workload cluster to get deleted
2022-06-28T04:10:22Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu cluster list -o json`
2022-06-28T04:10:25Z    INFO   utils/cluster_test_runner.go:267    Workload cluster test-wkld-1656386192 successfully deleted

2022-06-28T04:10:25Z    INFO   clirunner/run.go:24 Running the command `/usr/local/bin/tanzu management-cluster delete test-mgmt-1656386192 --yes`
2022-06-28T04:10:28Z    ERROR  io/io.go:425    Verifying management cluster...

2022-06-28T04:10:33Z    ERROR  io/io.go:425    Setting up cleanup cluster...

2022-06-28T04:14:14Z    ERROR  io/io.go:425    Installing providers to cleanup cluster...

2022-06-28T04:14:14Z    ERROR  io/io.go:425    Fetching providers

2022-06-28T04:14:15Z    ERROR  io/io.go:425    Installing cert-manager Version="v1.5.3"

2022-06-28T04:14:21Z    ERROR  io/io.go:425    Waiting for cert-manager to be available...

2022-06-28T04:17:39Z    ERROR  io/io.go:425    Installing Provider="cluster-api" Version="v1.0.1" TargetNamespace="capi-system"

2022-06-28T04:17:44Z    ERROR  io/io.go:425    Installing Provider="bootstrap-kubeadm" Version="v1.0.1" TargetNamespace="capi-kubeadm-bootstrap-system"

2022-06-28T04:17:47Z    ERROR  io/io.go:425    Installing Provider="control-plane-kubeadm" Version="v1.0.1" TargetNamespace="capi-kubeadm-control-plane-system"

2022-06-28T04:17:54Z    ERROR  io/io.go:425    Installing Provider="infrastructure-azure" Version="v1.0.2" TargetNamespace="capz-system"

2022-06-28T04:21:39Z    ERROR  io/io.go:425    Moving Cluster API objects from management cluster to cleanup cluster...

2022-06-28T04:21:43Z    ERROR  io/io.go:425    Performing move...

2022-06-28T04:21:45Z    ERROR  io/io.go:425    Discovering Cluster API objects

2022-06-28T04:22:10Z    ERROR  io/io.go:425    Moving Cluster API objects Clusters=1

2022-06-28T04:22:11Z    ERROR  io/io.go:425    Creating objects in the target cluster

2022-06-28T04:22:57Z    ERROR  io/io.go:425    Deleting objects from the source cluster

2022-06-28T04:24:04Z    ERROR  io/io.go:425    Waiting for the Cluster API objects to get ready after move...

2022-06-28T04:24:44Z    ERROR  io/io.go:425    Deleting management cluster...

2022-06-28T04:36:35Z    ERROR  io/io.go:425    Management cluster 'test-mgmt-1656386192' deleted.
Deleting the management cluster context from the kubeconfig file '/Users/amansha/.kube/config'

2022-06-28T04:39:42Z    ERROR  io/io.go:425    
Management cluster deleted!