[Feature] Use the airgap tool to tarball (and untar) the helm charts, prerequisite binaries, and upstream testing binaries

wvwatson commented 3 years ago

Use the tarball tool to tarball (and untar) the following tools:

1) dockerd (image, manifest file) 2) sonobuoy (binary, possible image, needs full path tagging) 3) Chaos mesh (image, helm chart) 3) helm (3.1.1) (binary) 4) cluster api (binary, needs full path tagging) 5) litmus (image, helm chart, needs full path tagging)

https://hackmd.io/qCAvHzzDS9aXU2q4lxNzYQ?view

How will this be tested? aka Acceptance Criteria (optional)

(optional: unnecessary for things like some version bumps etc.)

Once this issue is addressed how will the fix be verified?

Additional context Add any other context or screenshots about the feature request here. Related to #585

taylor commented 3 years ago

includes helm charts, prerequisite binaries, and upstream testing binaries

agentpoyo commented 2 years ago

Acceptance Criteria for peer review

I would expect to see a file listing of binaries, helm charts and other prerequisits to support running CNF tests with cnf-testsuite in an airgapped environment:

[x] ./cnf-testsuite airgapped output-file=/tmp/airgapped.tar.gz
[x] Running tar to list contents of the tarball tar -ztvf /tmp/airgapped.tar.gz
[x] I can see the tools and other helm charts, binaries and upstream binaries

Screenshots of publish tarball test:

[x] I can see a screenshots or command line output of the publish tarball list output.

agentpoyo commented 2 years ago

root@master1:~# tar -tvf /tmp/airgapped.tar.gz 
-rw------- root/root 137369600 2021-11-17 22:31 bootstrap_images/kubectl.tar
-rw------- root/root  59106816 2021-11-17 22:31 bootstrap_images/chaos-mesh.tar
-rw------- root/root 288927232 2021-11-17 22:31 bootstrap_images/chaos-daemon.tar
-rw------- root/root 124748800 2021-11-17 22:31 bootstrap_images/chaos-dashboard.tar
-rw------- root/root 3296702976 2021-11-17 22:33 bootstrap_images/chaos-kernel.tar
-rw------- root/root   46865408 2021-11-17 22:33 bootstrap_images/pingcap-coredns.tar
-rw------- root/root   90854400 2021-11-17 22:34 bootstrap_images/sonobuoy.tar
-rw------- root/root  307950592 2021-11-17 22:34 bootstrap_images/sonobuoy-logs.tar
-rw------- root/root  149388800 2021-11-17 22:34 bootstrap_images/litmus-operator.tar
-rw------- root/root  144283136 2021-11-17 22:34 bootstrap_images/litmus-runner.tar
-rw------- root/root  337614848 2021-11-17 22:34 bootstrap_images/go-runner.tar
-rw------- root/root  934845952 2021-11-17 22:35 bootstrap_images/kind-node.tar
-rw------- root/root   61165568 2021-11-17 22:35 bootstrap_images/gatekeeper.tar
-rw------- root/root   47648256 2021-11-17 22:35 bootstrap_images/gatekeeper-crds.tar
-rw------- root/root   48168960 2021-11-17 22:35 bootstrap_images/tigera-operator.tar
-rw------- root/root   63188480 2021-11-17 22:35 bootstrap_images/calico-controller.tar
-rw------- root/root   21866496 2021-11-17 22:35 bootstrap_images/calico-flexvol.tar
-rw------- root/root  146054656 2021-11-17 22:35 bootstrap_images/calico-cni.tar
-rw------- root/root  158017536 2021-11-17 22:35 bootstrap_images/calico-node.tar
-rw------- root/root   59463168 2021-11-17 22:36 bootstrap_images/calico-typha.tar
-rw------- root/root  420407296 2021-11-17 22:36 bootstrap_images/cilium.tar
-rw------- root/root   55630336 2021-11-17 22:36 bootstrap_images/cilium-operator.tar
-rw------- root/root  141419520 2021-11-17 22:37 bootstrap_images/prometheus.tar
-rw-r--r-- root/root      42485 2021-11-17 22:38 manifests/litmus-operator-v2.1.0.yaml
-rw-r--r-- root/root      37080 2021-11-17 22:38 manifests/chaos_crds.yaml
-rw-r--r-- root/root       2927 2021-11-17 22:39 manifests/lat-experiment.yaml
-rw-r--r-- root/root       1554 2021-11-17 22:40 manifests/lat-rbac.yaml
-rw-r--r-- root/root       2967 2021-11-17 22:40 manifests/corr-experiment.yaml
-rw-r--r-- root/root       1578 2021-11-17 22:41 manifests/corr-rbac.yaml
-rw-r--r-- root/root       2816 2021-11-17 22:41 manifests/dup-experiment.yaml
-rw-r--r-- root/root       1582 2021-11-17 22:42 manifests/dup-rbac.yaml
-rw-r--r-- root/root       2061 2021-11-17 22:43 manifests/pod-delete-experiment.yaml
-rw-r--r-- root/root       1483 2021-11-17 22:43 manifests/pod-delete-rbac.yaml
-rw-r--r-- root/root       2826 2021-11-17 22:44 manifests/pod-memory-hog-experiment.yaml
-rw-r--r-- root/root       1514 2021-11-17 22:44 manifests/pod-memory-hog-rbac.yaml
-rw-r--r-- root/root       2930 2021-11-17 22:45 manifests/pod-io-stress-experiment.yaml
-rw-r--r-- root/root       1506 2021-11-17 22:46 manifests/pod-io-stress-rbac.yaml
-rw-r--r-- root/root       2453 2021-11-17 22:46 manifests/disk-fill-experiment.yaml
-rw-r--r-- root/root       1474 2021-11-17 22:47 manifests/disk-fill-rbac.yaml
-rw-r--r-- root/root   10314964 2021-11-17 22:48 download/sonobuoy.tar.gz
-rw-r--r-- root/root   40771584 2021-11-17 22:48 download/kubescape-ubuntu-latest
-rw-r--r-- root/root    6820758 2021-11-17 22:49 download/kind
-rw-r--r-- root/root      77684 2021-11-17 22:50 download/nsa.json
drwxr-xr-x root/root          0 2021-11-17 22:50 repositories/chaos-mesh_chaos-mesh/
-rw-r--r-- root/root      26302 2021-11-17 22:50 repositories/chaos-mesh_chaos-mesh/chaos-mesh-v0.5.1.tgz
drwxr-xr-x root/root          0 2021-11-17 22:51 repositories/projectcalico_tigera-operator/
-rw-r--r-- root/root      42032 2021-11-17 22:51 repositories/projectcalico_tigera-operator/tigera-operator-v3.20.2-1.tgz
drwxr-xr-x root/root          0 2021-11-17 22:52 repositories/cilium_cilium/
-rw-r--r-- root/root      61097 2021-11-17 22:52 repositories/cilium_cilium/cilium-1.10.5.tgz
drwxr-xr-x root/root          0 2021-11-17 22:53 repositories/gatekeeper_gatekeeper/
-rw-r--r-- root/root      11916 2021-11-17 22:53 repositories/gatekeeper_gatekeeper/gatekeeper-3.6.0.tgz
-rw-r--r-- root/root   12436234 2021-11-17 22:53 bin/crictl-v1.17.0-linux-amd64.tar.gz
-rw-r--r-- root/root   31833841 2021-11-17 22:53 bin/containerd-1.5.0-linux-amd64.tar.gz

cnti-testcatalog / testsuite