e2e: sonobuoy conformance tests

kubernetes-sigs / cluster-api-provider-kubevirt

Cluster API Provider for KubeVirt

Apache License 2.0

110 stars 63 forks source link

e2e: sonobuoy conformance tests #166

Closed rhrazdil closed 2 years ago

rhrazdil commented 2 years ago

What this PR does / why we need it:

This PR introduces conobuoy conformance test script.

Fist commit:

adds hack scripts that download and execute default sonobuoy conformance suite in tenant cluster.

Second commit:

updates current ssh-infrra function to accept optional commands to run on the infra node, without getting interactive shell. a consequence of this change is that namespace (second parameter) is required.

Which issue this PR fixes (optional, in fixes #<issue number>(, fixes #<issue_number>, ...) format, will close that issue when PR gets merged): fixes #

Special notes for your reviewer:

Release notes:

NONE

rhrazdil commented 2 years ago

/cc @qinqon

k8s-ci-robot commented 2 years ago

@rhrazdil: GitHub didn't allow me to request PR reviews from the following users: qinqon.

Note that only kubernetes-sigs members and repo collaborators can review this PR, and authors cannot review their own PRs.

In response to [this](https://github.com/kubernetes-sigs/cluster-api-provider-kubevirt/pull/166#issuecomment-1200978421): >/cc @qinqon Instructions for interacting with me using PR comments are available [here](https://git.k8s.io/community/contributors/guide/pull-requests.md). If you have questions or suggestions related to my behavior, please file an issue against the [kubernetes/test-infra](https://github.com/kubernetes/test-infra/issues/new?title=Prow%20issue:) repository.

davidvossel commented 2 years ago

/ok-to-test

coveralls commented 2 years ago

Pull Request Test Coverage Report for Build 2773915353

0 of 0 changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 48.383%

Totals
Change from base Build 2763291491:	0.0%
Covered Lines:	778
Relevant Lines:	1608

💛 - Coveralls

davidvossel commented 2 years ago

@rhrazdil anything else needed here before merging?

rhrazdil commented 2 years ago

@davidvossel If you're OK with the implementation code-wise, this PR should be ready. After skipping the failing tests, we have a sucessful run here: https://prow.ci.kubevirt.io/view/gs/kubevirt-prow/pr-logs/pull/kubevirt_project-infra/2233/rehearsal-pull-cluster-api-provider-kubevirt-conformance-e2e/1560157270698889216 which runs 298 conformance tests

k8s-ci-robot commented 2 years ago

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: davidvossel, rhrazdil

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files: - ~~[OWNERS](https://github.com/kubernetes-sigs/cluster-api-provider-kubevirt/blob/main/OWNERS)~~ [davidvossel] Approvers can indicate their approval by writing `/approve` in a comment Approvers can cancel approval by writing `/approve cancel` in a comment