ComplianceAsCode / compliance-operator

Operator providing Kubernetes cluster compliance checks
Apache License 2.0
36 stars 22 forks source link

CMP-2547: Implement ROSA e2e test suite #515

Closed rhmdnd closed 3 months ago

rhmdnd commented 3 months ago

We have to handle some differences in how we setup e2e testing on managed OpenShift offerings, like ROSA. This commit stands up a separate e2e suite that will be specific to ROSA test cases and wires it up to a Makefile target for easy use.

openshift-ci-robot commented 3 months ago

@rhmdnd: This pull request references CMP-2547 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.16.0" version, but no target version was set.

In response to [this](https://github.com/ComplianceAsCode/compliance-operator/pull/515): >We have to handle some differences in how we setup e2e testing on >managed OpenShift offerings, like ROSA. This commit stands up a separate >e2e suite that will be specific to ROSA test cases and wires it up to a >Makefile target for easy use. > Instructions for interacting with me using PR comments are available [here](https://prow.ci.openshift.org/command-help?repo=ComplianceAsCode%2Fcompliance-operator). If you have questions or suggestions related to my behavior, please file an issue against the [openshift-eng/jira-lifecycle-plugin](https://github.com/openshift-eng/jira-lifecycle-plugin/issues/new) repository.
rhmdnd commented 3 months ago

Quick rough draft that I was able to get working with a rosa HCP cluster (no master nodes, only worker nodes).

We'll need a separate PR to wire up testing in openshift/release so we can run this against an actual ROSA cluster.

rhmdnd commented 3 months ago

/test e2e-rosa

rhmdnd commented 3 months ago

Rerunning the rosa e2e job since it failed to provision the cluster. Unrelated to this change.

rhmdnd commented 3 months ago

/test e2e-rosa

rhmdnd commented 3 months ago

/test e2e-rosa

rhmdnd commented 3 months ago

Adding doc, px, and qe labels since this is an upstream testing change for developer productivity.

openshift-ci[bot] commented 3 months ago

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: rhmdnd, Vincent056

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files: - ~~[OWNERS](https://github.com/ComplianceAsCode/compliance-operator/blob/master/OWNERS)~~ [Vincent056,rhmdnd] Approvers can indicate their approval by writing `/approve` in a comment Approvers can cancel approval by writing `/approve cancel` in a comment