OliverMKing commented 1 year ago

Description

Part 2 of some e2e improvements. This is targeting a new e2e framework and does not impact the current e2e environment (yet). The plan is to move all the e2e tests over to this new framework in the next pr and replace the existing one with this new one.

This change makes it so we can easily deploy an e2e testing image to each testing infrastructure cluster. This e2e testing image must run inside clusters to accommodate all cluster options (namely private clusters).

Additionally, this PR sets up the ability for e2e tests to be run in separate GitHub jobs.

We want e2e tests to run in a separate job for each phase with separate jobs for each infrastructure. This is to ensure that if we need to manually retry a test it it's simple and we don't need to retry everything. It also makes it easy to detect errors.

Type of change

Please delete options that are not relevant.

[ ] Bug fix (non-breaking change which fixes an issue)
[x] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] This change requires a documentation update

How Has This Been Tested?

Locally

Checklist:

[x] My code follows the style guidelines of this project
[x] I have performed a self-review of my code
[x] I have commented my code, particularly in hard-to-understand areas
[x] I have made corresponding changes to the documentation
[x] My changes generate no new warnings
[x] I have added tests that prove my fix is effective or that my feature works
[x] New and existing unit tests pass locally with my changes
[x] Any dependent changes have been merged and published in downstream modules

coveralls commented 1 year ago

Pull Request Test Coverage Report for Build 5868909783

0 of 0 changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 87.445%

Totals
Change from base Build 5868425389:	0.0%
Covered Lines:	1790
Relevant Lines:	2047

💛 - Coveralls