As part of compliance with the Made for UDS requirements, upgrade testing must be implemented separately from E2E functional/performance tests. Upgrade tests consist of an installation of a previous bundle version, performing a deployment of the newer "snapshot" bundle, and then running all E2E tests against the upgraded bundle.
This PR also implements a snapshot release, allowing for the separation of the creation of a dev bundle from the testing workflow. This allows for graceful handling of build errors (stop early, re-run) and aligns us with OSS/best practice standards for producing frequent releases for testing. As part of this implementation, releases are now a modular action that accepts two inputs, release tag and sub-repo.
NOTE: the nightly takes about 3 hours to complete - that's 3 hours of large runner costs
BREAKING CHANGES
N/A
CHANGES
adds an upgrade test that runs nightly against the last tagged release and the current commit on main
adds a snapshot release workflow that runs nightly using the current commit on main
refactors release to be a modular action used by release and nightly-snapshot-release
Related Issue
Relates to #702
Checklist before merging
[x] Tests, documentation, ADR added or updated as needed
Description
As part of compliance with the Made for UDS requirements, upgrade testing must be implemented separately from E2E functional/performance tests. Upgrade tests consist of an installation of a previous bundle version, performing a deployment of the newer "snapshot" bundle, and then running all E2E tests against the upgraded bundle.
This PR also implements a snapshot release, allowing for the separation of the creation of a dev bundle from the testing workflow. This allows for graceful handling of build errors (stop early, re-run) and aligns us with OSS/best practice standards for producing frequent releases for testing. As part of this implementation, releases are now a modular action that accepts two inputs, release tag and sub-repo.
NOTE: the nightly takes about 3 hours to complete - that's 3 hours of large runner costs
BREAKING CHANGES
CHANGES
Related Issue
Relates to #702
Checklist before merging