defenseunicorns / leapfrogai

Production-ready Generative AI for local, cloud native, airgap, and edge deployments.
https://leapfrog.ai
Apache License 2.0
257 stars 29 forks source link

chore(test, release): nightly snapshot release and upgrade testing #1141

Closed justinthelaw closed 1 month ago

justinthelaw commented 1 month ago

Description

As part of compliance with the Made for UDS requirements, upgrade testing must be implemented separately from E2E functional/performance tests. Upgrade tests consist of an installation of a previous bundle version, performing a deployment of the newer "snapshot" bundle, and then running all E2E tests against the upgraded bundle.

This PR also implements a snapshot release, allowing for the separation of the creation of a dev bundle from the testing workflow. This allows for graceful handling of build errors (stop early, re-run) and aligns us with OSS/best practice standards for producing frequent releases for testing. As part of this implementation, releases are now a modular action that accepts two inputs, release tag and sub-repo.

NOTE: the nightly takes about 3 hours to complete - that's 3 hours of large runner costs

BREAKING CHANGES

CHANGES

Related Issue

Relates to #702

Checklist before merging

netlify[bot] commented 1 month ago

Deploy Preview for leapfrogai-docs canceled.

Name Link
Latest commit 102a0511ade41ba627acc6ed30c28f639c21e440
Latest deploy log https://app.netlify.com/sites/leapfrogai-docs/deploys/66f4bcc4f70602000846e5e4