lf-edge / eden

Eden is where EVE and Adam get tried and tested:
https://projecteve.dev
Apache License 2.0
49 stars 47 forks source link

Test upgrade from LTS to the version from PR, not vice-versa #967

Closed milan-zededa closed 4 months ago

milan-zededa commented 4 months ago

EVE downgrade is generally not supported and it will fail between some versions, see for example: https://github.com/lf-edge/eve/pull/3812#issuecomment-1999741583

We should instead test upgrade from some LTS version to the latest version with the changes from the tested PR.

@uncleDecart We need to test EVE upgrades and not downgrades. In this PR I'm trying to figure out how to this but github actions are a mystery to me :)

milan-zededa commented 4 months ago

Do we still want to check that current version can handle upgrades to another versions properly? Is it still possible to downgrade to some recent version that we can change from time to time (having part of tests red for short time, but for some clear reason of no compatibility)?

Yeah, I guess it is easier to just change the EVE version that we use for testing upgrades/downgrades rather than trying to change the test workflow. I didn't realize that testing the "upgrade" from the PR-version of EVE is also something we want to have covered by the test. After all it makes sense to ensure that user will not be "stuck" in the new version. I'm closing this PR and will open another to update the EVE version that we use in update_eve_image tests.