lf-edge / eden

Eden is where EVE and Adam get tried and tested:
https://projecteve.dev
Apache License 2.0
50 stars 48 forks source link

EVE upgrade test flakiness #955

Closed uncleDecart closed 2 months ago

uncleDecart commented 9 months ago

This is a tracker to collect all EVE upgrade test suite runs, which failed in GitHub Actions

How to contribute?

If you see any failure in GitHub actions runs, please add it to this table.

How to find eden version?

Open workflow file of the run and see which eden tag is invoked, like here it is 0.9.3.

How to find EVE version?

In setup-job of workflow which failed find eve image parameter which in inputs. For example, here it is evebuild/pr:3698. In case if it contains evebuild/pr put PR in it.

Link to run Eden version EVE version test file system
1 0.9.5 master update_eve_image_oci zfs
2 master 11.7.0 update_eve_image_oci zfs

How to run suite locally

Clean previous build and add default config with debug level of printing

make clean && make build-tests
./eden config add default
./eden config set default --key eve.log-level --value debug

(optional) set EVE tag to a version you're testing

./eden config set default --key eve.tag --value 11.3.0

Setup and run a test

./eden setup
./dist/bin/eden+ports.sh 2223:2223
./eden start
./eden eve onboard
./eden test ./tests/workflow -s eve-upgrade.tests.txt -v debug
OhmSpectator commented 9 months ago

Oh... I have a looot to add to the upgrade tests... But first I have to understand on how to run them))

uncleDecart commented 9 months ago

@OhmSpectator please ping me if you need any help

uncleDecart commented 2 months ago

Stabilised. Will open new one if something occurs again