search

lf-edge / eden

Eden is where EVE and Adam get tried and tested:
https://projecteve.dev
Apache License 2.0
49 stars 47 forks source link

Smoke test suite flakiness #956

Closed uncleDecart closed 1 week ago

uncleDecart commented 7 months ago

This is a tracker to collect all Smoke test suite runs, which failed in GitHub Actions

How to contribute?

If you see any failure in GitHub actions runs, please add it to this table.

How to find eden version?

Open workflow file of the run and see which eden tag is invoked, like here it is 0.9.3.

How to find EVE version?

In setup-job of workflow which failed find eve image parameter which in inputs. For example, here it is evebuild/pr:3698. In case if it contains evebuild/pr put PR in it.

How can I find TPM and File System

It should be in brackets next to run name, for instance here name is Smoke tests (ext4, true) which means ext4 file system and TPM is enabled

Link to run Eden version EVE version test file system TPM
1 0.9.5 master shutdown_test ext4 enabled
2 0.9.5 PR eden_start zfs enabled
3 0.9.5 11.7.0 eden_onboard zfs enabled

How to run suite locally

Clean previous build and add default config with debug level of printing

make clean && make build-tests
./eden config add default
./eden config set default --key eve.log-level --value debug

(optional) set EVE tag to a version you're testing

./eden config set default --key eve.tag --value 11.3.0

Setup and run a test

./eden setup
./dist/bin/eden+ports.sh 2223:2223
./eden start
./eden eve onboard
./eden test ./tests/workflow -s smoke.tests.txt -v debug
christoph-zededa commented 3 months ago

see also https://github.com/lf-edge/eve/actions/runs/9192474194/job/25284249864#step:3:2900 ;-)

uncleDecart commented 1 week ago

Stabilised. Will open new one if something occurs again