Open lcheylus opened 9 months ago
I added case in FreeBSD CI/workflow when tests failed : the summary (Markdown format) displays a specific status for tests failure and the list of failed tests.
You can see an example of such a case with my OpenBSD workflow (WIP) : https://github.com/lcheylus/rust-coreutils/actions/runs/7669296982
GitHub workflow allows to add a Job summary with Markdown format:
In GH workflows, tests are runned with
cargo-nextest
tool (instead ofcargo test
). With version 0.9.66 and above, it adds an experimental support for producing machine-readable output for test runs, in a format similar to cargo test's libtest JSON output => https://nexte.st/book/run-machine-readable.htmlI tried to use this feature to generate file results for tests (JSON format) and to use them to generate summaries after end of the tests in FreeBSD workflow (could also be added in other workflows including tests).
NEXTEST_EXPERIMENTAL_LIBTEST_JSON=1 cargo nextest run --hide-progress-bar --profile ci --all-features -p uucore --message-format libtest-json-plus 1> "${WORKSPACE}/tests-uucore.json"