reubeno / brush

bash/POSIX-compatible shell implemented in Rust
MIT License
20 stars 4 forks source link

test: add os-targeted integration tests #241

Closed reubeno closed 3 days ago

reubeno commented 4 days ago

For increased integration coverage, add new jobs that take the produced Linux/x86_64 release binaries and use them to run our compatibility and completion integration tests on each of Fedora, Debian, and Arch Linux.

In the future, we'll want to enable interactive tests and evaluate which other target platforms are appropriate for additional testing.

github-actions[bot] commented 4 days ago

Performance Benchmark Report

Benchmark name Baseline (μs) Test/PR (μs) Delta (μs) Delta %
expand_one_string 3.42 μs 3.41 μs -0.01 μs ⚪ Unchanged
instantiate_shell 60.41 μs 59.90 μs -0.51 μs ⚪ Unchanged
instantiate_shell_with_init_scripts 30295.87 μs 30388.89 μs 93.02 μs ⚪ Unchanged
parse_bash_completion 2792.35 μs 2774.44 μs -17.91 μs 🟢 -0.64%
parse_sample_script 4.30 μs 4.17 μs -0.13 μs ⚪ Unchanged
run_echo_builtin_command 90.62 μs 89.82 μs -0.80 μs ⚪ Unchanged
run_one_builtin_command 109.56 μs 109.58 μs 0.02 μs ⚪ Unchanged
run_one_external_command 1908.61 μs 1918.05 μs 9.44 μs ⚪ Unchanged
run_one_external_command_directly 1003.28 μs 1004.95 μs 1.67 μs ⚪ Unchanged

Code Coverage Report: Only Changed Files listed

Package Base Coverage New Coverage Difference
brush-core/src/builtins/command.rs 🟢 91.86% 🟢 90.7% 🔴 -1.16%
brush-core/src/jobs.rs 🔴 42.42% 🔴 37.23% 🔴 -5.19%
brush-core/src/shell.rs 🟢 83.52% 🟢 82.77% 🔴 -0.75%
brush-shell/src/args.rs 🟠 63.64% 🟠 62.22% 🔴 -1.42%
brush-shell/src/main.rs 🟢 90.85% 🟢 90.91% 🟢 0.06%
Overall Coverage 🟢 77.1% 🟢 76.96% 🔴 -0.14%

Minimum allowed coverage is 70%, this run produced 76.96%ced_ 73.44%

github-actions[bot] commented 4 days ago

Test Results

  2 files    9 suites   1m 8s ⏱️ 499 tests 499 ✅ 0 💤 0 ❌ 986 runs  986 ✅ 0 💤 0 ❌

Results for commit caad197f.

:recycle: This comment has been updated with latest results.