This PR adds support for the remaining CHISEL benchmark binaries and any required tooling to support them, including:
Bash script set -e support to fail immediately when the first command returns a non-zero exit code (#54)
Improved ComparisonResult class with more metadata (#53)
Improved parameter generation to cover all unique combinations (#52)
Pass environment variables to all Jinja2 templates (#51)
Compare file ownership (user and group) (#50)
About half of the CHISEL benchmark samples are not being run because they do not operate correctly. For these samples, the original binary is compared against itself.
This PR adds support for the remaining CHISEL benchmark binaries and any required tooling to support them, including:
set -e
support to fail immediately when the first command returns a non-zero exit code (#54)ComparisonResult
class with more metadata (#53)About half of the CHISEL benchmark samples are not being run because they do not operate correctly. For these samples, the original binary is compared against itself.