trailofbits / differ

Detecting Inconsistencies in Feature or Function Evaluations of Requirements
GNU Affero General Public License v3.0
67 stars 4 forks source link

Compare Hook Script Output #42

Closed ameily closed 1 year ago

ameily commented 1 year ago

Adds two new comparators, setup_script and teardown_script, that compare the exit code and stdout/stderr content for the setup and teardown scripts, respectively. The original issue was more expansive, allowing each hook body to define a list of comparators, which is really unnecessary. The core missing piece was capturing stdout/stderr and the exit code. Additional comparators, such as the file comparator, can still be used to compare the results of any file generated within a hook, such as a downloaded file.

Fixes #26