This PR contains all campaign configs and other changes used in the final differ evaluation. Any fixes to the evaluation campaigns were applied to the original campaigns. This PR is rather big, so I will describe the commits, split up by day they were committed:
10/4 (8 commits)
Fix bug in differ where it did not print out the exit of the debloated binary
This is the only change in the entire PR which is not related to a campaign
Add campaign files for the evaluation
For each binary, there are up to three new campaigns:
eval.yml (standard Ubuntu)
eval-aggressive.yml (Ubuntu, but for binaries with different retained features)
eval-buster.yml (Debian Buster)
Fix yaml format error in grep campaigns
10/13 (19 commits)
Fix bugs in the campaigns (including the original files)
These bugs were largely found by fixing any crashes in the non-debloated runs
Add libfilter and gtirb-static to campaigns
10/16 (3 commits)
Fix some additional bugs in campaigns:
Remove unsupported test case in grep
Use ./tar.symlink for the eval campaign to prevent crashes from referencing non-existent binary
Fix path for objdumpgtirb-dynamic so binary can run
This PR contains all campaign configs and other changes used in the final differ evaluation. Any fixes to the evaluation campaigns were applied to the original campaigns. This PR is rather big, so I will describe the commits, split up by day they were committed:
10/4 (8 commits)
eval.yml(standard Ubuntu)eval-aggressive.yml(Ubuntu, but for binaries with different retained features)eval-buster.yml(Debian Buster)10/13 (19 commits)
libfilterandgtirb-staticto campaigns10/16 (3 commits)
grep./tar.symlinkfor the eval campaign to prevent crashes from referencing non-existent binaryobjdumpgtirb-dynamicso binary can run