trailofbits / differ

Detecting Inconsistencies in Feature or Function Evaluations of Requirements
GNU Affero General Public License v3.0
67 stars 4 forks source link

[Epic] Initial CHISEL Benchmark Support #30

Closed ameily closed 1 year ago

ameily commented 1 year ago

We have a working foundation, now we need to make sure that we can support and mirror something like the CHISEL Benchmark. This issue may provide samples for our integration tests, #24.

ameily commented 1 year ago

I can't get the CHISEL debloated version of bzip to accept an input file. I've tried providing the input file via the command line arguments, piping content from cat, redirecting from the input file. The only output I see is when I provide the input file as a command line parameter:

bzip2.chisel: Can't open input file input.bin: Success.

This creates an empty output file, input.bin.bz2. I've also tried the -c and other flags but they are treated as input file names and are not working properly.

ameily commented 1 year ago

I'm unable to get the remaining samples working on Ubuntu 20.04, I think due to some incompatibilities since they were originally built on Ubuntu 18.04.

ameily commented 1 year ago

The tar CHISEL binary passes some verification but produces extra files. For example, given the following:

echo "foo foo" > foo
echo "bar " > bar

The CHISEL tar extracts the following files:

bar
'bar '$'\n'
foo
'foo foo '$'\n'

The original tar is unable to extract the CHISEL produced archive.