trendmicro / tlsh

Other
732 stars 136 forks source link

Recent changes broke the regression test #81

Closed jonjoliver closed 4 years ago

jonjoliver commented 4 years ago
===========
Cmake Tests
===========
Running tests...
Test project /Users/jono/Documents/TrendMicro/2016_docs/2016_TLSH/tlsh.github/build/release
    Start 1: tlsh_unittest_len
1/2 Test #1: tlsh_unittest_len ................   Passed    0.83 sec
    Start 2: tlsh_unittest_xlen
2/2 Test #2: tlsh_unittest_xlen ...............***Failed    0.01 sec

50% tests passed, 1 tests failed out of 2

Total Test time (real) =   0.84 sec

The following tests FAILED:
      2 - tlsh_unittest_xlen (Failed)
Errors while running CTest
make: *** [test] Error 8
jonjoliver commented 4 years ago

To replicate

$ cd Testing
$ ./test.sh

[stuff deleted]

Scenario: not considering len, ...
Scenario: tlsh   (c++ standard version)...

test 1

../bin/tlsh -r example_data -o tmp/example_data.out 2> tmp/example_data.err
passed
../bin/tlsh -r example_data -o tmp/example_data.json_out -ojson 2> tmp/example_data.err
diff: exp/example_data.128.1.5.xlen.json_out_EXP: No such file or directory
jonjoliver commented 4 years ago

I see the problem For some reason (historical accident) there is duplicated tests Combining _len tests and _xlen tests in CMakefile