openwall / john

John the Ripper jumbo - advanced offline password cracker, which supports hundreds of hash and cipher types, and runs on many operating systems, CPUs, GPUs, and even some FPGAs
https://www.openwall.com/john/
Other
10.21k stars 2.09k forks source link

Several FAILED jtrts tests with -passthru --fork=2 #703

Closed frank-dittrich closed 10 years ago

frank-dittrich commented 10 years ago

latest bleeding-jumbo, 64bit linux (OMP disabled)...

(master)test $ ./jtrts.pl -noprelim -passthru --fork=2 -q
-------------------------------------------------------------------------------
- JtR-TestSuite (jtrts). Version 1.12.14, June 30, 2014.  By, Jim Fougeron & others
- Testing:  John the Ripper password cracker, version 1.8.0.2-bleeding-jumbo [linux-gnu 64-bit AVX-autoconf]
--------------------------------------------------------------------------------
form=dynamic_19                   guesses: 1501 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=dynamic_20                   guesses: 1845 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
sh: line 1:  3418 Segmentation fault      (core dumped) ../run/john -ses=./tst --fork=2 -pot=./tst.pot dynamic_21_tst.in --wordlist=pw.dic 2>&1 > /dev/null
form=dynamic_21                   guesses:    0 unk unk : Expected count(s) (1500)  [!!!FAILED!!!]
.pot CHK:dynamic_21               guesses:  260 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=dynamic_29-raw-utf8          guesses: 1519 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=dynamic_29-utf8              guesses: 1519 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=dynamic_29-sapf-utf8         guesses: 1420 0:00:00:00 DONE : Expected count(s) (1416)(1500)  [!!!FAILED!!!]
form=dynamic_33-NT-utf8           guesses: 1519 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=dynamic_33-sapf-utf8         guesses: 1420 0:00:00:00 DONE : Expected count(s) (1416)(1500)  [!!!FAILED!!!]
form=raw-md5u-raw-utf8            guesses: 1519 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=raw-md5u-utf8                guesses: 1519 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=raw-md5u-sapf-utf8           guesses: 1423 0:00:00:00 DONE : Expected count(s) (1416)(1500)  [!!!FAILED!!!]
form=descrypt                     guesses: 1567 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
.pot CHK:descrypt                 guesses: 1520 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=descrypt                     guesses: 1520 0:00:00:01 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
.pot CHK:descrypt                 guesses: 1508 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=mediawiki                    guesses:    0 unk unk : Expected count(s) (1500)  [!!!FAILED!!!]
Self test failed (get_hash[0](0))
Self test failed (get_hash[0](0))
form=pixMD5                       guesses: 1501 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=PHPS                         guesses:    0 unk unk : Expected count(s) (1500)  [!!!FAILED!!!]
Self test failed (get_hash[0](0))
Self test failed (get_hash[0](0))
form=raw-md5u-utf8                guesses: 1519 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=hmac-sha1                    guesses: 1536 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=hmac-sha224                  guesses: 1536 0:00:00:03 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=hmac-sha256                  guesses: 1536 0:00:00:04 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=dragonfly3-64                guesses: 1536 0:00:00:01 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=dragonfly4-64                guesses: 1536 0:00:00:01 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=lm                           guesses: 1501 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=pwdump_lm                    guesses: 1056 0:00:00:00 DONE : Expected count(s) (986)  [!!!FAILED!!!]
form=hmacMD5                      guesses: 1536 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=rakp                         guesses: 1536 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=BFegg                        guesses: 1501 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=MSSql                        guesses: 1538 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=MSSql-8859-1                 guesses: 1538 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=MSSql-8859-1-gen             guesses: 1505 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=oracle                       guesses: 1572 0:00:00:03 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=netlm-l0phtcrack             guesses: 1424 0:00:00:00 DONE : Expected count(s) (1351)  [!!!FAILED!!!]
form=lotus5                       guesses: 1501 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=epi                          guesses: 1536 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=rawsha0                      guesses: 1467 0:00:00:00 DONE : Expected count(s) (1464)  [!!!FAILED!!!]
form=mssql-utf8                   guesses: 1264 0:00:00:00 DONE : Expected count(s) (1229)  [!!!FAILED!!!]
form=mschapv2-utf8                guesses: 1471 0:00:00:25 DONE : Expected count(s) (1442)(1500)  [!!!FAILED!!!]
form=mschapv2-naive-utf8          guesses: 1536 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=netlmv2-utf8                 guesses: 1536 0:00:00:01 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=netntlm-utf8                 guesses: 1471 0:00:00:22 DONE : Expected count(s) (1442)(1500)  [!!!FAILED!!!]
form=netntlm(l0phtcrack)-utf8     guesses: 1471 0:00:00:19 DONE : Expected count(s) (1442)(1500)  [!!!FAILED!!!]
form=netntlm-naive-utf8           guesses: 1536 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=netntlm-naive(l0phtcrack)-ut guesses: 1536 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=netntlmv2-utf8               guesses: 1536 0:00:00:01 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=NT-utf8                      guesses: 1519 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=NTv2-utf8                    guesses: 1519 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=NT-raw-utf8                  guesses: 1519 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=NTv2-raw-utf8                guesses: 1519 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=mscash-utf8                  guesses: 1529 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=mssql05-utf8                 guesses: 1517 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=oracle-utf8                  guesses: 1548 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=raw-md5u-utf8                guesses: 1519 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=raw-md5u-raw-utf8            guesses: 1519 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=dynamic_29-raw-utf8          guesses: 1519 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=mssql-koi8r-gen              guesses: 1505 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=SAP F/G                      guesses: 6841 0:00:00:00 DONE : Expected count(s) (6794)  [!!!FAILED!!!]
form=sapB                         guesses: 1519 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
Some tests had Errors. Performed 289 tests.57 errors  3 errors reprocessing the .POT files
Time used was 1043 seconds

Somehow I wasn't able to reproduce the "Self test failed (get_hash0)" errors using --test=0.

The dynamic_21 segfault has been reported separately: https://github.com/magnumripper/JohnTheRipper/issues/702

frank-dittrich commented 10 years ago

BTW, these problems don't go away with

./jtrts.pl -noprelim -passthru --fork=2 -q
frank-dittrich commented 10 years ago

with --fork=2 --dupe, the list actually gets longer:

(master)test $ ./jtrts.pl -noprelim -passthru "--fork=2 --dupe" -q
-------------------------------------------------------------------------------
- JtR-TestSuite (jtrts). Version 1.12.14, June 30, 2014.  By, Jim Fougeron & others
- Testing:  John the Ripper password cracker, version 1.8.0.2-bleeding-jumbo [linux-gnu 64-bit AVX-autoconf]
--------------------------------------------------------------------------------
form=dynamic_19                   guesses: 1501 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=dynamic_20                   guesses: 1890 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
sh: line 1: 14890 Segmentation fault      (core dumped) ../run/john -ses=./tst --fork=2 --dupe -pot=./tst.pot dynamic_21_tst.in --wordlist=pw.dic 2>&1 > /dev/null
form=dynamic_21                   guesses:    0 unk unk : Expected count(s) (1500)  [!!!FAILED!!!]
.pot CHK:dynamic_21               guesses:  259 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=dynamic_29-raw-utf8          guesses: 1519 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=dynamic_29-utf8              guesses: 1230 0:00:00:00 DONE : Expected count(s) (1229)  [!!!FAILED!!!]
form=dynamic_29-utf8              guesses: 1519 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=dynamic_29-sapf-utf8         guesses: 1420 0:00:00:00 DONE : Expected count(s) (1416)(1500)  [!!!FAILED!!!]
form=dynamic_33-NT-utf8           guesses: 1519 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=dynamic_33-sapf-utf8         guesses: 1420 0:00:00:00 DONE : Expected count(s) (1416)(1500)  [!!!FAILED!!!]
form=raw-md5u-raw-utf8            guesses: 1519 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=raw-md5u-utf8                guesses: 1519 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=raw-md5u-sapf-utf8           guesses: 1423 0:00:00:00 DONE : Expected count(s) (1416)(1500)  [!!!FAILED!!!]
form=descrypt                     guesses: 1567 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
.pot CHK:descrypt                 guesses: 1532 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=descrypt                     guesses: 1520 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
.pot CHK:descrypt                 guesses: 1504 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=mediawiki                    guesses:    0 unk unk : Expected count(s) (1500)  [!!!FAILED!!!]
Self test failed (get_hash[0](0))
Self test failed (get_hash[0](0))
form=pixMD5                       guesses: 1501 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=PHPS                         guesses:    0 unk unk : Expected count(s) (1500)  [!!!FAILED!!!]
Self test failed (get_hash[0](0))
Self test failed (get_hash[0](0))
form=raw-md5u-utf8                guesses: 1519 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=hmac-sha1                    guesses: 1536 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=hmac-sha224                  guesses: 1536 0:00:00:03 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=hmac-sha256                  guesses: 1536 0:00:00:04 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=dragonfly3-64                guesses: 1536 0:00:00:01 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=dragonfly4-64                guesses: 1536 0:00:00:01 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=crc32_read_file              guesses:    0 unk unk : Expected count(s) (1500)  [!!!FAILED!!!]
form=crc32_dups                   guesses:   50 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=crc32_dups2                  guesses:   50 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=crc32_dups_read_file         guesses:    0 unk unk : Expected count(s) (1500)  [!!!FAILED!!!]
form=crc32_dups2_read_file        guesses:    0 unk unk : Expected count(s) (1500)  [!!!FAILED!!!]
form=crc32_dups_dupe_rem          guesses:    0 unk unk : Expected count(s) (50)  [!!!FAILED!!!]
form=crc32_dups2_dupe_rem         guesses:    0 unk unk : Expected count(s) (50)  [!!!FAILED!!!]
form=lm                           guesses: 1501 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=pwdump_lm                    guesses: 1056 0:00:00:00 DONE : Expected count(s) (986)  [!!!FAILED!!!]
form=hmacMD5                      guesses: 1536 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=rakp                         guesses: 1536 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=BFegg                        guesses: 1501 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=MSSql                        guesses: 1524 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=MSSql-8859-1                 guesses: 1524 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=MSSql-8859-1-gen             guesses: 1506 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=oracle                       guesses: 1572 0:00:00:02 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=netlm-l0phtcrack             guesses: 1426 0:00:00:00 DONE : Expected count(s) (1351)  [!!!FAILED!!!]
form=lotus5                       guesses: 1501 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=epi                          guesses: 1536 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=rawsha0                      guesses: 1467 0:00:00:00 DONE : Expected count(s) (1464)  [!!!FAILED!!!]
form=mssql-utf8                   guesses: 1249 0:00:00:00 DONE : Expected count(s) (1229)  [!!!FAILED!!!]
form=mschapv2-utf8                guesses: 1471 0:00:00:25 DONE : Expected count(s) (1442)(1500)  [!!!FAILED!!!]
form=mschapv2-naive-utf8          guesses: 1536 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=netlmv2-utf8                 guesses: 1536 0:00:00:01 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=netntlm-utf8                 guesses: 1471 0:00:00:23 DONE : Expected count(s) (1442)(1500)  [!!!FAILED!!!]
form=netntlm(l0phtcrack)-utf8     guesses: 1471 0:00:00:16 DONE : Expected count(s) (1442)(1500)  [!!!FAILED!!!]
form=netntlm-naive-utf8           guesses: 1536 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=netntlm-naive(l0phtcrack)-ut guesses: 1536 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=netntlmv2-utf8               guesses: 1536 0:00:00:01 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=NT-utf8                      guesses: 1519 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=NTv2-utf8                    guesses: 1519 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=NT-raw-utf8                  guesses: 1519 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=NTv2-raw-utf8                guesses: 1519 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=mscash-utf8                  guesses: 1529 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=mssql05-utf8                 guesses: 1517 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=oracle-utf8                  guesses: 1548 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=raw-md5u-utf8                guesses: 1519 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=raw-md5u-raw-utf8            guesses: 1519 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=dynamic_29-raw-utf8          guesses: 1519 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=mssql-koi8r-gen              guesses: 1505 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
form=SAP F/G                      guesses: 6841 0:00:00:00 DONE : Expected count(s) (6794)  [!!!FAILED!!!]
form=sapB                         guesses: 1519 0:00:00:00 DONE : Expected count(s) (1500)  [!!!FAILED!!!]
Some tests had Errors. Performed 289 tests.65 errors  3 errors reprocessing the .POT files
Time used was 1013 seconds

May be instead of counting guesses, we should evaluate the "--show |tail -n 1" output?

NOTE: I didn't test any GPU formats.

magnumripper commented 10 years ago

BTW, these problems don't go away with ./jtrts.pl -noprelim -passthru --fork=2 -q

That was what you ran in the first place. Did you mean adding -dupe?

frank-dittrich commented 10 years ago

Yes, I meant -passthru "--fork2 --dupe"

magnumripper commented 10 years ago

This is 99% a Test Suite issue (magnumripper/jtrTestSuite#13). I'm closing this. The actual JtR bugs (if any) should be added as separate issues.