search

randombit / botan

Cryptography Toolkit
https://botan.randombit.net
BSD 2-Clause "Simplified" License
2.54k stars 562 forks source link

Current master fails tests #656

Closed mouse07410 closed 7 years ago

mouse07410 commented 7 years ago

Mac OS X 10.11.6 El Capitan. Xcode-8.0. Installed OpenSSL-1.0.2j (via Macports). Current Botan master, configured:

$ ./configure.py --prefix=/opt/local --with-openssl --with-boost --with-lzma --with-bzip2 --with-zlib --with-sqlite3 --with-python-version=2.7 --with-sphinx --cc=clang --enable-modules=pkcs11 --cc-abi-flags='-maes -mpclmul -mrdrnd -msse2 -mssse3 -msse4 -msse4.2 -Os -Ofast -I/opt/local/include' --with-external-includedir='/Users/ur20980/src/pkcs11-base/'
./configure.py --prefix=/opt/local --without-unaligned-mem --with-openssl --with-boost --with-lzma --with-bzip2 --with-zlib --with-sqlite3 --with-python-version=2.7 --with-sphinx --enable-modules=pkcs11 --cc-abi-flags='-maes -mpclmul -mrdrnd -msse2 -mssse3 -msse4 -msse4.2 -Os -Ofast -I/opt/local/include'
   INFO: ./configure.py invoked with options "--prefix=/opt/local --without-unaligned-mem --with-openssl --with-boost --with-lzma --with-bzip2 --with-zlib --with-sqlite3 --with-python-version=2.7 --with-sphinx --enable-modules=pkcs11 --cc-abi-flags=-maes -mpclmul -mrdrnd -msse2 -mssse3 -msse4 -msse4.2 -Os -Ofast -I/opt/local/include"
   INFO: Platform: OS="Darwin" machine="x86_64" proc="i386"
   INFO: Guessing target OS is darwin (use --os to set)
   INFO: Guessing to use compiler clang (use --cc to set)
   INFO: Guessing target processor is a x86_64/x86_64 (use --cpu to set)
   INFO: Target is clang-darwin-x86_64-x86_64
   INFO: Skipping, incompatible OS - beos_stats cryptoapi_rng win32_stats
   INFO: Skipping, requires external dependency - tpm
   INFO: Loading modules adler32 aead aes aes_ni aes_ssse3 aont asn1 auto_rng base base64 bcrypt bigint blake2 block blowfish boost bzip2 camellia cascade cast cbc cbc_mac ccm certstor_sql certstor_sqlite3 cfb chacha chacha20poly1305 chacha_sse2 clmul cmac codec_filt comb4p compression crc24 crc32 cryptobox ctr curve25519 darwin_secrandom datastor des dev_random dh dl_algo dl_group dlies dsa dyn_load eax ec_gfp ec_group ecb ecc_key ecdh ecdsa ecgdsa ecies eckcdsa egd elgamal eme_oaep eme_pkcs1 eme_raw emsa1 emsa_pkcs1 emsa_pssr emsa_raw emsa_x931 entropy fd_unix ffi filters fpe_fe1 gcm gost_28147 gost_3410 gost_3411 hash hash_id hex hkdf hmac hmac_drbg hmac_rng http_util idea idea_sse2 kasumi kdf kdf1 kdf1_iso18033 kdf2 keccak keypair lion locking_allocator lzma mac mce mceies md4 md5 mdx_hash mgf1 misty1 mode_pad modes mp newhope noekeon noekeon_simd numbertheory ocb ofb oid_lookup openpgp openssl par_hash passhash9 pbes2 pbkdf pbkdf1 pbkdf2 pem pk_pad pkcs11 poly1305 prf_tls prf_x942 proc_walk pubkey rc4 rdrand rdrand_rng rdseed rfc3394 rfc6979 rmd160 rng rsa salsa20 seed serpent serpent_simd sessions_sql sessions_sqlite3 sha1 sha1_sse2 sha2_32 sha2_64 simd siphash siv skein sp800_108 sp800_56c sqlite3 srp6 stateful_rng stream system_rng threefish threefish_avx2 tiger tls tss twofish unix_procs utils whirlpool x509 x919_mac x931_rng xtea xts zlib
   INFO: Enabling use of external dependency boost
   INFO: Enabling use of external dependency bzip2
   INFO: Enabling use of external dependency lzma
   INFO: Enabling use of external dependency openssl
   INFO: Enabling use of external dependency pkcs11
   INFO: Enabling use of external dependency sqlite3
   INFO: Enabling use of external dependency zlib
   INFO: Assuming CPU is little endian
   INFO: Using symlink to link files into build dir (use --link-method to change)
   INFO: Botan 1.11.33 (unreleased undated) build setup is complete

Some compilation warnings:

. . . . .
clang++  -m64 -pthread -stdlib=libc++ -maes -mpclmul -mrdrnd -msse2 -mssse3 -msse4 -msse4.2 -Os -Ofast -I/opt/local/include -fPIC -fvisibility=hidden -std=c++11 -D_REENTRANT -fstack-protector -O3 -Wall -Wextra -Wpedantic -Wshadow -Wstrict-aliasing -Wstrict-overflow=5 -Wcast-align -Wmissing-declarations -Wpointer-arith -Wcast-qual -Wunreachable-code -Ibuild/include -Ibuild/include/external -c ./src/lib/block/aes/aes.cpp -o build/obj/lib/block_aes.o
In file included from ./src/lib/block/aes/aes.cpp:12:
build/include/botan/cpuid.h:173:27: warning: comparison of constant 128 with expression of
      type 'Botan::CPUID::CPUID_bits' is always true
      [-Wtautological-constant-out-of-range-compare]
         BOTAN_ASSERT(bit < 128, "CPUID bit within bounds");
                      ~~~ ^ ~~~
build/include/botan/assert.h:29:12: note: expanded from macro 'BOTAN_ASSERT'
      if(!(expr))                                         \
           ^~~~
1 warning generated.
. . . . .
clang++  -m64 -pthread -stdlib=libc++ -maes -mpclmul -mrdrnd -msse2 -mssse3 -msse4 -msse4.2 -Os -Ofast -I/opt/local/include -fPIC -fvisibility=hidden -std=c++11 -D_REENTRANT -fstack-protector -O3 -Wall -Wextra -Wpedantic -Wshadow -Wstrict-aliasing -Wstrict-overflow=5 -Wcast-align -Wmissing-declarations -Wpointer-arith -Wcast-qual -Wunreachable-code -Ibuild/include -Ibuild/include/external -c ./src/lib/ffi/ffi.cpp -o build/obj/lib/ffi.o
./src/lib/ffi/ffi.cpp:988:51: warning: 'PK_Encryptor_EME' is deprecated
      [-Wdeprecated-declarations]
      std::unique_ptr<Botan::PK_Encryptor> pk(new Botan::PK_Encryptor_EME(safe_get(k...
                                                  ^
build/include/botan/pubkey.h:519:7: note: 'PK_Encryptor_EME' has been explicitly marked
      deprecated here
      PK_Encryptor_EME(const Public_Key& key,
      ^
./src/lib/ffi/ffi.cpp:1033:51: warning: 'PK_Decryptor_EME' is deprecated
      [-Wdeprecated-declarations]
      std::unique_ptr<Botan::PK_Decryptor> pk(new Botan::PK_Decryptor_EME(safe_get(k...
                                                  ^
build/include/botan/pubkey.h:561:7: note: 'PK_Decryptor_EME' has been explicitly marked
      deprecated here
      PK_Decryptor_EME(const Private_Key& key,
      ^
./src/lib/ffi/ffi.cpp:1077:48: warning: 'PK_Signer' is deprecated
      [-Wdeprecated-declarations]
      std::unique_ptr<Botan::PK_Signer> pk(new Botan::PK_Signer(safe_get(key_obj), hash));
                                               ^
build/include/botan/pubkey.h:186:7: note: 'PK_Signer' has been explicitly marked deprecated
      here
      PK_Signer(const Private_Key& key,
      ^
./src/lib/ffi/ffi.cpp:1168:55: warning: 'PK_Key_Agreement' is deprecated
      [-Wdeprecated-declarations]
      std::unique_ptr<Botan::PK_Key_Agreement> pk(new Botan::PK_Key_Agreement(safe_g...
                                                      ^
build/include/botan/pubkey.h:411:7: note: 'PK_Key_Agreement' has been explicitly marked
      deprecated here
      PK_Key_Agreement(const Private_Key& key,
      ^
4 warnings generated.
. . . . .
clang++  -m64 -pthread -stdlib=libc++ -maes -mpclmul -mrdrnd -msse2 -mssse3 -msse4 -msse4.2 -Os -Ofast -I/opt/local/include -fPIC -fvisibility=hidden -std=c++11 -D_REENTRANT -fstack-protector -O3 -Wall -Wextra -Wpedantic -Wshadow -Wstrict-aliasing -Wstrict-overflow=5 -Wcast-align -Wmissing-declarations -Wpointer-arith -Wcast-qual -Wunreachable-code -Ibuild/include -Ibuild/include/external -c ./src/lib/pubkey/curve25519/donna.cpp -o build/obj/lib/pubkey_curve25519_donna.o
./src/lib/pubkey/curve25519/donna.cpp:377:29: warning: suggest braces around initialization
      of subobject [-Wmissing-braces]
      fmonty_out_t result { nqx2, nqz2, nqpqx2, nqpqz2 };
                            ^~~~~~~~~~
                            {         }
./src/lib/pubkey/curve25519/donna.cpp:377:41: warning: suggest braces around initialization
      of subobject [-Wmissing-braces]
      fmonty_out_t result { nqx2, nqz2, nqpqx2, nqpqz2 };
                                        ^~~~~~~~~~~~~~
                                        {             }
./src/lib/pubkey/curve25519/donna.cpp:378:24: warning: suggest braces around initialization
      of subobject [-Wmissing-braces]
      fmonty_in_t in { nqx, nqz, nqpqx, nqpqz, q };
                       ^~~~~~~~
                       {       }
./src/lib/pubkey/curve25519/donna.cpp:378:34: warning: suggest braces around initialization
      of subobject [-Wmissing-braces]
      fmonty_in_t in { nqx, nqz, nqpqx, nqpqz, q };
                                 ^~~~~~~~~~~~
                                 {           }
4 warnings generated.
. . . . .

Several tests fail:

$  ./botan-test
Testing Botan 1.11.33 (unreleased, revision git:29911fcc0aaf764b9d02d5ebec09423be4a6d4f2, distribution unspecified)
Starting tests soak level:5 rng:HMAC_DRBG with seed '00000EC2D1ED7984'
AES-128 ran 16170 tests in 38.97 msec all ok
AES-192 ran 18858 tests in 41.57 msec all ok
AES-256 ran 21546 tests in 48.35 msec all ok
Blowfish ran 840 tests in 15.03 msec all ok
CAST-128 ran 574 tests in 1.71 msec all ok
CAST-256 ran 91 tests in 0.24 msec all ok
Camellia-128 ran 84 tests in 0.23 msec all ok
Camellia-192 ran 42 tests in 0.10 msec all ok
Camellia-256 ran 70 tests in 0.22 msec all ok
Cascade(Serpent,AES-256) ran 14 tests in 0.06 msec all ok
Cascade(Serpent,CAST-128) ran 7 tests in 0.04 msec all ok
Cascade(Serpent,Twofish) ran 21 tests in 0.20 msec all ok
DES ran 4508 tests in 10.76 msec all ok
DESX ran 63 tests in 0.13 msec all ok
GOST-28147-89(R3411_94_TestParam) ran 126 tests in 0.36 msec all ok
GOST-28147-89(R3411_CryptoPro) ran 70 tests in 0.19 msec all ok
IDEA ran 15148 tests in 45.19 msec all ok
KASUMI ran 21 tests in 0.08 msec all ok
Lion(SHA-160,RC4,64) ran 7 tests in 0.13 msec all ok
MISTY1 ran 217 tests in 0.73 msec all ok
Noekeon ran 28 tests in 0.11 msec all ok
SEED ran 56 tests in 0.22 msec all ok
Serpent ran 14630 tests in 38.25 msec all ok
Threefish-512 ran 56 tests in 0.19 msec all ok
TripleDES ran 812 tests in 1.85 msec all ok
Twofish ran 7749 tests in 36.72 msec all ok
XTEA ran 259 tests in 0.57 msec all ok
CTR-BE(AES-128) ran 12 tests in 0.28 msec all ok
CTR-BE(AES-192) ran 3 tests in 0.02 msec all ok
CTR-BE(AES-256) ran 3 tests in 0.02 msec all ok
CTR-BE(DES) ran 39 tests in 0.16 msec all ok
CTR-BE(Noekeon) ran 384 tests in 1.24 msec all ok
CTR-BE(Serpent) ran 333 tests in 1.45 msec all ok
CTR-BE(TripleDES) ran 447 tests in 4.05 msec all ok
CTR-BE(XTEA) ran 171 tests in 0.54 msec all ok
ChaCha(12) ran 12 tests in 0.04 msec all ok
ChaCha(20) ran 444 tests in 1.54 msec all ok
ChaCha(8) ran 114 tests in 0.41 msec all ok
MARK-4 ran 30 tests in 0.16 msec all ok
OFB(AES-128) ran 3 tests in 0.02 msec all ok
OFB(AES-192) ran 3 tests in 0.02 msec all ok
OFB(AES-256) ran 3 tests in 0.02 msec all ok
OFB(DES) ran 12 tests in 0.09 msec all ok
RC4 ran 414 tests in 3.07 msec all ok
Salsa20 ran 21 tests in 0.12 msec all ok
Adler32 ran 153 tests in 0.32 msec all ok
Blake2b(224) ran 1278 tests in 3.37 msec all ok
Blake2b(256) ran 1278 tests in 3.45 msec all ok
Blake2b(384) ran 1278 tests in 2.06 msec all ok
Blake2b(512) ran 1343 tests in 2.60 msec all ok
CRC24 ran 163 tests in 0.17 msec all ok
CRC32 ran 153 tests in 0.17 msec all ok
Comb4P(MD4,MD5) ran 5 tests in 0.09 msec all ok
Comb4P(SHA-160,RIPEMD-160) ran 5 tests in 0.07 msec all ok
GOST-R-34.11-94 ran 49 tests in 0.58 msec all ok
Keccak-1600(224) ran 1338 tests in 4.31 msec all ok
Keccak-1600(256) ran 1338 tests in 3.92 msec all ok
Keccak-1600(384) ran 1338 tests in 3.40 msec all ok
Keccak-1600(512) ran 1338 tests in 3.63 msec all ok
MD4 ran 742 tests in 0.65 msec all ok
MD5 ran 752 tests in 0.86 msec all ok
Parallel(MD5,SHA-160) ran 8 tests in 0.07 msec all ok
Parallel(SHA-256,SHA-512) ran 4 tests in 0.04 msec all ok
RIPEMD-160 ran 754 tests in 1.39 msec all ok
SHA-160 ran 1512 tests in 1.72 msec all ok
SHA-224 ran 16 tests in 0.05 msec all ok
SHA-256 ran 2616 tests in 3.55 msec all ok
SHA-384 ran 66 tests in 0.11 msec all ok
SHA-512 ran 66 tests in 0.08 msec all ok
SHA-512-256 ran 4 tests in 0.01 msec all ok
Skein-512(224) ran 1278 tests in 3.73 msec all ok
Skein-512(256) ran 1278 tests in 4.28 msec all ok
Skein-512(384) ran 1278 tests in 3.08 msec all ok
Skein-512(512) ran 1338 tests in 3.17 msec all ok
Tiger(16,3) ran 9 tests in 0.06 msec all ok
Tiger(20,3) ran 9 tests in 0.03 msec all ok
Tiger(24,3) ran 44 tests in 0.14 msec all ok
Whirlpool ran 38 tests in 0.25 msec all ok
CBC-MAC(AES-128) ran 282 tests in 0.84 msec all ok
CBC-MAC(DES) ran 192 tests in 0.66 msec all ok
CMAC(AES-128) ran 130 tests in 0.49 msec all ok
CMAC(AES-192) ran 34 tests in 0.16 msec all ok
CMAC(AES-256) ran 40 tests in 0.15 msec all ok
CMAC(Blowfish) ran 6 tests in 0.51 msec all ok
CMAC(Threefish-512) ran 6 tests in 0.03 msec all ok
HMAC(MD5) ran 24 tests in 0.11 msec all ok
HMAC(RIPEMD-160) ran 24 tests in 0.08 msec all ok
HMAC(SHA-160) ran 36 tests in 0.12 msec all ok
HMAC(SHA-256) ran 30 tests in 0.09 msec all ok
Poly1305 ran 462 tests in 0.93 msec all ok
SipHash(2,4) ran 6 tests in 0.03 msec all ok
X9.19-MAC ran 36 tests in 0.19 msec all ok
AES-128/CBC/CTS ran 30 tests in 0.22 msec all ok
AES-128/CBC/NoPadding ran 5 tests in 0.04 msec all ok
AES-128/CFB ran 5 tests in 0.03 msec all ok
AES-128/CFB(8) ran 5 tests in 0.05 msec all ok
AES-128/ECB/NoPadding ran 5 tests in 0.06 msec all ok
AES-128/XTS ran 305 tests in 2.49 msec all ok
AES-192/CBC/NoPadding ran 5 tests in 0.04 msec all ok
AES-192/CFB ran 5 tests in 0.03 msec all ok
AES-192/CFB(8) ran 5 tests in 0.04 msec all ok
AES-256/CBC/NoPadding ran 5 tests in 0.04 msec all ok
AES-256/CFB ran 5 tests in 0.03 msec all ok
AES-256/CFB(8) ran 5 tests in 0.04 msec all ok
AES-256/XTS ran 225 tests in 1.26 msec all ok
DES/CBC/CTS ran 210 tests in 1.24 msec all ok
DES/CBC/NoPadding ran 5 tests in 0.13 msec all ok
DES/CBC/OneAndZeros ran 175 tests in 1.17 msec all ok
DES/CBC/PKCS7 ran 165 tests in 1.31 msec all ok
DES/CFB ran 100 tests in 0.71 msec all ok
DES/CFB(16) ran 30 tests in 0.32 msec all ok
DES/CFB(32) ran 35 tests in 0.35 msec all ok
DES/CFB(8) ran 50 tests in 0.60 msec all ok
DES/ECB/NoPadding ran 10 tests in 0.09 msec all ok
DES/ECB/OneAndZeros ran 125 tests in 0.89 msec all ok
DES/ECB/PKCS7 ran 105 tests in 0.70 msec all ok
IDEA/ECB/NoPadding ran 5 tests in 0.05 msec all ok
Noekeon/CBC/PKCS7 ran 640 tests in 3.85 msec all ok
Serpent/ECB/NoPadding ran 5 tests in 0.09 msec all ok
Serpent/XTS ran 1210 tests in 6.13 msec all ok
TripleDES/XTS ran 640 tests in 4.30 msec all ok
Twofish/XTS ran 1200 tests in 17.26 msec all ok
XTEA/ECB/NoPadding ran 155 tests in 1.27 msec all ok
PBKDF1(SHA-1) ran 5 tests in 3.41 msec all ok
PBKDF2(CMAC(Blowfish)) ran 1 tests in 0.12 msec all ok
PBKDF2(SHA-1) ran 10 tests in 19.01 msec all ok
PBKDF2(SHA-256) ran 1 tests in 18.36 msec all ok
PBKDF2(SHA-384) ran 1 tests in 15.69 msec all ok
PBKDF2(SHA-512) ran 1 tests in 13.03 msec all ok
HMAC_DRBG(SHA-1) ran 240 tests in 8.27 msec all ok
HMAC_DRBG(SHA-224) ran 240 tests in 10.03 msec all ok
HMAC_DRBG(SHA-256) ran 240 tests in 10.40 msec all ok
HMAC_DRBG(SHA-384) ran 240 tests in 13.15 msec all ok
HMAC_DRBG(SHA-512) ran 240 tests in 15.47 msec all ok
HMAC_DRBG(SHA-512-256) ran 240 tests in 20.86 msec all ok
X9.31-RNG(AES-128) ran 128 tests in 0.72 msec all ok
X9.31-RNG(AES-192) ran 128 tests in 0.72 msec all ok
X9.31-RNG(AES-256) ran 128 tests in 0.65 msec all ok
Util load/store ran 229 tests all ok
Util round_down ran 6 tests in 0.01 msec all ok
Util round_up ran 11 tests in 0.17 msec all ok
AES-128/CCM(10,2) ran 1 tests in 0.14 msec all ok
AES-128/CCM(16,2) ran 2 tests in 0.24 msec all ok
AES-128/CCM(16,3) ran 1 tests in 0.12 msec all ok
AES-128/CCM(8,2) ran 3 tests in 0.48 msec all ok
AES-128/EAX ran 78 tests in 7.66 msec all ok
AES-128/EAX(8) ran 2 tests in 0.26 msec all ok
AES-128/GCM ran 36 tests in 4.33 msec all ok
AES-128/GCM(8) ran 4 tests in 0.42 msec all ok
AES-128/OCB ran 25 tests in 3.81 msec all ok
AES-128/OCB(12) ran 1 tests in 0.10 msec all ok
AES-128/SIV ran 2 tests in 0.24 msec all ok
AES-192/GCM ran 24 tests in 2.38 msec all ok
AES-256/GCM ran 24 tests in 2.29 msec all ok
Blowfish/EAX ran 17 tests in 6.67 msec all ok
ChaCha20Poly1305 ran 7 tests in 0.67 msec all ok
DES/EAX ran 17 tests in 1.50 msec all ok
Threefish-512/EAX ran 1 tests in 0.13 msec all ok
TripleDES/EAX ran 17 tests in 1.95 msec all ok
Twofish/EAX ran 33 tests in 4.37 msec all ok
Base64 ran 64 tests in 0.11 msec all ok
NoPadding ran 10 tests in 0.02 msec all ok
OneAndZeros ran 10 tests in 0.01 msec all ok
PKCS7 ran 10 tests in 0.01 msec all ok
X9.23 ran 10 tests in 0.01 msec all ok
bcrypt ran 8 tests in 10.81 msec all ok
BigInt encoding functions ran 1 tests all ok
BigInt size functions ran 72 tests all ok
BigInt::random_integer ran 100010 tests in 431.82 msec all ok
BigInt Addition ran 292 tests in 96.66 msec all ok
BigInt Divide ran 72 tests in 12.14 msec all ok
BigInt InvMod ran 305 tests in 73.49 msec all ok
BigInt IsPrime ran 28 tests in 7.18 msec all ok
BigInt Lshift ran 100 tests in 52.76 msec all ok
BigInt Mod ran 171 tests in 13.16 msec all ok
BigInt Multiply ran 412 tests in 437.40 msec all ok
BigInt Powmod ran 39 tests in 64.45 msec all ok
BigInt Ressol ran 18 tests in 10.60 msec all ok
BigInt Rshift ran 102 tests in 14.92 msec all ok
BigInt Square ran 42 tests in 6.91 msec all ok
BigInt Subtraction ran 126 tests in 40.49 msec all ok
Certificate Store - All subjects ran 7 tests all ok
Certificate Store - CRL ran 9 tests all ok
Certificate Store - Insert, Find, Remove ran 38 tests all ok
Charset ran 9 tests in 0.03 msec all ok
Charset negative tests ran 5 tests all ok
bz2 compression ran 16 tests all ok
deflate compression ran 16 tests all ok
gzip compression ran 16 tests all ok
lzma compression ran 16 tests all ok
zlib compression ran 16 tests all ok
cryptobox ran 1 tests all ok
Curve25519 keygen ran 18 tests all ok
Curve25519 roundtrip ran 6 tests all ok
Curve25519 scalarmult ran 18 tests in 2.09 msec all ok
DH negative tests ran 2 tests all ok
Diffie-Hellman/KDF2(SHA-1) key agreement ran 4 tests in 7.64 msec all ok
Diffie-Hellman/Raw key agreement ran 8 tests in 91.62 msec all ok
DH modp/ietf/1024 keygen ran 18 tests all ok
DH modp/ietf/2048 keygen ran 18 tests all ok
DLIES AES-256/CBC ran 84 tests in 9.01 sec all ok
DLIES AES-256/GCM ran 16 tests in 1.67 sec all ok
DLIES XOR ran 44 tests in 4.67 sec all ok
DLIES XOR ran 12 tests all ok
DSA/EMSA1(SHA-1) signature generation ran 45 tests in 207.32 msec all ok
DSA/EMSA1(SHA-224) signature generation ran 36 tests in 150.66 msec all ok
DSA/EMSA1(SHA-256) signature generation ran 36 tests in 144.91 msec all ok
DSA/EMSA1(SHA-384) signature generation ran 36 tests in 153.77 msec all ok
DSA/EMSA1(SHA-512) signature generation ran 36 tests in 137.98 msec all ok
DSA dsa/botan/2048 keygen ran 18 tests all ok
DSA dsa/jce/1024 keygen ran 18 tests all ok
ECC Scalarmult frp256v1 ran 104 tests in 190.14 msec all ok
ECC Scalarmult secp192r1 ran 104 tests in 81.75 msec all ok
ECC Scalarmult secp224r1 ran 104 tests in 84.92 msec all ok
ECC Scalarmult secp256k1 ran 100 tests in 97.53 msec all ok
ECC Scalarmult secp256r1 ran 104 tests in 112.81 msec all ok
ECC Scalarmult secp384r1 ran 104 tests in 177.26 msec all ok
ECC Scalarmult secp521r1 ran 104 tests in 286.59 msec all ok
ECC randomized brainpool160r1 ran 62 tests all ok
ECC randomized brainpool192r1 ran 62 tests all ok
ECC randomized brainpool224r1 ran 62 tests all ok
ECC randomized brainpool256r1 ran 62 tests all ok
ECC randomized brainpool320r1 ran 62 tests all ok
ECC randomized brainpool384r1 ran 62 tests all ok
ECC randomized brainpool512r1 ran 62 tests all ok
ECC randomized gost_256A ran 62 tests all ok
ECC randomized secp160k1 ran 62 tests all ok
ECC randomized secp160r1 ran 62 tests all ok
ECC randomized secp160r2 ran 62 tests all ok
ECC randomized secp192k1 ran 62 tests all ok
ECC randomized secp192r1 ran 62 tests all ok
ECC randomized secp224k1 ran 62 tests all ok
ECC randomized secp224r1 ran 62 tests all ok
ECC randomized secp256k1 ran 62 tests all ok
ECC randomized secp256r1 ran 62 tests all ok
ECC randomized secp384r1 ran 62 tests all ok
ECC randomized secp521r1 ran 62 tests all ok
ECC randomized x962_p192v2 ran 62 tests all ok
ECC randomized x962_p192v3 ran 62 tests all ok
ECC randomized x962_p239v1 ran 62 tests all ok
ECC randomized x962_p239v2 ran 62 tests all ok
ECC randomized x962_p239v3 ran 62 tests all ok
ECC Unit ran 99 tests all ok
ECDH/Raw secp192r1 key agreement ran 50 tests in 111.26 msec all ok
ECDH/Raw secp224r1 key agreement ran 50 tests in 111.12 msec all ok
ECDH/Raw secp256r1 key agreement ran 50 tests in 136.41 msec all ok
ECDH/Raw secp384r1 key agreement ran 50 tests in 218.72 msec all ok
ECDH/Raw secp521r1 key agreement ran 50 tests in 365.19 msec all ok
frp256v1 ran 25 tests 25 FAILED
Failure 1: test 1 failed with exception 'OpenSSL ECDH refused key or params d2i_ECPrivateKey failed: error:1009E077:lib(16):func(158):reason(119)'
Failure 2: test 2 failed with exception 'OpenSSL ECDH refused key or params d2i_ECPrivateKey failed: error:10092010:lib(16):func(146):reason(16)'
Failure 3: test 3 failed with exception 'OpenSSL ECDH refused key or params d2i_ECPrivateKey failed: error:1009E077:lib(16):func(158):reason(119)'
Failure 4: test 4 failed with exception 'OpenSSL ECDH refused key or params d2i_ECPrivateKey failed: error:10092010:lib(16):func(146):reason(16)'
Failure 5: test 5 failed with exception 'OpenSSL ECDH refused key or params d2i_ECPrivateKey failed: error:1009E077:lib(16):func(158):reason(119)'
Failure 6: test 6 failed with exception 'OpenSSL ECDH refused key or params d2i_ECPrivateKey failed: error:10092010:lib(16):func(146):reason(16)'
Failure 7: test 7 failed with exception 'OpenSSL ECDH refused key or params d2i_ECPrivateKey failed: error:1009E077:lib(16):func(158):reason(119)'
Failure 8: test 8 failed with exception 'OpenSSL ECDH refused key or params d2i_ECPrivateKey failed: error:10092010:lib(16):func(146):reason(16)'
Failure 9: test 9 failed with exception 'OpenSSL ECDH refused key or params d2i_ECPrivateKey failed: error:1009E077:lib(16):func(158):reason(119)'
Failure 10: test 10 failed with exception 'OpenSSL ECDH refused key or params d2i_ECPrivateKey failed: error:10092010:lib(16):func(146):reason(16)'
Failure 11: test 11 failed with exception 'OpenSSL ECDH refused key or params d2i_ECPrivateKey failed: error:1009E077:lib(16):func(158):reason(119)'
Failure 12: test 12 failed with exception 'OpenSSL ECDH refused key or params d2i_ECPrivateKey failed: error:10092010:lib(16):func(146):reason(16)'
Failure 13: test 13 failed with exception 'OpenSSL ECDH refused key or params d2i_ECPrivateKey failed: error:1009E077:lib(16):func(158):reason(119)'
Failure 14: test 14 failed with exception 'OpenSSL ECDH refused key or params d2i_ECPrivateKey failed: error:10092010:lib(16):func(146):reason(16)'
Failure 15: test 15 failed with exception 'OpenSSL ECDH refused key or params d2i_ECPrivateKey failed: error:10092010:lib(16):func(146):reason(16)'
Failure 16: test 16 failed with exception 'OpenSSL ECDH refused key or params d2i_ECPrivateKey failed: error:10092010:lib(16):func(146):reason(16)'
Failure 17: test 17 failed with exception 'OpenSSL ECDH refused key or params d2i_ECPrivateKey failed: error:10092010:lib(16):func(146):reason(16)'
Failure 18: test 18 failed with exception 'OpenSSL ECDH refused key or params d2i_ECPrivateKey failed: error:10092010:lib(16):func(146):reason(16)'
Failure 19: test 19 failed with exception 'OpenSSL ECDH refused key or params d2i_ECPrivateKey failed: error:10092010:lib(16):func(146):reason(16)'
Failure 20: test 20 failed with exception 'OpenSSL ECDH refused key or params d2i_ECPrivateKey failed: error:10092010:lib(16):func(146):reason(16)'
Failure 21: test 21 failed with exception 'OpenSSL ECDH refused key or params d2i_ECPrivateKey failed: error:10092010:lib(16):func(146):reason(16)'
Failure 22: test 22 failed with exception 'OpenSSL ECDH refused key or params d2i_ECPrivateKey failed: error:10092010:lib(16):func(146):reason(16)'
Failure 23: test 23 failed with exception 'OpenSSL ECDH refused key or params d2i_ECPrivateKey failed: error:10092010:lib(16):func(146):reason(16)'
Failure 24: test 24 failed with exception 'OpenSSL ECDH refused key or params d2i_ECPrivateKey failed: error:10092010:lib(16):func(146):reason(16)'
Failure 25: test 25 failed with exception 'OpenSSL ECDH refused key or params d2i_ECPrivateKey failed: error:10092010:lib(16):func(146):reason(16)'
ECDH brainpool256r1 keygen ran 18 tests all ok
ECDH brainpool384r1 keygen ran 18 tests all ok
ECDH brainpool512r1 keygen ran 18 tests all ok
ECDH frp256v1 keygen ran 18 tests all ok
ECDH secp256r1 keygen ran 18 tests all ok
ECDH secp384r1 keygen ran 18 tests all ok
ECDH secp521r1 keygen ran 18 tests all ok
ECDH kex ran 3 tests all ok
pubkey/ecdsa_rfc6979.vec ran 96 tests 96 FAILED
Failure 1: test 1 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 2: test 2 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 3: test 3 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 4: test 4 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 5: test 5 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 6: test 6 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 7: test 7 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 8: test 8 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 9: test 9 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 10: test 10 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 11: test 11 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 12: test 12 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 13: test 13 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 14: test 14 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 15: test 15 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 16: test 16 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 17: test 17 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 18: test 18 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 19: test 19 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 20: test 20 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 21: test 21 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 22: test 22 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 23: test 23 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 24: test 24 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 25: test 25 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 26: test 26 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 27: test 27 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 28: test 28 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 29: test 29 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 30: test 30 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 31: test 31 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 32: test 32 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 33: test 33 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 34: test 34 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 35: test 35 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 36: test 36 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 37: test 37 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 38: test 38 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 39: test 39 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 40: test 40 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 41: test 41 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 42: test 42 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 43: test 43 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 44: test 44 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 45: test 45 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 46: test 46 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 47: test 47 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 48: test 48 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 49: test 49 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 50: test 50 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 51: test 51 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 52: test 52 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 53: test 53 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 54: test 54 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 55: test 55 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 56: test 56 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 57: test 57 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 58: test 58 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 59: test 59 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 60: test 60 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 61: test 61 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 62: test 62 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 63: test 63 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 64: test 64 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 65: test 65 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 66: test 66 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 67: test 67 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 68: test 68 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 69: test 69 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 70: test 70 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 71: test 71 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 72: test 72 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 73: test 73 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 74: test 74 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 75: test 75 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 76: test 76 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 77: test 77 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 78: test 78 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 79: test 79 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 80: test 80 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 81: test 81 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 82: test 82 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 83: test 83 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 84: test 84 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 85: test 85 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 86: test 86 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 87: test 87 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 88: test 88 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 89: test 89 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 90: test 90 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 91: test 91 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 92: test 92 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 93: test 93 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 94: test 94 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 95: test 95 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
Failure 96: test 96 failed with exception 'False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285'
ECDSA frp256v1 keygen ran 18 tests all ok
ECDSA secp256r1 keygen ran 18 tests all ok
ECDSA secp384r1 keygen ran 18 tests all ok
ECDSA secp521r1 keygen ran 18 tests all ok
ecdsa_unit ran 1 tests 1 FAILED
Failure 1: False assertion m_op is not null in PK_Signer @./src/lib/pubkey/pubkey.cpp:254
ECGDSA/EMSA1(RIPEMD-160) signature generation ran 27 tests in 63.06 msec all ok
ECGDSA/EMSA1(SHA-1) signature generation ran 9 tests in 12.77 msec all ok
ECGDSA/EMSA1(SHA-224) signature generation ran 18 tests in 47.71 msec all ok
ECGDSA/EMSA1(SHA-256) signature generation ran 27 tests in 81.49 msec all ok
ECGDSA/EMSA1(SHA-384) signature generation ran 18 tests in 98.53 msec all ok
ECGDSA/EMSA1(SHA-512) signature generation ran 9 tests in 58.53 msec all ok
ECGDSA secp256r1 keygen ran 18 tests all ok
ECGDSA secp384r1 keygen ran 18 tests all ok
ECGDSA secp521r1 keygen ran 18 tests all ok
ECIES ran 36 tests in 236.28 msec all ok
ECIES-ISO ran 148 tests in 364.98 msec all ok
ECIES cipher not found ran 1 tests all ok
ECIES ciphertext too short ran 1 tests all ok
ECIES kdf not found ran 1 tests all ok
ECIES mac not found ran 1 tests all ok
ECIES other key not set ran 1 tests all ok
ECIES short system params ctor ran 3 tests all ok
ECKCDSA/EMSA1(SHA-1) signature generation ran 9 tests in 30.97 msec all ok
ECKCDSA/EMSA1(SHA-224) signature generation ran 9 tests in 19.95 msec all ok
ECKCDSA/EMSA1(SHA-256) signature generation ran 9 tests in 46.24 msec all ok
ECKCDSA secp256r1 keygen ran 18 tests all ok
ECKCDSA secp384r1 keygen ran 18 tests all ok
ECKCDSA secp521r1 keygen ran 18 tests all ok
ElGamal/Raw decryption ran 80 tests in 79.22 msec all ok
ElGamal modp/ietf/1024 keygen ran 18 tests all ok
ElGamal modp/ietf/2048 keygen ran 18 tests all ok
Entropy source darwin_secrandom ran 3 tests in 0.20 msec all ok
Entropy source dev_random ran 3 tests in 0.04 msec all ok
Entropy source egd ran 1 tests in 0.00 msec all ok
Entropy source proc_info ran 3 tests in 0.02 msec all ok
Entropy source proc_walk ran 1 tests in 0.01 msec all ok
Entropy source rdrand ran 3 tests in 0.01 msec all ok
Entropy source rdseed ran 1 tests in 0.00 msec all ok
Entropy source unix_procs ran 3 tests in 62.49 msec all ok
botan_pk_op_verify_create: False assertion m_op is not null in PK_Verifier @./src/lib/pubkey/pubkey.cpp:285
FFI ran 241 tests 1 FAILED
Failure 1: FFI botan_pk_op_verify_create unexpectedly failed with error code -1
Note 1: FFI PBKDF timed 10 ms 20000 iterations 100 ms 130000 iterations
SecureQueue ran 6 tests all ok
FPE_FE1 ran 4 tests in 6.18 msec all ok
PKCS #8 fuzzing ran 1 tests all ok
X.509 fuzzing ran 53 tests all ok
GF2m ran 262136 tests all ok
GOST-34.10 gost_256A keygen ran 18 tests all ok
GOST-34.10 secp256r1 keygen ran 18 tests all ok
GOST 34.10-2001/EMSA1(GOST-34.11) signature verification ran 21 tests in 30.13 msec all ok
HMAC_DRBG Broken Entropy Input ran 6 tests all ok
HMAC_DRBG Fork Safety ran 4 tests all ok
HMAC_DRBG Nonce Check ran 15 tests all ok
HMAC_DRBG Prediction Resistance ran 3 tests all ok
HMAC_DRBG Randomize With Timestamp Input ran 2 tests all ok
HMAC_DRBG Reseed ran 8 tests all ok
HMAC_DRBG Reseed KAT ran 5 tests all ok
HKDF(SHA-1) ran 4 tests in 0.06 msec all ok
HKDF(SHA-256) ran 3 tests in 0.03 msec all ok
HKDF(SHA-512) ran 5 tests in 0.08 msec all ok
KDF1(SHA-1) ran 5 tests in 0.05 msec all ok
KDF1-18033(SHA-1) ran 2 tests in 0.02 msec all ok
KDF1-18033(SHA-256) ran 2 tests in 0.02 msec all ok
KDF2(SHA-1) ran 76 tests in 0.59 msec all ok
SP800-108-Counter(CMAC(AES-128)) ran 30 tests in 0.44 msec all ok
SP800-108-Counter(CMAC(AES-192)) ran 30 tests in 0.33 msec all ok
SP800-108-Counter(CMAC(AES-256)) ran 30 tests in 0.32 msec all ok
SP800-108-Counter(CMAC(TripleDES)) ran 30 tests in 0.55 msec all ok
SP800-108-Counter(SHA-1) ran 30 tests in 0.46 msec all ok
SP800-108-Counter(SHA-256) ran 30 tests in 0.79 msec all ok
SP800-108-Counter(SHA-384) ran 30 tests in 0.55 msec all ok
SP800-108-Counter(SHA-512) ran 30 tests in 0.43 msec all ok
SP800-108-Feedback(CMAC(AES-128)) ran 30 tests in 0.50 msec all ok
SP800-108-Feedback(CMAC(AES-192)) ran 30 tests in 0.46 msec all ok
SP800-108-Feedback(CMAC(AES-256)) ran 30 tests in 0.53 msec all ok
SP800-108-Feedback(CMAC(TripleDES)) ran 30 tests in 1.00 msec all ok
SP800-108-Feedback(SHA-1) ran 30 tests in 0.58 msec all ok
SP800-108-Feedback(SHA-256) ran 30 tests in 0.65 msec all ok
SP800-108-Feedback(SHA-384) ran 30 tests in 0.55 msec all ok
SP800-108-Feedback(SHA-512) ran 30 tests in 0.45 msec all ok
SP800-108-Pipeline(CMAC(AES-128)) ran 30 tests in 0.43 msec all ok
SP800-108-Pipeline(CMAC(AES-192)) ran 30 tests in 0.42 msec all ok
SP800-108-Pipeline(CMAC(AES-256)) ran 30 tests in 0.43 msec all ok
SP800-108-Pipeline(CMAC(TripleDES)) ran 30 tests in 0.86 msec all ok
SP800-108-Pipeline(SHA-1) ran 30 tests in 0.45 msec all ok
SP800-108-Pipeline(SHA-256) ran 30 tests in 0.56 msec all ok
SP800-108-Pipeline(SHA-384) ran 30 tests in 0.41 msec all ok
SP800-108-Pipeline(SHA-512) ran 30 tests in 0.43 msec all ok
SP800-56C(SHA-1) ran 10 tests in 0.19 msec all ok
SP800-56C(SHA-256) ran 10 tests in 0.20 msec all ok
SP800-56C(SHA-384) ran 10 tests in 0.19 msec all ok
SP800-56C(SHA-512) ran 10 tests in 0.19 msec all ok
TLS-12-PRF(SHA-224) ran 1 tests in 0.03 msec all ok
TLS-12-PRF(SHA-256) ran 1 tests in 0.02 msec all ok
TLS-12-PRF(SHA-384) ran 1 tests in 0.03 msec all ok
TLS-12-PRF(SHA-512) ran 1 tests in 0.03 msec all ok
TLS-PRF ran 32 tests in 0.60 msec all ok
X9.42-PRF(1.2.840.113549.1.9.16.3.6) ran 1 tests in 0.05 msec all ok
X9.42-PRF(KeyWrap.RC2) ran 1 tests in 0.04 msec all ok
X9.42-PRF(KeyWrap.TripleDES) ran 1 tests in 0.10 msec all ok
McEliece keygen ran 30 tests in 2.57 sec all ok
McEliece IES ran 510 tests all ok
McEliece KEM ran 510 tests all ok
McEliece keygen ran 255 tests all ok
bigint_cnd_abs ran 6 tests all ok
bigint_cnd_add ran 4 tests all ok
bigint_cnd_sub ran 4 tests all ok
bigint_cnd_swap ran 12 tests all ok
NEWHOPE ran 4000 tests in 240.87 msec all ok
NIST P-192 reduction ran 102 tests all ok
NIST P-224 reduction ran 102 tests all ok
NIST P-256 reduction ran 102 tests all ok
NIST P-384 reduction ran 102 tests all ok
NIST P-521 reduction ran 102 tests all ok
OCB long ran 3474 tests in 24.69 msec all ok
OctetString ran 14 tests all ok
OID add ran 3 tests all ok
OID add and lookup ran 4 tests all ok
OID add string ran 3 tests all ok
Parallel hash ran 3 tests all ok
passhash9 ran 9 tests in 464.57 msec all ok
RFC3394 keywrap ran 12 tests in 0.09 msec all ok
RFC 6979 nonce generation ran 8 tests in 0.91 msec all ok
RSA/EME-PKCS1-v1_5 decryption ran 90 tests in 87.67 msec all ok
RSA/EME1(SHA-1) decryption ran 342 tests in 628.31 msec all ok
RSA/Raw decryption ran 1865 tests in 640.82 msec all ok
RSA/KDF1-18033(SHA-1) KEM ran 6 tests in 24.90 msec all ok
RSA/KDF1-18033(SHA-256) KEM ran 6 tests in 29.09 msec all ok
RSA/KDF1-18033(SHA-512) KEM ran 3 tests in 21.58 msec all ok
RSA/KDF2(SHA-1) KEM ran 6 tests in 26.82 msec all ok
RSA/KDF2(SHA-256) KEM ran 6 tests in 26.73 msec all ok
RSA/KDF2(SHA-512) KEM ran 3 tests in 21.25 msec all ok
RSA 1024 keygen ran 18 tests all ok
RSA 1280 keygen ran 18 tests all ok
RSA/EMSA1(SHA-1) signature generation ran 99 tests in 16.21 msec all ok
RSA/EMSA2(RIPEMD-160) signature generation ran 132 tests in 35.25 msec all ok
RSA/EMSA2(SHA-1) signature generation ran 66 tests in 12.60 msec all ok
RSA/EMSA2(SHA-224) signature generation ran 132 tests in 37.84 msec all ok
RSA/EMSA2(SHA-256) signature generation ran 132 tests in 35.83 msec all ok
RSA/EMSA2(SHA-384) signature generation ran 132 tests in 35.05 msec all ok
RSA/EMSA2(SHA-512) signature generation ran 132 tests in 38.19 msec all ok
RSA/EMSA2(Whirlpool) signature generation ran 132 tests in 35.54 msec all ok
RSA/EMSA3(MD5) signature generation ran 297 tests in 318.27 msec all ok
RSA/EMSA3(RIPEMD-160) signature generation ran 132 tests in 34.93 msec all ok
RSA/EMSA3(Raw) signature generation ran 165 tests in 42.19 msec all ok
RSA/EMSA3(SHA-1) signature generation ran 330 tests in 50.31 msec all ok
RSA/EMSA3(SHA-224) signature generation ran 99 tests in 38.56 msec all ok
RSA/EMSA3(SHA-256) signature generation ran 132 tests in 33.87 msec all ok
RSA/EMSA3(SHA-384) signature generation ran 132 tests in 36.83 msec all ok
RSA/EMSA3(SHA-512) signature generation ran 132 tests in 37.52 msec all ok
RSA/EMSA3(Tiger) signature generation ran 132 tests in 35.05 msec all ok
RSA/EMSA4(SHA-1) signature generation ran 990 tests in 250.69 msec all ok
RSA/EMSA4(RIPEMD-160) signature verification ran 56 tests in 2.40 msec all ok
RSA/EMSA4(SHA-1) signature verification ran 196 tests in 9.24 msec all ok
RSA/EMSA4(SHA-224) signature verification ran 56 tests in 2.58 msec all ok
RSA/EMSA4(SHA-256) signature verification ran 56 tests in 2.28 msec all ok
RSA/Raw signature verification ran 14 tests in 2.14 msec all ok
SRP6 ran 1 tests all ok
DTLS v1.0 ran 810 tests in 380.21 msec all ok
DTLS v1.2 ran 1260 tests in 2.23 sec all ok
TLS v1.0 ran 835 tests in 373.30 msec all ok
TLS v1.1 ran 836 tests in 431.66 msec all ok
TLS v1.2 ran 1294 tests in 3.12 sec all ok
alert parsing ran 9 tests in 0.09 msec all ok
cert_verify parsing ran 8 tests in 0.10 msec all ok
client_hello parsing ran 18 tests in 0.28 msec all ok
hello_request parsing ran 2 tests in 0.03 msec all ok
hello_verify parsing ran 5 tests in 0.06 msec all ok
hello_verify_request construction ran 1 tests all ok
new_session_ticket parsing ran 5 tests in 0.05 msec all ok
server_hello parsing ran 12 tests in 0.11 msec all ok
TLS Policy DH key verification ran 1 tests all ok
TLS Policy ECDH key verification ran 2 tests all ok
TLS Policy ECDSA key verification ran 2 tests all ok
TLS Policy RSA key verification ran 2 tests all ok
TSS ran 2 tests all ok
unit_x509 ran 1 tests 1 FAILED
Failure 1: Invalid argument Decoding error: CERTIFICATE REQUEST decoding failed (Invalid argument Decoding error: PKCS #10 request: Bad signature detected)
Date parsing ran 71 tests in 0.10 msec all ok
X509v3 Name Constraints: Invalid_DN_Name_Constraint.crt ran 1 tests all ok
X509v3 Name Constraints: Invalid_Email_Name_Constraint.crt ran 1 tests all ok
X509v3 Name Constraints: Invalid_IP_Name_Constraint.crt ran 1 tests all ok
X509v3 Name Constraints: Valid_DNS_Name_Constraint.crt ran 1 tests all ok
X509v3 Name Constraints: Valid_DN_Name_Constraint.crt ran 1 tests all ok
X509v3 Name Constraints: Valid_IP_Name_Constraint.crt ran 1 tests all ok
NIST path validation ran 71 tests all ok
X509test path validation ran 37 tests all ok
Tests complete ran 526866 tests 124 tests failed
Error: Test error Test suite failure
$

Also, cert_info seems to misbehave, especially when given --ber flag:

$ ./botan cert_info ~/Documents/Certs/forest_rsa_ca_3.pem
Subject Name: Forest RSA CA 3
Subject Organization: The Burrow
Subject Organizational Unit: Gatherers
Subject State: MA
Subject Country: US
Issuer Name: Forest RSA CA 3
Issuer Organization: The Burrow
Issuer Organizational Unit: Gatherers
Issuer State: MA
Issuer Country: US
Version: 3
Not valid before: 150524005222Z
Not valid after: 250524005222Z
. . . . .

What format is the date/time above?

And with --ber it gets into infinite loop:

$ ./botan cert_info --ber ~/Documents/Certs/forest_rsa_ca_3.cer
Subject Name: Forest RSA CA 3
Subject Organization: The Burrow
Subject Organizational Unit: Gatherers
Subject State: MA
Subject Country: US
. . . . .
Fzd1BVdlu6iF3Dz16CsI28vunfj4jCRzmEZMSDqYbUyBAgMBAAE=
-----END PUBLIC KEY-----

X509_Certificate parsing failed I/O error: ASN1::maybe_BER: Source was empty
X509_Certificate parsing failed I/O error: ASN1::maybe_BER: Source was empty
. . . . .[las message repeated endlessly]
randombit commented 7 years ago

LOL, CI was not building against OpenSSL due to a typo so this was missed. I think most of these are the same bug, looking at it now.

What format is the date/time above?

Just the raw ASN.1 time string. The output of X509_Certificate::to_string could be better.

randombit commented 7 years ago

The BER infinite loop is because of a strange interaction with DataSource_Stream - the peek function which is used to guess DER vs PEM resets the EOF state, so the cli never realizes EOF already happened. Not really sure how to fix this one yet, thanks for mentioning the problem.

mouse07410 commented 7 years ago

... I think most of these are the same bug, looking at it now ...

Thanks! I confirm that 55b8fb5 with 27a6d11 fixes the tests:

. . . . .
Tests complete ran 528317 tests all tests ok

What format is the date/time above?

Just the raw ASN.1 time string. The output of X509_Certificate::to_string could be better.

Could you change it then...? When a user invokes botan CLI to print out the cert, he probably would like to see what the expiration data/time is, and does not have the immediate skills to convert the raw ASN.1 to DTG...

...the peek function which is used to guess DER vs PEM resets the EOF state, so the cli never realizes EOF already happened...

But... with the (new?) --ber flag is there still a need to guess DER vs. PEM? A simpler logic would be "--ber => DER, otherwise PEM", and it would avoid the need to peek...?

randombit commented 7 years ago

Could you change it then...?

LOL, you must be joking. But if not:

I have only so many (completely unpaid) hours to devote to this project and the plain truth is when selecting a task to work on I'm quite unlikely to spend time on an issue like this [*], which is purely cosmetic and can be improved in a somewhat drive by manner by any skilled and motivated programmer. In contrast there are many things, such as reviewing complicated patches or redesigning major parts of the library, which can only be done by me - either I do them or they will not happen.

[*] Unless it starts bugging me personally, of course, in which case I'll fix it that day. ;)

The output of X509_Certificate::to_string could be much better (more or less matching openssl x509 -text would be fine), but until/unless it starts bugging me personally it remains just a todo. (But, it was missing in the todo, so I added it).

But... with the (new?) --ber flag is there still a need to guess DER vs. PEM?

Surely so if this flag were passed to the library in any way, but it just exists in the cli to control text vs binary IO on the file.

randombit commented 7 years ago

Closing, as tests are fixed now. The DataSource_Stream EOF issue should have its own ticket.