Failed tests

[th-otto]

This is a list of currently failing tests:

perl scripts/run-test-suites.pl  --skip=
test_suite_aes.cbc ................................................ PASS
test_suite_aes.cfb ................................................ PASS
test_suite_aes.ctr ................................................ PASS
test_suite_aes.ecb ................................................ PASS
test_suite_aes.ofb ................................................ PASS
test_suite_aes.rest ............................................... PASS
test_suite_aes.xts ................................................ PASS
test_suite_alignment .............................................. PASS
test_suite_aria ................................................... PASS
test_suite_asn1parse .............................................. PASS
test_suite_asn1write .............................................. PASS
test_suite_base64 ................................................. PASS
test_suite_bignum.generated ....................................... PASS
test_suite_bignum.misc ............................................ PASS
test_suite_bignum_core.generated .................................. PASS
test_suite_bignum_core.misc ....................................... PASS
test_suite_bignum_mod.generated ................................... PASS
test_suite_bignum_mod.misc ........................................ PASS
test_suite_bignum_mod_raw ......................................... PASS
test_suite_bignum_mod_raw.generated ............................... PASS
test_suite_bignum_random .......................................... PASS
test_suite_block_cipher ........................................... PASS
test_suite_block_cipher.psa ....................................... PASS
test_suite_camellia ............................................... PASS
test_suite_ccm .................................................... PASS
test_suite_chacha20 ............................................... PASS
test_suite_chachapoly ............................................. PASS
test_suite_cipher.aes ............................................. PASS
test_suite_cipher.aria ............................................ PASS
test_suite_cipher.camellia ........................................ PASS
test_suite_cipher.ccm ............................................. PASS
test_suite_cipher.chacha20 ........................................ PASS
test_suite_cipher.chachapoly ...................................... PASS
test_suite_cipher.des ............................................. PASS
test_suite_cipher.gcm ............................................. PASS
test_suite_cipher.misc ............................................ PASS
test_suite_cipher.nist_kw ......................................... PASS
test_suite_cipher.null ............................................ PASS
test_suite_cipher.padding ......................................... PASS
test_suite_cmac ................................................... PASS
test_suite_common ................................................. PASS
test_suite_constant_time .......................................... PASS
test_suite_constant_time_hmac ..................................... PASS
test_suite_ctr_drbg ............................................... PASS
test_suite_debug .................................................. PASS
test_suite_des .................................................... PASS
test_suite_dhm .................................................... PASS
test_suite_ecdh ................................................... PASS
test_suite_ecdsa .................................................. PASS
test_suite_ecjpake ................................................ PASS
test_suite_ecp .................................................... PASS
test_suite_ecp.generated .......................................... PASS
test_suite_entropy ................................................ PASS
test_suite_error .................................................. PASS
test_suite_gcm.aes128_de .......................................... PASS
test_suite_gcm.aes128_en .......................................... PASS
test_suite_gcm.aes192_de .......................................... PASS
test_suite_gcm.aes192_en .......................................... PASS
test_suite_gcm.aes256_de .......................................... PASS
test_suite_gcm.aes256_en .......................................... PASS
test_suite_gcm.camellia ........................................... PASS
test_suite_gcm.misc ............................................... PASS
test_suite_hkdf ................................................... PASS
test_suite_hmac_drbg.misc ......................................... PASS
test_suite_hmac_drbg.no_reseed .................................... PASS
test_suite_hmac_drbg.nopr ......................................... PASS
test_suite_hmac_drbg.pr ........................................... PASS
test_suite_lmots .................................................. PASS
test_suite_lms .................................................... PASS
test_suite_md ..................................................... PASS
test_suite_md.psa ................................................. PASS
test_suite_mdx .................................................... PASS
test_suite_memory_buffer_alloc .................................... PASS
test_suite_mps .................................................... PASS
test_suite_net .................................................... PASS
test_suite_nist_kw ................................................ PASS
test_suite_oid .................................................... PASS
test_suite_pem .................................................... PASS
test_suite_pk ..................................................... FAIL
test_suite_pkcs12 ................................................. PASS
test_suite_pkcs1_v15 .............................................. PASS
test_suite_pkcs1_v21 .............................................. PASS
test_suite_pkcs5 .................................................. PASS
test_suite_pkcs7 .................................................. PASS
test_suite_pkparse ................................................ FAIL
test_suite_pkwrite ................................................ PASS
test_suite_platform ............................................... FAIL
test_suite_platform_printf ........................................ PASS
test_suite_platform_util .......................................... PASS
test_suite_poly1305 ............................................... PASS
test_suite_psa_crypto ............................................. FAIL
test_suite_psa_crypto.pbkdf2 ...................................... PASS
test_suite_psa_crypto_attributes .................................. PASS
test_suite_psa_crypto_driver_wrappers ............................. PASS
test_suite_psa_crypto_entropy ..................................... PASS
test_suite_psa_crypto_generate_key.generated ...................... FAIL
test_suite_psa_crypto_hash ........................................ FAIL
test_suite_psa_crypto_init ........................................ FAIL
test_suite_psa_crypto_low_hash.generated .......................... PASS
test_suite_psa_crypto_memory ...................................... PASS
test_suite_psa_crypto_metadata .................................... PASS
test_suite_psa_crypto_not_supported.generated ..................... PASS
test_suite_psa_crypto_not_supported.misc .......................... FAIL
test_suite_psa_crypto_op_fail.generated ........................... FAIL
test_suite_psa_crypto_op_fail.misc ................................ FAIL
test_suite_psa_crypto_pake ........................................ FAIL
test_suite_psa_crypto_persistent_key .............................. FAIL
test_suite_psa_crypto_se_driver_hal ............................... PASS
test_suite_psa_crypto_se_driver_hal_mocks ......................... PASS
test_suite_psa_crypto_slot_management ............................. FAIL
test_suite_psa_crypto_storage_format.current ...................... FAIL
test_suite_psa_crypto_storage_format.misc ......................... FAIL
test_suite_psa_crypto_storage_format.v0 ........................... FAIL
test_suite_psa_crypto_util ........................................ PASS
test_suite_psa_its ................................................ PASS
test_suite_random ................................................. FAIL
test_suite_rsa .................................................... PASS
test_suite_shax ................................................... PASS
test_suite_ssl .................................................... FAIL
test_suite_ssl_decrypt.misc ....................................... FAIL
test_suite_test_helpers ........................................... PASS
test_suite_timing ................................................. PASS
test_suite_version ................................................ PASS
test_suite_x509parse .............................................. FAIL
test_suite_x509write .............................................. PASS
------------------------------------------------------------------------
FAILED (125 suites, 24058 tests run)

• test_suite_pk: most checks fail because psa_crypto_init() returns PSA_ERROR_INSUFFICIENT_ENTROPY. This is maybe because we don't have a /dev/urandom device or similar
• test_suite_pkparse: fails for the same reason
• test_suite_psa_crypto: ditto
• test_suite_psa_crypto_generate_key.generated: ditto
• test_suite_psa_crypto_hash: ditto
• test_suite_psa_crypto_init: ditto
• test_suite_psa_crypto_not_supported.misc: ditto
• test_suite_psa_crypto_op_fail.generated: ditto
• test_suite_psa_crypto_op_fail.misc. ditto
• test_suite_psa_crypto_pake: ditto
• test_suite_psa_crypto_persistent_key: ditto
• test_suite_psa_crypto_slot_management:ditto
• test_suite_psa_crypto_storage_format.current: ditto
• test_suite_psa_crypto_storage_format.misc: ditto
• test_suite_psa_crypto_storage_format.v0: ditto
• test_suite_ssl_decrypt.misc: ditto
• test_suite_x509parse: ditto
• test_suite_random: similar reason, mbedtls_ctr_drbg_init() returns MBEDTLS_ERR_CTR_DRBG_ENTROPY_SOURCE_FAILED
• test_suite_ssl: crashes with a bus error when trying to process a HELLO_REQUEST. To be investigated
• test_suite_platform: fails in Check mbedtls_calloc overallocation, because mintlib does not check that the multiplication nmemb * size does not overflow

[th-otto]

Most of the failing tests was because of the MBEDTLS_NO_PLATFORM_ENTROPY define. Fixed now.

Magically, that also fixed the crash in test_suite_ssl. Maybe a bug in the test program.

Remaining failures in test_suite_ssl are because server functions are disabled by undefining MBEDTLS_SSL_SRV_C. Enabling that would make the tests pass.