LibTestApp fails with GCC 8.x for AESNI emulation code path

intel / intel-ipsec-mb

Intel(R) Multi-Buffer Crypto for IPSec

BSD 3-Clause "New" or "Revised" License

289 stars 87 forks source link

LibTestApp fails with GCC 8.x for AESNI emulation code path #28

Closed tkanteck closed 5 years ago

tkanteck commented 5 years ago

A few facts about the issue:

SSE, AVX, AVX2 and AVX512 code paths are fine
LibTestApp reports failure for AESNI emulation code
this cannot be reproduced with older GCC versions
the issue only affects the code that emulates AESNI instructions (no feature support in the CPU).

Nature of the problem is not know at this stage and it is under investigation.

tkanteck commented 5 years ago

Root cause of the issue is compiler using SSE instructions and XMM registers in AESNI emulation code. The clobbered registers are being used by assembly algorithm and produce incorrect results. This behavior is observed with newer compiler versions (as in issue subject).

Fix for the issue will be available shortly.