Closed chenghuaWang closed 2 months ago
@yirongjie Some Server dose not support AVX-VNNI(_mm256_dpbusd_avx_epi32), such as ice lake.
#if defined(__AVXVNNI__) || (defined(__AVX512VNNI__) && defined(__AVX512VL__))
// res = _mm256_dpbusd_epi32(_mm256_setzero_si256(), u, s);
res = _mm256_dpbusd_avx_epi32(_mm256_setzero_si256(), u, s);
#else
should be changed to
#if defined(__AVXVNNI__)
...
#elif (defined(__AVX512VNNI__) && defined(__AVX512VL__))
...
#else
See document:
and
@chenghuaWang I fix it here .https://github.com/UbiquitousLearning/mllm/pull/147/commits/93eac2ebde357cdcbfef9f2dddf7dad59fe0150d
Compiled using Clang17. Test Passed