[X] I searched using keywords relevant to my issue to make sure that I am creating a new issue that is not already open (or closed).
[X] I reviewed the Discussions, and have a new and useful enhancement to share.
Feature Description
I have Intel i9-11900 (Rocket Lake) and i5-12600 (Alder Lake) CPUs. Llamafile runs twice as slow on "Rocket Lake" as "Alder Lake". Although "Rocket Lake" supports AVX-512. I suspect this is because "Rocket Lake" uses AVX2 instead of AVX-512. Is it possible to support AVX-512 for "Rocket Lake"?
Prerequisites
Feature Description
I have Intel i9-11900 (Rocket Lake) and i5-12600 (Alder Lake) CPUs. Llamafile runs twice as slow on "Rocket Lake" as "Alder Lake". Although "Rocket Lake" supports AVX-512. I suspect this is because "Rocket Lake" uses AVX2 instead of AVX-512. Is it possible to support AVX-512 for "Rocket Lake"?
lscpu-11900.txt lscpu-12600.txt
llamafile-bench-11900.json llamafile-bench-12600.json
Motivation
This feature will increase the performance of Llamafile for "Rocket Lake".
Possible Implementation
No response