Open GreyXor opened 3 months ago
Hello Would that be possible to include this llama.cpp ? https://github.com/amd/RyzenAI-SW/tree/main/example/transformers/ext/llama.cpp
It will be compatible with XDNA and the driver slated for integration into the Linux mainline, enabling direct utilization of the NPU in Phoenix and Strix Point SoCs.
Hello Would that be possible to include this llama.cpp ? https://github.com/amd/RyzenAI-SW/tree/main/example/transformers/ext/llama.cpp
It will be compatible with XDNA and the driver slated for integration into the Linux mainline, enabling direct utilization of the NPU in Phoenix and Strix Point SoCs.