Feature Request: Support for Intel® Arc™ Graphics

LostRuins / koboldcpp

A simple one-file way to run various GGML and GGUF models with KoboldAI's UI

https://github.com/lostruins/koboldcpp

GNU Affero General Public License v3.0

4.34k stars 310 forks source link

Open atlatlir opened 3 days ago

atlatlir commented 3 days ago

Hi I'd like to request that support for Intel® Arc™ Graphics be added to KoboldCpp.

LostRuins commented 2 days ago

You can probably use the Vulkan or CLBlast backend for that.