A Gradio Web UI for running local LLM on Intel GPU (e.g., local PC with iGPU, discrete GPU such as Arc, Flex and Max) using IPEX-LLM.
GNU Affero General Public License v3.0
14
stars
8
forks
source link
Convert bigdl-llm as the default loader #7
Closed
sgwhat closed 6 months ago
Set
bigdl-llm
as the default Loader to replace manual switching.