search

intel-analytics / text-generation-webui

A Gradio Web UI for running local LLM on Intel GPU (e.g., local PC with iGPU, discrete GPU such as Arc, Flex and Max) using IPEX-LLM.
GNU Affero General Public License v3.0
14 stars 8 forks source link

Error loading model #39

Closed yu1chaofan closed 1 month ago

yu1chaofan commented 1 month ago

Describe the bug

image Error loading model

Is there an existing issue for this?

Reproduction

Tested model: qwen1.5-0.5B phi-1_5 MiniCPM-2B-sft-bf16

Screenshot

No response

Logs

https://github.com/intel-analytics/ipex-llm/blob/main/docs/mddocs/Quickstart/webui_quickstart.md

System Info

Windows 11 23H2
Intel(R) Arc(T M) A770 Graphics
jason-dai commented 1 month ago

I wonder if you can submit the issue to https://github.com/intel-analytics/ipex-llm/issues

yu1chaofan commented 1 month ago

OK, but I have successfully run MiniCPM-2B-sft-bf16 according to the following steps https://github.com/intel-analytics/ipex-llm/tree/main/python/llm/example/GPU/HuggingFace/LLM/minicpm