Closed violet17 closed 5 months ago
After offline sync with @violet17 , we found this issue only happens with Chinese prompt. Apply below setting can solve this issue:
@rnwang04 Thanks for quick reply.
After offline sync with @violet17 , we found this issue only happens with Chinese prompt. Apply below setting can solve this issue:
Maybe also update the quickstart?
Maybe also update the quickstart?
Ok, I will do it.
Follow guide: https://ipex-llm.readthedocs.io/en/latest/doc/LLM/Quickstart/llama_cpp_quickstart.html command:
main.exe -m "C:\Users\admin\Desktop\ipex\llama-cpp\llama-cpp\libs\models\qwen1_5-1_8b-chat-q5_k_m.gguf" -n 512 --prompt "我的问题是:什么是零售?请把回答限制在五 十个汉字以内。" -t 8 -e -ngl 33 --color --no-mmap --temp 0
log:
CPU: MTL Ultra 7 165HL GPU version: 5333 or 5448 version: ipex-llm: 2.1.0b20240510
Could you please take a look on this issue? Thanks.