Open tristan-k opened 5 months ago
Hi @tristan-k If I understand correctly, are you running llama.cpp on your integrated graphics (Intel (R) Iris (R) Xe Graphics) on an Ubuntu system? We have located the possible reasons for this error and trying to fix it, once it is done, we will update here to let you know.
For now, you can try ./main -m mistral-7b-instruct-v0.1.Q4_K_M.gguf -n 32 --prompt "Once upon a time, there existed a little girl who liked to have adventures. She wanted to go to places and meet new people, and have fun" -t 8 -e -ngl 30 --color
to see whether it works.
Describe the bug
I'm unable to run the example from the quickstart guide for lllama.cpp. Not sure if this is related to llama.cpp or IPEX LLM.
Versions