Hi Everyone, I tried ctransformers to load the GGML of WizardLM, but unfortunely it crashes
using
from ctransformers import AutoModelForCausalLM
and then
AutoModelForCausalLM.from_pretrained("TheBloke/WizardLM-30B-GGML", model_file="/home/user/app/wizardlm-30b.ggmlv3.q2_K.bin", model_type="llama")
the error says
Illegal instruction (core dumped)
is there any help for me?
Hi Everyone, I tried ctransformers to load the GGML of WizardLM, but unfortunely it crashes using
from ctransformers import AutoModelForCausalLMand thenAutoModelForCausalLM.from_pretrained("TheBloke/WizardLM-30B-GGML", model_file="/home/user/app/wizardlm-30b.ggmlv3.q2_K.bin", model_type="llama")the error saysIllegal instruction (core dumped)is there any help for me?