I have a problem with loading my models(Llama 1b istruct and mistraal 7b instruct) i get this error:" No LM Runtime found for model format 'gguf' ! ".
the weird thing is that i am running this version on a VM with linux and on the host PC with Windows everything is perfectly fineand no errors are occuring.
Can someone pls help me?
@Diacool the "no LM Runtime found for model format 'GGUF'" error indicates that the Linux VM CPU doesn't have AVX2 instructions, in your VM, ensure you are using the host PC's CPU.
I have a problem with loading my models(Llama 1b istruct and mistraal 7b instruct) i get this error:" No LM Runtime found for model format 'gguf' ! ". the weird thing is that i am running this version on a VM with linux and on the host PC with Windows everything is perfectly fineand no errors are occuring. Can someone pls help me?