search

lmstudio-ai / lmstudio-bug-tracker

Bug tracking for the LM Studio desktop application
10 stars 3 forks source link

Failing to Load Llama 3.1-Instruct #77

Closed jetlime closed 3 months ago

jetlime commented 3 months ago

While loading the model "lmstudio-community/Meta-Llama-3.1-8B-Instruct-GGUF/Meta-Llama-3.1-8B-Instruct-Q8_0.gguf".

I obtain the following error:

llama.cpp error: 'done_getting_tensors: wrong number of tensors; expected 292, got 291
yagil commented 3 months ago

Hi @jetlime please try LM Studio 0.2.31. You can download it from https://lmstudio.ai

jetlime commented 3 months ago

It works, thanks. Sorry about that, I wasn't aware about the newer version :)