search

lmstudio-ai / lmstudio-bug-tracker

Bug tracking for the LM Studio desktop application
4 stars 3 forks source link

Running vision models is a problem? #101

Open cardchase opened 2 weeks ago

cardchase commented 2 weeks ago

Failed to load model: No LM Runtime found for format 'safetensors!

Model: Phi-3.5-vision-instruct-gguf

image

image

Model downloaded from the "Discover" tab

yagil commented 2 weeks ago

@cardchase does any other model load successfully?

cardchase commented 2 weeks ago

@cardchase does any other model load successfully?

Yes. the rest of the models i.e.

image

loads successfully.

YorkieDev commented 1 week ago

Hi @cardchase None of the Phi 3.5 Vision or MoE models will load in LM Studio. Support for the model isn't implemented in llama.cpp yet. https://github.com/ggerganov/llama.cpp/issues/9119