Unable to load vision model: openbmb/MiniCPM-Llama3-V-2_5

lmstudio-ai / lmstudio-bug-tracker

Bug tracking for the LM Studio desktop application

2 stars 2 forks source link

Unable to load vision model: openbmb/MiniCPM-Llama3-V-2_5 #39

Open michabbb opened 2 weeks ago

michabbb commented 2 weeks ago

this model has a vision adapter: mmproj-model-f16.gguf i never used any vision model in lmstudio, so I don´t know if that is a bug or related to this particular model. because this model has strong OCR capabilities, I wanted to test it, but lmstudio is unable to load any of the GGUF versions while the "mmproj-model-f16.gguf" exists. if I delete that file, the model is loading.

again: don´t know if that is lmstudio bug or not, but it would be nice to test this model ;)

YorkieDev commented 2 weeks ago

Hi @michabbb MiniCPM models are currently unsupported in llama.cpp (Which LM Studio uses) so they will not work. https://github.com/ggerganov/llama.cpp/pull/7599