lmstudio-ai / lmstudio-bug-tracker

Bug tracking for the LM Studio desktop application
10 stars 3 forks source link

LLava - The first prompt is always ignored when sent with an image #99

Open VandersonQk opened 2 months ago

VandersonQk commented 2 months ago

I found a problem with llava models, I noticed that the first prompt is always ignored when I send an image in the initial prompt: Screenshot_20240829_101740

Expected result (official llava repository): Screenshot_20240829_101636

When I continue the conversation it works: Screenshot_20240829_101811

Doing some research on the subject, I found this issue from ollama (https://github.com/ollama/ollama/issues/2769), and it seems to be the same problem.

Another problem that may be related, is that it is not possible to send other images during the conversation, when I try to send the message “failed to send message” appears and in the chat “This message contains no content. The AI has nothing to say.”

I don't think it makes a difference in this case, but I'm using LMStudio on linux (ubuntu 23).