Jeffser / Alpaca

An Ollama client made with GTK4 and Adwaita
https://jeffser.com/alpaca
GNU General Public License v3.0
389 stars 41 forks source link

llava-llama3 and other llava models do not have image send capacity #39

Closed CounterFlow64 closed 5 months ago

CounterFlow64 commented 5 months ago

I don't know if this is a bug or not, just checking. The original llava LLM-image model allows you to send images. llava with llama3 for example, does not allow to send images, while I do think it's technically designed for this.

Edit: this is the case with moondream too. It has image understanding, but only original llava allows sending of images in the GUI

Jeffser commented 5 months ago

Hi thabks for the report, you see, I have a hard-coded list for which models support images, right now it only has llava but I will add those to that list for the next release.

I will also check if there's a way to dynamically check if a model can use images or not

Jeffser commented 5 months ago

Also, thank you for the donation

CounterFlow64 commented 5 months ago

Thanks, really appreciate the project btw

Jeffser commented 5 months ago

just so you know I made the changes and added a subtitle to every model that can read images, the next update (0.8.0) should be available on Flathub in a couple of hours https://github.com/Jeffser/Alpaca/commit/0c9fd6685b636c674cf82d8fd4ffa6f8d735af5a