search

elevenhsoft / cosmic-ext-applet-ollama

Ollama applet for COSMIC Desktop
GNU General Public License v3.0
19 stars 1 forks source link

Some thought for enhancement #6

Open wiiznokes opened 4 weeks ago

wiiznokes commented 4 weeks ago

I didn't wanted to make a tons of issues, so here is a list of what i think would be nice to add

Overall, great applet! I didn't expect it to be that fast on my 3060ti. I will probably try to package it for fedora now that i managed to install ollama (with snap, its probably the best solution for fedora, works out of the box with my nvidia card and is very up to date)

elevenhsoft commented 3 weeks ago

Hello, sorry for late response :)

remove the ..., it takes some useful height space

We can remove it. Just added, so it does not look that empty ;p

provide a feedback to know if the model is loaded in memory. I'm not sure if the model is unloaded after some time to save space, but it would be nice to document that at least, to know if it make sense to remove the applet from the panel when gaming for example

I'm not sure about that one. From my understanding. It should be not loaded, especially from the applet itself, but Ollama can make it loaded in memory, so it waiting for your requests via API. However applet is not that resources free. We running on subscriptions, most of the time it's on idle state so does not do anything, but when making requests it's goes from subscription. But if we should remove applet from panel when gaming? I don't think so, but I know some people may think it's required so depends who and on what hardware is running it :P

scroll to the bottom when opening the applet

good idea.

maybe change the add image and new chat button (maybe with 📎 and +)

Yea, I'm using cosmic icons for it, if I find good substitute we can change :)

support (shit || ctrl) + enter for inserting a new line.

this one might be tricky, since libcosmic does not have multiline inputs from what I know. Maybe I can try to add one, but I can promise anything. But for sure it would be helpful.

Overall, great applet! I didn't expect it to be that fast on my 3060ti. I will probably try to package it for fedora now that i managed to install ollama (with snap, its probably the best solution for fedora, works out of the box with my nvidia card and is very up to date)

Thank you! Yeah, on some AMD or NV GPU it works really well. Some struggling is running on CPU but still usable ^^