search

Jeffser / Alpaca

🦙 An Ollama client made with GTK4 and Adwaita
https://jeffser.com/alpaca
GNU General Public License v3.0
459 stars 45 forks source link

Set num_threads model parameter #360

Open 71f681c20d opened 1 month ago

71f681c20d commented 1 month ago

Is your feature request related to a problem? Please describe. When I run Alpaca, the Ollama instance is under-utilizing my resources, resulting in slower outputs.

Describe the solution you'd like A menu option under Preferences>General for setting the number of threads as an Ollama model parameter

Describe alternatives you've considered Editing config files for the ollama model

Additional context This would add a lot of convenience for people who want to configure how many cores the ollama instance can use, and it would be nice easily change this value for each model. I currently have a change implemented already, and I'm testing it now.

71f681c20d commented 1 month ago

I have a change implemented already, but still need to test it out. I'll do that today. Can I submit this issue?