search

fmaclen / hollama

A minimal web-UI for talking to Ollama servers
https://hollama.fernando.is
MIT License
465 stars 38 forks source link

Ability to set parameters #191

Closed iladshyan closed 1 month ago

iladshyan commented 1 month ago

It would be great if we got some ability to add some parameters. For example num_thread is an essential parameter for me as I want to use my CPU to maximum extent. I really don't know if it is even possible to set the num_thread value in current version. It takes ages to produce an output because my default thread value is 2. It would also be great if I can tweak the keep_alive parameter.

fmaclen commented 1 month ago

@iladshyan thanks for the request. This feature is currently planned as part of #116 with the idea that you'll be able to modify all of these settings once per Session or save them as a Project so you can re-use them.

iladshyan commented 1 month ago

@iladshyan thanks for the request. This feature is currently planned as part of #116 with the idea that you'll be able to modify all of these settings once per Session or save them as a Project so you can re-use them.

That's fantastic!

fmaclen commented 1 month ago

:tada: This issue has been resolved in version 0.16.0 :tada:

The release is available on GitHub release

Your semantic-release bot :package::rocket: