search

s-kostyaev / ellama

Ellama is a tool for interacting with large language models from Emacs.
GNU General Public License v3.0
475 stars 30 forks source link

Feature request: customizable temperature #99

Open hab25 opened 6 months ago

hab25 commented 6 months ago

I like setting temperature (see https://github.com/ahyatt/llm/blob/a090d3bdbd8764c2d0ea6e157ad02569068a09cb/llm.el#L101C1-L104C22 ) to 0.

AFAICT this is not currently cleanly possible with ellama.

NightMachinery commented 5 months ago

Is there a simple elisp hack to hardcode the temperature to zero?

s-kostyaev commented 5 months ago

You can create custom ollama model with temperature 0. See modelfile documentation in ollama repo.

NightMachinery commented 5 months ago

I don't use the ollama backend; I use Groq or OpenRouter, depending on the model. (Both are OpenAI compatible servers.)

s-kostyaev commented 5 months ago

No simple hacks, I will add support later. Llm library supports it, so I need to pass param there.