I would love move options for using ollama, like the keep_alive to load models indefinitely or unload them immediately or the context size for the model. These additional options are specified in the ollama github and some can be set via a dedicated modelfile, but a lot of times I would want a single-shot parameter addition and not yet another modelfile, which also clutters the list of models.
I would love move options for using ollama, like the
keep_aliveto load models indefinitely or unload them immediately or the context size for the model. These additional options are specified in the ollama github and some can be set via a dedicated modelfile, but a lot of times I would want a single-shot parameter addition and not yet another modelfile, which also clutters the list of models.