issues
search
rendezqueue
/
rendezllama
CLI for llama.cpp with various commands to guide, edit, and regenerate tokens on the fly.
ISC License
10
stars
1
forks
source link
qual: Update defaults
#29
Closed
grencez
closed
1 year ago
grencez
commented
1 year ago
[x] mirostat should be default. It's better than top-k.
[x] Repeat pentalties should not exist or be a good choice for chat.
[x] mmap should be on by default. Even on my ZFS setup, I think it's better to stall out than swap.
[x] batch_count should be big enough for OpenBLAS to activate.
[x]
template_protagonist and template_confidant should be "{{user}}" and "{{char}}" by default.
Nah.
[x]
Should threads be auto-detected?
Yes but I don't want to maintain it unless it's easier.
[x] No character name requirement if prefixes are given.
Document defaults. Link from examples.
template_protagonist and template_confidant should be "{{user}}" and "{{char}}" by default.Nah.Should threads be auto-detected?Yes but I don't want to maintain it unless it's easier.Document defaults. Link from examples.