search

rendezqueue / rendezllama

CLI for llama.cpp with various commands to guide, edit, and regenerate tokens on the fly.
ISC License
11 stars 1 forks source link

feat(chat command): to continue without an immediate newline #12

Closed grencez closed 1 year ago

grencez commented 1 year ago

The workaround for now is to type a space followed by one or more words that are likely to be continued as a sentence. A space followed by [ or * or /think works well to induce an action or thought (if your prompt uses this syntax) without biasing the content.

grencez commented 1 year ago

Oh, this should be easy. Just zero out the probability of a newline.