rendezqueue / rendezllama

CLI for llama.cpp with various commands to guide, edit, and regenerate tokens on the fly.
ISC License
11 stars 1 forks source link

feat(option): to behave nicely as a child process that provides a chatbot #22

Closed grencez closed 1 year ago

grencez commented 1 year ago

We just need a few things:

grencez commented 1 year ago

New example explains how to run as a coprocess: https://github.com/rendezqueue/rendezllama/tree/trunk/example/prompt/assistant_coprocess