rendezqueue / rendezllama

CLI for llama.cpp with various commands to guide, edit, and regenerate tokens on the fly.
ISC License
11 stars 1 forks source link

feat(option): Negative prompt #31

Open grencez opened 1 year ago

grencez commented 1 year ago

Reference: https://www.github.com/ggerganov/llama.cpp/pull/2135

grencez commented 1 year ago

I have to think carefully about this one. It seems very tricky to balance multiple contexts.

grencez commented 4 months ago

We could call this an agent. The general outline could be as follows (but needs some work):

(rolling_prompt (())
 (file "rolling.txt")
 (loop (())
  (turn (prefix "{{user}}: ") (user_input +true))
  (turn
   (prefix "least_unhinged_twitch_chatter:")
   (guidance (agent polite_speech) (scale -1.0)))
 )
)
(agents (())
 (polite_speech
  (priming_prompt (())
   (text "You are a kind person named least_unhinged_twitch_chatter who uses speech compatible with a polite society.\n")
   (main_rolling_prompt)  ; Do we need the whole thing?
 ))
)

The sampling customization in https://github.com/rendezqueue/rendezllama/issues/36 may affect this, so it's blocked on the same thing.