search

KoboldAI / KoboldAI-Client

For GGUF support, see KoboldCPP: https://github.com/LostRuins/koboldcpp
https://koboldai.com
GNU Affero General Public License v3.0
3.46k stars 747 forks source link

Generate requests for multiple chat sessions #329

Open andrey-genpracc opened 1 year ago

andrey-genpracc commented 1 year ago

I want to have different characters (stories) in chat mode and send for each of them their requests and have different chat sessions with that different characters . And when i will send request through api, it will be for specific character and chat session. Does KoboldAIClient API have this functional? Can't find this one in docs (

henk717 commented 1 year ago

By default the API will process what you send to it verbatim. So when you send something for one character it wont be remembered in the next request. So its all about how you craft your requests.

andrey-genpracc commented 1 year ago

If i correctly understood i don't have chat id, to send api request only for specific chat session and i need to create my text in request with specific way which provide logical continue of conversation for exact story?

henk717 commented 1 year ago

Correct yes, the API by default goes straight to the generator so the "history" in the text you send to the API provides it with the context on what to do next.