search

LostRuins / koboldcpp

A simple one-file way to run various GGML and GGUF models with KoboldAI's UI
https://github.com/lostruins/koboldcpp
GNU Affero General Public License v3.0
4.36k stars 312 forks source link

Novel or book writing feature like Sudowrite #831

Open d5364t54ytfr4 opened 2 months ago

d5364t54ytfr4 commented 2 months ago

Hello!

I didn't know that you could run such powerful LLMs locally until now.

I was intrigued by novel writing AI like sudowrite, but the subscriptions are too expensive.

Are there any plans to imitate the features of Novel writing AI?

For example Sudowrite has features like setting the following in memory.:** Braindump Genre Style Synopsis Characters Outline

It also supports autogenerating the above content and rewriting the content based on prompts.

Or is this already possible with some hacks?

It'd be cool if you could use this software for writing novels.

LostRuins commented 2 months ago

Check the scenarios for some good examples. There is a story writing mode, adventure mode, chat mode and instruct mode.

d5364t54ytfr4 commented 2 months ago

Check the scenarios for some good examples. There is a story writing mode, adventure mode, chat mode and instruct mode.

I have checked the story mode, but I'm specifically referring to setting the above features in memory. By setting things like synopsis, Characters, Outline in memory, you can get the desired story.

This is done in a easy to use GUI that handles everything automatically.

And best of all you can even generate these things automatically with a prompt and you can even have the LLM rewrite/change the things with a prompt.

Sudowrite