weave
multiversal writing tool
![Weave Icon](https://github.com/mdegans/weave/raw/main/resources/icon.inkscape.svg)
Weave is a "multiversal" generative tree writing tool akin to loom
. It supports multiple generative backends such as:
- β
drama_llama
- llama.cpp wrapper supporting all llama.cpp models
- β
OpenAI models
- β
Shim for GPT 3.5+ chat completions API, including GPT 4o.
- π² Anthropic models
Features
Notable features:
- Live switching of backends - Generate part of a story
with OpenAI and another part with LLaMA -- all without restarting the app.
- Streaming responses - Cancel generations in progress --
both local and online.
- Live editing - Edit posts during generation. New tokens are always appended to the end.
- Advanced sampling controls - For local language models. Use any sampling methods in any order.
Coming soon:
Additionally, one goal of weave
is feature parity with loom
.
- βοΈ Read mode
- β
Linear story view
- π² Tree nav bar
- π² Edit mode
- βοΈ Tree view
- β
Explore tree visually with mouse
- β
Expand and collapse nodes
- π² Change tree topology
- β
Edit nodes in place
- π² Navigation
- π² Hotkeys
- π² Bookmarks
- π² Chapters
- π² 'Visited' state
- βοΈ Generation
- π² Generate N children with various models (currently one a time).
- β
Modify generation settings (Complete for OpenAI but not yet from LLaMA)
- βοΈ File I/O
- β
Serializable application state, including stories, to JSON.
- β
Open/save trees as JSON files
- π² Work with trees in multiple tabs
- π² Combine multiple trees
Notable issues
- On some platforms (like MacOS) the Weave icon will change to an
e
shortly
after launch. See this
issue for
details.
- With each new generation, all tokens need to be injested again with most
backends. This is solvable with
drama_llama
(longest prefix cache) but not
for the OpenAI API. So for OpenAI, it's recommended to generate larger posts.
The system prompt is customizable so you can tweak the agent's instructions on
verbosity.
- It is not currently possible to have a scrollable viewport so it's
recommended to collapse nodes if things get cluttered. This is because the
nodes are implemented with
egui::containers::Window
which ignore scrollable areas. This is fixable
but not easily and not cleanly. When it is resolved the central panel will be
split into story and node views.