Generate dynamic diagrams (via Excalidraw) - Githubissues

khoj-ai / khoj

Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI (e.g gpt, claude, gemini, llama, qwen, mistral).

https://khoj.dev

GNU Affero General Public License v3.0

14.7k stars 730 forks source link

Generate dynamic diagrams (via Excalidraw) #940

Closed sabaimran closed 3 weeks ago

sabaimran commented 3 weeks ago

Add support for generating dynamic diagrams in flow with Excalidraw (https://github.com/excalidraw/excalidraw). This happens in three steps:

Default information collection & intent determination step.
Improving the overall guidance of the prompt for generating a JSON, Excalidraw-compatible declaration.
Generation of the diagram to output to the final UI.

Inline diagram	Expanded diagram

Add support on the web UI for rendering the diagrams in-flow.

Pending issues

Stylesheet not loading upfront sometimes for some reason, so renders with ugly default font
Handle response for Obsidian, Emacs, Desktop (reroute to web UI)

rehandaphedar commented 3 weeks ago

Hi, not sure if this should be in a separate issue, but I think these two programs would be very good candidates for extending a feature like this:

d2 would be a very good candidate for extending a feature like this. It's very "clean" (single d2 binary that outputs svg, no complex dependencies).
Kroki! is a single API for multiple text to diagram programs, including d2 and excalidraw.