griptape-ai / ComfyUI-Griptape

A suite of Griptape nodes for ComfyUI
Apache License 2.0
96 stars 11 forks source link

Reorganize Menu Items #90

Open shhlife opened 1 month ago

shhlife commented 1 month ago

I'd like to add some consistency to the Griptape RMB menu.

shhlife commented 1 month ago

Here's the current re-order - let me know what you think

image

image

image

image

image

image

image

image

image

image

image

shhlife commented 1 month ago

That breaks it all up based on agent tasks/etc.. I could also go media-type menu items, so group all image things, then group audio things, group text things, then utils for merging/converting..

but then for things like loading and saving, do those go in the media-based menus, or would they go in a file menu?

shhlife commented 1 month ago

The other option would be something like:

Agent
* Create: Agent
* Create: Agent from Config
* ----------------------------------
* Run: Agent
* Run: Prompt Task
* Run: Tool Task
* Run: Toolkit Task
* ----------------------------------
* Expand Agent
* Save Default Agent

Agent Configs
* Agent Config: Custom Structure
* -----------------------------------
* Agent Config: Anthropic
* Agent Config: Azure OpenAI
* (etc)

Agent Drivers
* Prompt >
* Image Generation >
* Embedding >
* Vector Store >
* Text to Speech >
* Audio Transcription >
* Web Search >

Agent Rules
* Create: Rules
* Combine: Rules
* Replace: Rules on Agent

Agent Tools
* Convert: Agent to Tool
* Combine: Tools
* Replace: Tools on Agent
* -----------------------------
* Tool: Audio Transcription
* Tool: Calculator
* Tool: Date Time
* (etc)

--------------------------------

Display
* Display Image
* Display Text
* Display Data as Text

--------------------------------

Audio
* Run: Audio Transcription
* Run: Text to Speech
* ------------------------------
* Load: Audio

Image 
* Run: Create Image from Text
* Run: Create Image Variation from Text
* Run: Image Description
* Run: Parallel Image Description
* ------------------------------
* Load: Image from URL

Text
* Run: Text Summary
* ------------------------------
* Load: Text File
* Load: PDF
* Load: URL
* ------------------------------
* Save: Text File
* ------------------------------
* Vector Store: Add Text
* Vector Store: Query Text
shhlife commented 1 month ago

as part of this task, I'd also like to try and rename the nodes with a Gt prefix instead of Griptape to keep the names shorter.

shhlife commented 1 month ago

Another recommendation was to try and consolidate a bunch of similar nodes & hide/show parameters based on selections. Joviex (in the ComfyOrg Discord) is going to provide an example. This would allow us to do something like:

Agent: Create[Simple|Complex]
Agent: Run [Prompt|Tool(s)|TextSummary]
Vector Store [Add | Query]
--------------------------------------------
Agent Config
Agent Custom Config
Agent Tool [Agent | Calculator | DateTime ...]
Agent Utilities >
* Expand Agent
* Replace [Config | Rules | Tools] on Agent
--------------------------------------------
Prompt Driver
Image Generation Driver
Embedding Driver
Vector Store Driver
Text to Speech Driver
Audio Transcription Driver
Web Search Driver
shhlife commented 1 month ago

adding link to helpful example from Jovieux: https://github.com/Amorano/ComfyUI-Griptape

shhlife commented 1 month ago

Just pushed an update with the reordered menu items, without name changes or consolidation yet. Wanted to see if this helps.