[Feature Request] Modular prompt management

[muunkky]

For the best results, Prompts need to change a lot while outpainting. For me, this becomes the most inhibitive aspect of outpainting.

What I would love is the ability to add multiple prompt segments that you can turn "on" and "off". I'm imagining many text boxes with a check box beside them. Then you can put the prompt for the head in one, the background in another, and so on for various parts / aspects of the image. Then when outpainting you can select the relevant prompt "modules" for the area you are out/in-painting.

So far, I have been copying the original prompt in and editing it every time I run the imagine or inpaint tool. I guess I could use a document to organize the prompt and copy-paste as necessary. That would probably be the best alternative, or a spreadsheet maybe. I just discovered the prompt history tool, so maybe that will help a little.

Overall, I was just surprised at how much prompt refining was required to get good results

[zero01101]

hey, so i certainly agree that there's a good amount of prompt work involved with anything substantial in stable diffusion, but i don't think this is a particularly fluid way of enhancing it. just off the top of my head:

• a preset number of "promptlets" is inflexible
• a user-definable number of promptlets could quickly become unwieldy
• how do we know where in the prompt to put the promptlet? can't follow the text insert cursor because it vanishes from the input as soon as you click the checkbox/button/etc, does it always just go to the end of the prompt? prompt sequence is pretty important for composition
• how do we know which prompt it goes to? two buttons/checkboxes, positive/negative prompt?
• what happens if it's a rather short, simple promptlet but the user wants to apply it twice in separate areas? what if they change their mind, which one gets removed? both?

just kind of imagining trying to use something like that doesn't seem any more convenient (but potentially more error-prone) than a spreadsheet in the background like you mentioned, and i certainly have no interest in reinventing microsoft excel lol ;)

[guzuligo]

I think a simple interface to a text file is sufficient.

The only enhancement it would need is some keyboard shortcuts to clear prompt, replace it and append to it. Example: press shift and ctrl+v send to prompt, ctrl+x replaces prompt, ctrl+c imports what is in the prompt.

That way, you would just need to navigate your text file interface. And then you can save your text files normally and can even edit them outside of the app.

And then, maybe there can be an option when you want to continue working on a piece, you just save the canvas along with the text file and they get the same file name so that when you load, you have even the text file ready.

[seijihariki]

We can try using some type of autocompleting with custom user-defined tags with values; danbooru tag autocomplete style. This would avoid much clutter on the UI, and still allow for custom in/outpainting prompt shortcuts.

[muunkky]

@zero01101 I was really thinking of something much simpler. Just have multiple text fields with check boxes, that's it. add more text boxes for new stuff and then be able to turn it off and on as you go. Click the little trash button to remove that text box if you don't need it anymore.

If the prompt is just an aggregate of the text boxes, then that should be plenty.

[Xotchkass]

@muunkky I personaly don't think this is enough, because you need to rearange tags and change their weights. I am thinking about something like this. where every box is draggable and have weight field.

[muunkky]

that's fancy. I was just thinking "I don't want there to be a fish here" or "I don't want it rendering the face in this part" or "let's add a pretty painting here"