Trojaner / text-generation-webui-stable_diffusion

Integrate image generation capabilities to text-generation-webui using Stable Diffusion.
Other
51 stars 5 forks source link

The Trigger Prompt Doesn't Seem to Impact the Model? #6

Closed juicyroots closed 6 months ago

juicyroots commented 7 months ago

This config setting in settings.yaml does not seem to change how the model responds:

The prompt to trigger a description of the subject.

stable_diffusion-interactive_mode_description_prompt: > You are now a text generator for the Stable Diffusion AI image generator. You will generate a text prompt for it. Describe [subject] using comma-separated tags only. Do not use sentences. ...

Is there something that I need to do, or a particular model that I need to use? What's the trick? Thank you!

Trojaner commented 7 months ago

This option only works in trigger mode

juicyroots commented 7 months ago

Thanks for the response! Appreciate it. I see a few options under 'Trigger Mode'

Text generation web UI - Brave-000101

Manual, Interactive, Continuous... Does only one of those work?

Trojaner commented 7 months ago

This option only works in trigger mode

Sorry, I forgot to specify that it's for the interactive trigger mode

Keep in mind that the extension UI is currently experimental and settings should be set in the related settings json or yaml file instead. This will also make them persistent.

Trojaner commented 7 months ago

Closing as resolved. Feel free to open a new issue if the issue persists.

Also prompt generation modes have been added for interactive and continuous modes in v1.1:

## Set's how the base prompt for image generation should be generated. Possible values:
##  - "default_prompt": Uses the default_prompt option as a static prompt ignoring any chat context.
##  - "generated_text": Uses the generated output as-is as prompt.
##  - "dynamic": Uses a dynamic prompt using the subject_regex, default_subject and description_prompt options.
## The result is combined with the base_prompt_suffix and base_negative_prompt options.
stable_diffusion-interactive_mode_prompt_generation_mode: "dynamic"
## Set's how the base prompt for image generation should be generated. Possible values:
##  - "default_prompt": Uses the default_prompt option as a static prompt ignoring any chat context.
##  - "generated_text": Uses the generated output as-is as prompt.
## The result is combined with the base_prompt_suffix and base_negative_prompt options.
stable_diffusion-continuous_mode_prompt_generation_mode: "generated_text"
sandrejev commented 6 months ago

It doesn' work for me either. The error is in script.py

        text = (
            description_prompt
            if ext_params.interactive_mode_prompt_generation_mode
            == InteractiveModePromptGenerationMode.DYNAMIC
            else text
        )

should be replaced with

        prompt = (
            description_prompt
            if ext_params.interactive_mode_prompt_generation_mode
            == InteractiveModePromptGenerationMode.DYNAMIC
            else text
        )