ljleb / prompt-fusion-extension

auto1111 webui extension for all sorts of prompt interpolations!
MIT License
268 stars 16 forks source link

ComfyUI #55

Closed Arthur-McArthur closed 1 year ago

Arthur-McArthur commented 1 year ago

This might be a long shot be is there any way to achieve this functionality in ComfyUI? Or plans to port your extension to it?

It is my most used extension by far and dramatically increases the capabilities of SD. It would be great to have it in ComfyUI

ljleb commented 1 year ago

At the moment I think I would need a custom kdiffusion node for this, which is not ideal.

We are working on inserting custom comfyui workflows into multiple sections of the webui for increased generation control. For example, you will be able to run a workflow at each denoising step of the webui to determine how denoising should happen. It is still in its infancy state yet, but you can keep an eye on it as we increase the integration: https://github.com/ModelSurge/sd-webui-comfyui/

Once we get to a more mature and stable state, I'll be looking to add prompt fusion nodes and a workflow type for merging conds, or something like that.

ljleb commented 1 year ago

There seems to be comfyui nodes that achieve this now. I have not successfully installed them but also haven't spent too much time on it: https://github.com/asagi4/comfyui-prompt-control