search

ssitu / ComfyUI_UltimateSDUpscale

ComfyUI nodes for the Ultimate Stable Diffusion Upscale script by Coyote-A.
GNU General Public License v3.0
840 stars 58 forks source link

ipadapter for use with the tiling? #32

Open cchance27 opened 11 months ago

cchance27 commented 11 months ago

Any chance there would be a way to integrate ipadapter to analyze the individual tiles as the upscaling is happening, this would likely help the issue where you get little faces from the portrait in each of the upscales if you upscale too quickly because the overall prompt doesn't match a tile of the image, if we could use ipadapter to analyze the tile with a higher strength than the overall weight it might really improve things.

ssitu commented 11 months ago

That sounds like a good idea, I'll look into it when I can, unless someone else beats me to it.

Steudio commented 2 months ago

to add-on to the idea, adding a way to analyse each tile with Florence 2 (for example) and change the prompt per tile would be amazing.