muerrilla / sd-webui-detail-daemon

Extension for A1111's Stable Diffusion Webui. Controls amount of detail.
MIT License
123 stars 5 forks source link

Hi-res fix functionality #10

Open BigMeatyClaws opened 4 months ago

BigMeatyClaws commented 4 months ago

Any chance or possibility this could be done? I'm curious to see how gradually introduced noise would work during the hires.

Great extension, by the way. Already sneaked its way into my top 5 despite being so new, I thought having gens this crisp was impossible with 1.5 based SD.

muerrilla commented 4 months ago

Hey there. Glad you find it useful.

Hires Fix usually applies to the later denoising steps (denoising strength < 0.4 meaning t > 0.6) so there's not really that much room for advanced scheduling, i.e. the effect you'll get out of DD will be pretty similar to using the initial noise multiplier or extra noise parameters already provided by the webui (which applies the extra noise only to the first step of the Hires pass).

On the other hand, Hires Fix is basically img2img, so you can try using DD in the img2img tab instead and have exactly what you're looking for.

I wouldn't mind allowing DD to work during Hires Fix. The reason I disabled it was that I wasn't sure what's the best way to handle it. Ideally we would have 2 separate schedules to allow detail adjustment throughout both the initial pass and the hires pass. But that would be too much work and makes the interface too complicated. One solution would be to have a dropdown that allows you to choose whether DD applies to the initial pass or the hi-res. Got any other ideas?

So, if you try the img2img method and think that it proves useful to have it working with Hires Fix as well do let me know.