search

pkuliyi2015 / multidiffusion-upscaler-for-automatic1111

Tiled Diffusion and VAE optimize, licensed under CC BY-NC-SA 4.0
Other
4.79k stars 339 forks source link

Please make tile vae and tile diffusion work with Stable XL #283

Open wardensc2 opened 1 year ago

wardensc2 commented 1 year ago

Hi pkuliyi2015 with the new model Stable Diffusion XL which using more Vram and hardware your extension is vital for PC with less Vram more. But at the moment it's not work in Stable XL, please make it support. We will wait, thank you in advance just dont abbandon this project it's so important for personal user like us.

wardensc2 commented 1 year ago

Sorry, I just check only tile diffusion not working, your tile vae is working very well, thank you

pkuliyi2015 commented 1 year ago

I didn't abandon the project; it is just because I haven't migrate to SDXL. I'm waiting for SDXL custom checkpoints; once they come I update again.

wardensc2 commented 1 year ago

I didn't abandon the project; it is just because I haven't migrate to SDXL. I'm waiting for SDXL custom checkpoints; once they come I update again.

Thank you so much

Desm0nt commented 1 year ago

Even though Tiled VAE works with SDXL - it still has a problem that SD 1.5 didn't have, specifically a weird dot/grid pattern

image

acezard commented 1 year ago

Even though Tiled VAE works with SDXL - it still has a problem that SD 1.5 didn't have, specifically a weird dot/grid pattern

image

I noticed this myself, Tiled VAE seems to ruin all my SDXL gens by creating a pattern (probably the decoded tiles? didn't try to change their size a lot). As of now, I preferred to stop using Tiled VAE in SDXL for that reason.

wardensc2 commented 1 year ago

I didn't abandon the project; it is just because I haven't migrate to SDXL. I'm waiting for SDXL custom checkpoints; once they come I update again.

Hi, anything new pkuliyi2015 ?

wardensc2 commented 1 year ago

Now controlnet openpose and depth for Stable XL are released, it's a matter of time before controlnet tile XL to be finished.

https://huggingface.co/thibaud/controlnet-openpose-sdxl-1.0/tree/main https://huggingface.co/diffusers/controlnet-depth-sdxl-1.0/tree/main https://huggingface.co/diffusers/controlnet-canny-sdxl-1.0/tree/main

So far anything update pkuliyi2015 ?

ViratX commented 1 year ago

I'm also looking forward to the integration with SDXL. Please pkuliyi2015, bless us with your wisdom soon!

pedroluizmossi1 commented 1 year ago

I didn't see this problem until I switched to the Juggernaut XL and some other XL models recently, disabling the Fast Decoder made it possible to generate the images normally. The images below are in 2688x1536, the magic still happens on the 3070.

The problem seems to increse when the resolution is not 1024x1024, but it depends from model to model and you lose a little speed in the final process, more noticeable in large images.

Specs: 3070 - 8GB Webui Parm: --xformers --medvram --no-half-vae

image

Fast Decoder Enabled: image

image

Fast Decoder Disabled: image

image

9Somboon commented 1 year ago

I didn't see this problem until I switched to the Juggernaut XL and some other XL models recently, disabling the Fast Decoder made it possible to generate the images normally. The images below are in 2688x1536, the magic still happens on the 3070.

The problem seems to increse when the resolution is not 1024x1024, but it depends from model to model and you lose a little speed in the final process, more noticeable in large images.

Specs: 3070 - 8GB Webui Parm: --xformers --medvram --no-half-vae

image

Fast Decoder Enabled: image

image

Fast Decoder Disabled: image

image

I've been having a headache with this problem for several days. And I found this answer as well.

sebaxakerhtc commented 9 months ago

@pkuliyi2015 So... There's a lot of custom chekpoints of SDXL now. Will Tiled Diffusion work with SDXL?

I didn't abandon the project; it is just because I haven't migrate to SDXL. I'm waiting for SDXL custom checkpoints; once they come I update again.

So... There's a lot of custom checkpoints based on SDXL now. Will Tiled Diffusion work soon with SDXL?

hakbodi commented 5 months ago

Are you still working on SDXL support?

Kahsolt commented 5 months ago

Sadly say no. The core developers of this extension has all gone :(

hakbodi commented 5 months ago

Sadly say no. The core developers of this extension has all gone :(

Ouch... that sucks, I've grown dependent on this extension :/ do you know if anything comparable exists with active development?

Kahsolt commented 5 months ago

So sorry but be honest to say that I've not touched these SD stuff for months, unfamiliar to the current mainstream community.

The last news I got is that, the author of sd-webui-forge will make his forge version "more experimental", thus call people back to the original a1111 for stable production. Before that annoucement, people wants our multidiffusion migrated to forge.... What I mean here is, maybe you should ask A1111, might there be more proficient users and helpful suggestion :)

woshinwyx commented 4 months ago

Even though Tiled VAE works with SDXL - it still has a problem that SD 1.5 didn't have, specifically a weird dot/grid pattern image

I noticed this myself, Tiled VAE seems to ruin all my SDXL gens by creating a pattern (probably the decoded tiles? didn't try to change their size a lot). As of now, I preferred to stop using Tiled VAE in SDXL for that reason.

Have you solved this problem?