search

basujindal / stable-diffusion

Optimized Stable Diffusion modified to run on lower GPU VRAM
Other
3.13k stars 469 forks source link

Gradio loading animation slows generations down by 10% #81

Open TheEnhas opened 2 years ago

TheEnhas commented 2 years ago

https://github.com/hlky/stable-diffusion-webui#Loading

Also, is there any way to integrate that UI into this fork? Mostly because it (kind of) has inpainting support in img2img, which is much different than the rudimentary support SD has and doesn't need a 3.1 GB latent diffusion checkpoint to work.

basujindal commented 2 years ago

I will look into the performance degradation part. But can you tell more about the inpainting support? Does it only use the original Stable diffusion weights for inpainting?

TheEnhas commented 2 years ago

I think so, there's no mention of other models to download for that, and it looks like it's done through masking with img2img. I'd try it but I'm kind of afraid of hosing my SD install, I'm lucky I was able to get this fork up and running lol

AK391 commented 2 years ago

huggingface diffusers supports inpainting which can be added using this script

https://github.com/huggingface/diffusers/tree/main/examples/inference#in-painting-using-stable-diffusion

pandoras-rabbithole commented 2 years ago

I will look into the performance degradation part. But can you tell more about the inpainting support? Does it only use the original Stable diffusion weights for inpainting?

I don't think it has actual inpainting support (nor does it claim to). it just masks the generated portion if img2img which results in generations where the masked portion doesn't line up or match the outside colors and style at all.