Sanster / IOPaint

Image inpainting tool powered by SOTA AI Model. Remove any unwanted object, defect, people from your pictures or erase and replace(powered by stable diffusion) any thing on your pictures.
https://www.iopaint.com/
Apache License 2.0
19.53k stars 1.99k forks source link

[Feature Request]support SD-XL #359

Open dsp6414 opened 1 year ago

dsp6414 commented 1 year ago

is there any plan to support SD-XL?

Sanster commented 1 year ago

As far as I know, SD-XL is not trained for inpainting task, its performance is worse than sd1.5-inpainting model, here is a discussion from diffusers:

https://github.com/huggingface/diffusers/issues/4392

2blackbar commented 1 year ago

Sanster You can use controlnet inpaint model with stable diffusion models, it works with any 1,5 model and works much better than regular inpaint 1.5 model, by using controlnet inpaint you will be able to implement outpainting like new adobe AI fill https://github.com/Mikubill/sd-webui-controlnet/discussions/1597

piaolingxue commented 1 year ago

https://huggingface.co/spaces/diffusers/stable-diffusion-xl-inpainting