Can I use SDXL for training, such as I want to train inpaints

lllyasviel / ControlNet-v1-1-nightly

Nightly release of ControlNet 1.1

4.47k stars 364 forks source link

Can I use SDXL for training, such as I want to train inpaints #126

Open CQxiaocaimi opened 8 months ago

CQxiaocaimi commented 8 months ago

As mentioned in the title, I believe that SDXL combined with Controlnet will have better results.

geroldmeisinger commented 8 months ago

yes

CQxiaocaimi commented 8 months ago

是的

How should I write the correspondingyaml file?I don't know how to do this. Can you help me? For example, I use stable-diffusion-xl-base-1.0 and want to train ControlNet's ip2p, canny, shuffle...So how should I write control_v11e_sd15_ip2p.yaml?I'm sorry to bother you, but I really don't understand.

geroldmeisinger commented 8 months ago

read this https://civitai.com/articles/2078 if this is your first CN training, start with a simple one: canny. use SD 1 instead of XL, it will be faster. you may need to restart training a few times. XL training is not that different and you can start it anytime once you have something working: https://github.com/huggingface/diffusers/blob/main/examples/controlnet/README_sdxl.md i never had to write my own yaml for simple CNs so I don't know