search

cloneofsimo / paint-with-words-sd

Implementation of Paint-with-words with Stable Diffusion : method from eDiff-I that let you generate image from text-labeled segmentation map.
MIT License
636 stars 50 forks source link

Using with lora #35

Open asadm opened 1 year ago

asadm commented 1 year ago

Hello,

I imagine I can't just monkeypatch the pww pipeline with loras. Can you point me to what exactly needs to be adjusted in this repo to make them compatible with your lora library.

Thank you for your help!

lwchen6309 commented 1 year ago

I guess you can traine models by LORA and "Mergigng Full model with LoRA and changing to original CKPT format" as described in his repo. This results in ckpt in the original format and should be compatible with PwW as usual.