How to use controlNet with pretrained LoRA?

HighCWu / ControlLoRA

ControlLoRA: A Lightweight Neural Network To Control Stable Diffusion Spatial Information

Apache License 2.0

569 stars 27 forks source link

Open zengqixun12 opened 1 year ago

zengqixun12 commented 1 year ago

I want to combine the pretrained LORA_model and pretrained controlnet_mdoel like "[control_sd15_depth.pth]",and export new model.

How to realize this function?

HighCWu commented 1 year ago

I haven't completed the quick call code for this, you can refer to mix_lora_and_control_lora.py for experiment

zengqixun12 commented 1 year ago

anyway,thanks a lot