Open asadm opened 1 year ago
This two repos may help. First, you can convert controlnet into diffusers supported format, then just treat it as a regular SD model, and further add LoRA layers. @asadm
but would this work with @cloneofsimo 's approach of patching pipe? The lora there seems to have been trained using kohya's approach
This two repos may help. First, you can convert controlnet into diffusers supported format, then just treat it as a regular SD model, and further add LoRA layers. @asadm
I tried this method, but fialed on the second step:
╭─────────────────────────────── Traceback (most recent call last) ────────────────────────────────╮
│ /usr/local/mnn/ENV/bin/lora_add:8 in
hi I have the same problem with you, in merging lora and controlnet, is there any solution for this?
The official diffusers implementation of controlnet already works with simo's lora
The official diffusers implementation of controlnet already works with simo's lora
hi is there any example for this?
The official diffusers implementation of controlnet already works with simo's lora
Could you please elaborate on this? How can I make this work?
What would be the right way to control a LoRA patched model using ControlNet?
Also, I wonder if we also need to patch controlnet model using something like this (Discussion).