huggingface / diffusers

🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.
https://huggingface.co/docs/diffusers
Apache License 2.0
26.38k stars 5.43k forks source link

examples\controlnet add only_mid_control=true and sd_locked=false #5070

Open geroldmeisinger opened 1 year ago

geroldmeisinger commented 1 year ago

Is your feature request related to a problem? Please describe. The original controlnet training tutorial mentions the options

Describe the solution you'd like Please make the option available as well.

Describe alternatives you've considered Going back to the original training script without any optimizations implemented.

patrickvonplaten commented 1 year ago

cc @williamberman @patil-suraj

williamberman commented 1 year ago

Yeah these are neat ideas! I think these would be good options for community PRs, happy to open up to the community :)

kelisiya commented 1 year ago

Have any updates about this project ?

jiangyuhangcn commented 1 year ago

How to Implement SD_ Locked=False in Diffusers?

ValMystletainn commented 1 year ago

I would like to try this issue. Seemingly, It can be done by set different gradient recording switch and keep it compatible with accelerate. @williamberman @patrickvonplaten @patil-suraj

jon-chuang commented 1 year ago

Seems pretty straightforward, just add an option to freeze/unfreeze certain weights.

UmerHA commented 1 year ago

Hi @ValMystletainn, are you still on it? :) Otherwise I'd tackle it.

UmerHA commented 11 months ago

Okay, I'd tackle this :) Eta 1 week.

Night1099 commented 6 months ago

This is not an option still in current controlnet train script