search

kohya-ss / sd-scripts

Apache License 2.0
5.03k stars 843 forks source link

[REQ] Will LCM model training? #916

Open mykeehu opened 11 months ago

mykeehu commented 11 months ago

I don't know if it's possible to train LCM models or convert an existing model to LCM, but it would be good for users with weak machines. A description of the LCM model is here: https://arxiv.org/abs/2310.04378

Their website: https://latent-consistency-models.github.io/

And here: https://github.com/luosiallen/latent-consistency-model

The Fast Stable Diffusion app page: https://github.com/rupeshs/fastsdcpu

kohya-ss commented 11 months ago

Their repository does not seem to have any training script yet.
https://github.com/luosiallen/latent-consistency-model/issues/20

Once the training script is released, there may be a possibility to implement it in this repository.

alfredplpl commented 11 months ago

FYI: https://github.com/laksjdjf/sd-trainer/blob/lcm/lcm.py

kohya-ss commented 11 months ago

FYI: https://github.com/laksjdjf/sd-trainer/blob/lcm/lcm.py

Thank you for letting me know!

mykeehu commented 10 months ago

LCM has got many updates! https://huggingface.co/latent-consistency/lcm-lora-sdxl https://huggingface.co/latent-consistency/lcm-sdxl

and: https://huggingface.co/collections/latent-consistency/latent-consistency-models-weights-654ce61a95edd6dffccef6a8 https://huggingface.co/collections/latent-consistency/latent-consistency-models-loras-654cdd24e111e16f0865fba6

alfredplpl commented 10 months ago

Distill code: https://github.com/huggingface/diffusers/tree/main/examples/consistency_distillation

aisegmentcn commented 10 months ago

Waiting...

ManuelMultiverse commented 9 months ago

Hi @kohya-ss any updates on this?