Does it work under CPU? Can I use the Latent Consistency Model? Is it possible to image to image? Is there an example

PRIS-CV / DemoFusion

Let us democratise high-resolution generation! (CVPR 2024)

1.98k stars 229 forks source link

Closed mingooglegit closed 11 months ago

mingooglegit commented 11 months ago

Does it work under CPU? Can I use the Latent Consistency Model? Is it possible to image to image? Is there an example

RuoyiDu commented 11 months ago

It works on CPU but will be much slower. You can have a try by set "cuda" to "cpu" and "float16" to "float32".
I don't think it can work as well on LCM as it does on SD. As DemoFusion relies on the interaction at each time-steps.
Yes, you can change the output of Phase #1 to encoded real images. But as we discussed in the paper, the results are not that satisfactory.