Support for LCM-LoRA + AnimateDiff-Lightning?

Zejun-Yang / AniPortrait

AniPortrait: Audio-Driven Synthesis of Photorealistic Portrait Animation

Apache License 2.0

4.54k stars 570 forks source link

Support for LCM-LoRA + AnimateDiff-Lightning? #6

Open apolinario opened 6 months ago

apolinario commented 6 months ago

Thanks for the model and pipelines, superb work!

As the technique is based on SD1.5 + AnimateDiff, I was wondering if it would be possible to create a super fast version based on the LCM-LoRA for SD1.5 plus Animate Diff Lightning (https://huggingface.co/ByteDance/AnimateDiff-Lightning)

Zejun-Yang commented 6 months ago

Thank you for your interest! We have also noticed this work. And we are trying to apply LCM in our framework to speed up the inference process. We think it would be possible to merge LCM and VDM.

guyanxiao commented 6 months ago

It would be greatful if we can speed up the inference speed. It's too slow on current apporach. Inference 25 seconds video takes 14 minutes on A800 GPU.