work with svd？

[Laidawang]

can it be used with svd（stable video diffusion）？

[TianxingWu]

Thanks for your interest. Yes we have conducted some preliminary explorations on SVD, and found that FreeInit can indeed enhance the consistency in several cases. However, since SVD noise schedule is largely different from SD, some adjustments might be needed for optimal effectiveness.

[LiuShiyu95]

@TianxingWu Thank you for your great work. Have you tried inversion the video in SVD to get the noise and then reconstructing the original video?

[PHOENIXFURY007]

Any updates on this ? Can it be used with I2Vgen-XL ?

[howardgriffin]

any update?

[TianxingWu]

@howardgriffin A recent paper called ConsistI2V seems to be working on similar ideas, but with specific designs for I2V tasks. Maybe you can check their work first :)