How to use FreeInit with Image to Video Models ? Is it possible to use it similar to FreeU in T2V , I2V ?

TianxingWu / FreeInit

[ECCV 2024] FreeInit: Bridging Initialization Gap in Video Diffusion Models

https://tianxingwu.github.io/pages/FreeInit/

MIT License

481 stars 22 forks source link

How to use FreeInit with Image to Video Models ? Is it possible to use it similar to FreeU in T2V , I2V ? #17

Open PHOENIXFURY007 opened 8 months ago

TianxingWu commented 7 months ago

Hi, my previous attempts on svd I2V model did not show the same level of effectiveness as on T2V. A recent work called ConsistI2V seems to have used similar ideas, which may worth your attention.