search

TianxingWu / FreeInit

[ECCV 2024] FreeInit: Bridging Initialization Gap in Video Diffusion Models
https://tianxingwu.github.io/pages/FreeInit/
MIT License
454 stars 24 forks source link

can it be used with VideoCrafter1 #10

Closed lmpeng12 closed 5 months ago

lmpeng12 commented 7 months ago

can it be used with VideoCrafter1, the github website is https://github.com/AILab-CVC/VideoCrafter.

TianxingWu commented 7 months ago

Have not tested it on VideoCrafter1 yet, but you can look into their ddim_sampling function here and refer to the example code pipeline_animation.py and animate_with_freeinit.py to add FreeInit into the sampling process.