Location of the input image in the generated video

Doubiiu / DynamiCrafter

[ECCV 2024] DynamiCrafter: Animating Open-domain Images with Video Diffusion Priors

Apache License 2.0

2.09k stars 165 forks source link

Location of the input image in the generated video #11

Closed wren93 closed 5 months ago

wren93 commented 5 months ago

Hi, is there a way to control the location of the input image in the generated video? e.g. if it is possible to always make it the first frame? I tried to look at the code and it seems that the input image is replicated 16 times and concatenated along the channel dimension of the noise, and it seems that there is no way to control it. I am wondering if this is the correct understanding. Thank you!

Doubiiu commented 5 months ago

Hi. You understanding is correct. We are studying how to add more controllability.