search

ali-vilab / VGen

Official repo for VGen: a holistic video generation ecosystem for video generation building on diffusion models
https://i2vgen-xl.github.io
2.75k stars 243 forks source link

Question about the motion adapter in DreamVideo #122

Open Alisaleelee opened 3 weeks ago

Alisaleelee commented 3 weeks ago

hi, thx for your nice work. I have some questions about DreamVideo.

Why selecting a random image embedding from the input video can diminish the impact of appearance to motion learning.

thanks.

weilllllls commented 3 weeks ago

Hi, thanks for your interest. Appearance guidance prevents the model from taking shortcuts (in learning appearance/background) by actively providing prior appearance information of motion videos, enabling the model to focus on motion learning.