search

aigc-apps / CogVideoX-Fun

📹 A more flexible CogVideoX that can generate videos at any resolution and creates videos from images.
Apache License 2.0
486 stars 32 forks source link

Training Image to Video generation #59

Open abcdvzz opened 2 weeks ago

abcdvzz commented 2 weeks ago

In the train.py, the code doesn't use sample['ref_pixel_values'] or sample['clip_pixel_values']. Does this mean the image to video generation training uses a random frame instead of the first frame?

bubbliiiing commented 2 weeks ago

I don't understand this meaning. The image generated video is implemented through inpaint, and the parts that need to be reconstructed are masked