RQ-Wu
commented
10 months ago You can use https://huggingface.co/docs/diffusers/using-diffusers/sdxl to generate the first frame. Our project uses a lower version of diffusers, and SD-XL is integrated in a higher version of diffusers. Aligning the two versions is a bit tricky. Maybe I'll do that later, and add the code of first-frame generation in this repo
Hi, thanks a lot for your interesting work! I know that in your paper you explain that you use the T2I model to generate the first frame during inference, but there doesn't seem to be any code in the "inference_script" that generates the first frame. I'm wondering if I'm mistaken.