Can Latte train for I2V tasks?

Vchitect / Latte

Latte: Latent Diffusion Transformer for Video Generation.

Apache License 2.0

1.44k stars 147 forks source link

Can Latte train for I2V tasks? #90

Open 0Godness opened 4 weeks ago

0Godness commented 4 weeks ago

Thanks for your nice work! I want to know how to extend Latte to I2V tasks. Hoping for your reply!

maxin-cn commented 4 weeks ago

Thanks for your nice work! I want to know how to extend Latte to I2V tasks. Hoping for your reply!

Hi, thanks for your interest. You can refer to our latest image animation (a.k.a, image-to-video generation) work Cinemo.

maxin-cn commented 4 weeks ago

Thanks for your nice work! I want to know how to extend Latte to I2V tasks. Hoping for your reply!

Hi, thanks for your interest. We are working on it and you can refer to our latest image animation (a.k.a, image-to-video generation) work Cinemo and SEINE. The codes and checkpoints are also public.