Doubiiu / DynamiCrafter

[ECCV 2024, Oral] DynamiCrafter: Animating Open-domain Images with Video Diffusion Priors
https://doubiiu.github.io/projects/DynamiCrafter/
Apache License 2.0
2.46k stars 197 forks source link

Can you provide more information on the Story telling video generation? #80

Closed cbokka closed 3 months ago

cbokka commented 4 months ago

Hi, I'm struggling to find any code or details about this? https://github.com/Doubiiu/DynamiCrafter?tab=readme-ov-file#21-storytelling-video-generation-see-project-page-for-more-details. Can you pleae help me find more information about this, like the code etc.

Doubiiu commented 4 months ago

Actually, this is straightforward:

  1. ask chatgpt for a story
  2. ask dalle3 to generate 4 shots (images) of that story
  3. use dynamicrafter to animate each of the shots to generate videos