Is there a list of prompts used in training that we can use when creating videos?

Doubiiu / DynamiCrafter

[ECCV 2024] DynamiCrafter: Animating Open-domain Images with Video Diffusion Priors

Apache License 2.0

2.06k stars 161 forks source link

Is there a list of prompts used in training that we can use when creating videos? #103

Open brad12d3 opened 6 days ago

brad12d3 commented 6 days ago

I'm curious what prompts DynamiCrafter responds to? I see some in the examples, but I was wondering if there was a resource that had more info on what type of prompts it responds best to?

Doubiiu commented 5 days ago

During training, we use BLIP-2 for captioning, so you can try to cap your image using online BLIP-2.