search

Doubiiu / DynamiCrafter

[ECCV 2024] DynamiCrafter: Animating Open-domain Images with Video Diffusion Priors
Apache License 2.0
2.06k stars 161 forks source link

how to generate prompts of custom videos #89

Closed zhuyglx closed 3 weeks ago

zhuyglx commented 1 month ago

Hello, thanks for your great job and open source. I want to ask if i will finetune model in my own dataset, I only have videos, any good video caption method I can use? thank you very much.

Doubiiu commented 3 weeks ago

We employed the image captioning tool BLIP2 throughout our experiments. Recently, we noticed that VideoChat and VILA were adopted in EasyAnimate for video captioning.

zhuyglx commented 3 weeks ago

We employed the image captioning tool BLIP2 throughout our experiments. Recently, we noticed that VideoChat and VILA were adopted in EasyAnimate for video captioning.

thx very much