search

showlab / MotionDirector

[ECCV 2024 Oral] MotionDirector: Motion Customization of Text-to-Video Diffusion Models.
https://showlab.github.io/MotionDirector/
Apache License 2.0
822 stars 49 forks source link

Ideal number of videos #45

Open agneet42 opened 1 month ago

agneet42 commented 1 month ago

Hi, Thanks for the great work! I was wondering if there is an optimal number of videos while training on multiple videos and a corresponding number of steps, that you found in your experiments. Currently I am training on 50 videos of the same motion for 3000 steps. Is that optimal?

ruizhaocv commented 1 hour ago

Hi. Since our task is a customization task, typically 10 videos are enough. On multiple videos, 0.5~1k training steps are enough. Depending on your own data, you can increase the training steps for more aligned motions, or reduce the steps to avoid overfitting.