Stability-AI / generative-models

Generative Models by Stability AI
MIT License
24.21k stars 2.7k forks source link

how to compute motion_bucket_id of a specific video #354

Open lixirui142 opened 5 months ago

lixirui142 commented 5 months ago

Hi, I am trying to tune Stable Video Diffusion, and I need to assign motion_bucket_id to each training video. Is there a script to compute the motion_bucket_id value of a video? I found it may relate to the video average optical flow norm and fps. However, it is ambiguous without a specific converting method.