guoyww / AnimateDiff

Official implementation of AnimateDiff.
https://animatediff.github.io
Apache License 2.0
10.47k stars 863 forks source link

MotionLoRA training #334

Open XuankeShi opened 6 months ago

XuankeShi commented 6 months ago

Could you please tell me what order of magnitude data was used for the training of motion lora? The released motion lora model is trained using 20-50 videos? What kind of motion is suitable for motion module lora training?

XuankeShi commented 6 months ago

I reproduced the motion module lora training code, but the conclusion I reached was completely different from the paper. Could u reply me?

XuankeShi commented 6 months ago

i've done the same experiment. it needs more than 5k videos data to learn the simple motion pattern for the MotionLora training.

OliverLeeXZ commented 3 months ago

Some question! Could you tell me how to train motionlora?

XuankeShi commented 3 months ago

Some question! Could you tell me how to train motionlora? 这个需要修改代码. 根据不同的diffusers 版本有不同的改法, 感兴趣我可以提供带motion lora版本的代码, 但是是有偿服务