search

showlab / MotionDirector

[ECCV 2024 Oral] MotionDirector: Motion Customization of Text-to-Video Diffusion Models.
https://showlab.github.io/MotionDirector/
Apache License 2.0
850 stars 54 forks source link

The code for directly finetune the foundation model #14

Closed bin123apple closed 11 months ago

bin123apple commented 11 months ago

Hey, thanks for your great work! And I hope your paper can be accepted by ICLR. I am a new guy in this area, and still trying to learn the diffusion model. I wonder if you have the code for directly finetuning the foundation model instead of customizing it? I am trying to use different motions instead of one to directly finetune it... if not, can it be achieved by modifying some code instead your _MotionDirectortrain.py file? Thanks a lot for any help!

ruizhaocv commented 11 months ago

Hi. Thanks! Our code can be adapted to directly fine-tuning the foundation model. But I think it is more straightforward for you to use this awesome repo: https://github.com/ExponentialML/Text-To-Video-Finetuning.

bin123apple commented 11 months ago

Thanks！

On Wed, Dec 13, 2023 at 11:49 PM Rui Zhao @.***> wrote:

Hi. Thanks! Our code can be adapted to directly fine-tuning the foundation model. But I think it is more straightforward for you to use this awesome repo: https://github.com/ExponentialML/Text-To-Video-Finetuning.

— Reply to this email directly, view it on GitHub https://github.com/showlab/MotionDirector/issues/14#issuecomment-1855124165, or unsubscribe https://github.com/notifications/unsubscribe-auth/AX2L2BYPHW4BHIK6GB25ZG3YJKANNAVCNFSM6AAAAABAUEXTOWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQNJVGEZDIMJWGU . You are receiving this because you authored the thread.Message ID: @.***>