search

MyNiuuu / MOFA-Video

Official Pytorch implementation for MOFA-Video: Controllable Image Animation via Generative Motion Field Adaptions in Frozen Image-to-Video Diffusion Model.
https://myniuuu.github.io/MOFA_Video
Other
358 stars 22 forks source link

I tested my own image according to the case, the character does not speak, this is why (I added the character's mask) #4

Closed zhanghongyong123456 closed 3 days ago

zhanghongyong123456 commented 3 weeks ago

image

zhanghongyong123456 commented 3 weeks ago

image

sorry, I seem to lack the key point driver. When will the demonstration of other functions be released

MyNiuuu commented 3 weeks ago

Currently we have only released the demo based on pure trajectory. As soon as we complete the preparation of the relevant codes, we will release the other functionalities. Thank you for your attention!

MyNiuuu commented 1 week ago

Currently we have only released the demo based on pure trajectory. As soon as we complete the preparation of the relevant codes, we will release the other functionalities. Thank you for your attention!

Hi! It's been a while, but we have released the Gradio demo for hybrid control here. Feel free to have a try!

uiyo commented 5 days ago

Same issue, still cannot talk with newest code, any solution?

Currently we have only released the demo based on pure trajectory. As soon as we complete the preparation of the relevant codes, we will release the other functionalities. Thank you for your attention!

Hi! It's been a while, but we have released the Gradio demo for hybrid control here. Feel free to have a try!

hint output viz_ldmk

MyNiuuu commented 5 days ago

@uiyo Hi! From the color of the mask, it seems that you are using the motion brush instead of the landmark mask. The motion brush, which is purple, is used to determine the control area for trajectory, while the landmark mask, which is blue, is used to determine the control area of landmarks.

You can refer to the instructions on the Gradio interface for more details.

Feel free contact me if you have other issues!

uiyo commented 4 days ago

@uiyo Hi! From the color of the mask, it seems that you are using the motion brush instead of the landmark mask. The motion brush, which is purple, is used to determine the control area for trajectory, while the landmark mask, which is blue, is used to determine the control area of landmarks.

You can refer to the instructions on the Gradio interface for more details.

Feel free contact me if you have other issues!

It works now, thx!