ali-vilab / UniAnimate

Code for Paper "UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animation".
https://unianimate.github.io/
700 stars 48 forks source link

Problem about long video generation with first frame condition #50

Open jby1993 opened 1 month ago

jby1993 commented 1 month ago

I try to generate a satisfactory video segment first, and then input the last frame of this segment into the model to generate the next segment to continue the long video generation. I found this strategy can produce more consistent video. However, some color deviation can happen. For example, The hands may become very dark in color. Is this normal or am I doing something wrong?

ak01user commented 1 month ago

hi,can you show your results?maybe it was a question of preprocessing.

jby1993 commented 1 month ago

https://github.com/ali-vilab/UniAnimate/assets/14065422/0265b9c6-33f2-4b44-a710-6978566c32f6

Hi, this example shows that the hands' color can be dark, but other regions are normal.