HumanAIGC / AnimateAnyone

Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animation
Apache License 2.0
14.23k stars 952 forks source link

Everybody, ByteDance announced a method for animating person by one pic #21

Open shaune0000 opened 8 months ago

shaune0000 commented 8 months ago

https://github.com/magic-research/magic-animate

pkuliyi2015 commented 8 months ago

It seems to be much worse than their demo?

silnt-awaken commented 8 months ago

It seems to be much worse than their demo?

Right it looks glitchy. This one is still superior. Need demo asap tho

continue-revolution commented 8 months ago

I’ve looked into this repo with other devs. It is very hard to support - CN reference only need a large refactor; and the performance is bad for anime, the VRAM consumption might be twice as this work. Not sure if it is worth supporting.

yhyu13 commented 8 months ago

I’ve looked into this repo with other devs. It is very hard to support - CN reference only need a large refactor; and the performance is bad for anime, the VRAM consumption might be twice as this work. Not sure if it is worth supporting.

Yep, also notice it use dense pose which do not have face & hand anchor points. This causes very obvious motion artificat for heads and fingers in motion. Which looks not optimal on my local test compare to what this work claims.

PS: Magic animate cost about 8GB VRAM at peak for fp16 inferencing on my local rig