How to makes face animation with specified image

[liuyingbin123]

@theEricMa @87003697 great job，but how to make animate from a single image

[liuyingbin123]

how to compute the condition param

[87003697]

Hello, and thank you for your interest! To animate from a single image, you'll need to follow several steps:

• Background Removal: The EG3D model we've implemented isn't capable of differentiating foreground from background. Therefore, for successful portrait reconstruction and animation, we suggest using a ready-made matting model to remove the background.
• Camera Pose Reconstruction: Use optimization-based methods to accurately reconstruct the head's six degrees of freedom (6DoF).
• GAN Inversion: Apply our proposed test-stage decoupling-by-inverting algorithm to invert the image into a motion-free identity code.

Once these steps are completed, you can proceed with the animation.

[87003697]

The computation of the condition parameter is associated with both extrinsic and intrinsic factors. The extrinsic factors are tied to the six degrees of freedom (6DoF), while the intrinsic factors are experimental hyperparameters that we've found to be practical through our testing. You can find the part of it in our released code. The rest of it is in the preprocessing script. We anticipate it to be release in August. Sorry for the late release!

[freefrog1986]

Looking forward to the condition parameter code！