search

dafei-qin / NFR_pytorch

Offical repo of "Neural Face Rigging for Animating and Retargeting Facial Meshes in the Wild"
57 stars 10 forks source link

Testing on a new face mesh #7

Closed seokg closed 9 months ago

seokg commented 9 months ago

Hi.

I am currently encountering some challenges with the generated results. I am working on animating a new face mesh from (VOCASET) and have come across the following outcomes.

Screenshot 2024-01-03 at 6 28 27 PM

The left two face meshes represent the provided mesh, and the right two meshes are from VOCASET. Despite all four meshes having the same Z_facs codes (128 dim latent code), there is noticeable distortion around the mouth in the right two meshes. I have taken the necessary steps to align and standardize the mesh, similar to the provided meshes. Do you have any suggestions on how I can address this behavior? Your insights would be greatly appreciated.

I am also linking the meshes (mesh1, mesh2) that i have used.

seokg commented 9 months ago

I have re-standardize the meshes, and the problem is solved. Seems like the standardization process is critical. Thanks.