Excuse me, what does the output folder animation_output-->meshes means?

TimoBolkart / voca

This codebase demonstrates how to synthesize realistic 3D character animations given an arbitrary speech signal and a static character mesh.

https://voca.is.tue.mpg.de/en

1.15k stars 273 forks source link

Excuse me, what does the output folder animation_output-->meshes means? #83

Closed airfri closed 3 years ago

airfri commented 3 years ago

I saw that in the output file, in addition to the video of a talking head, there are also many .obj files, which are composed of three columns of data, and there are signs of 'v' or 'f'. I guess each obj file is for a feature point of a human face, the three columns are the three-dimensional coordinates of the feature point. Does that mean? I want to map the output mesh data to the blendshapes of the human face Morph so that it can be applied to unity or UE4. I don't know if this is feasible.

TimoBolkart commented 3 years ago

Each of the .obj files contains the 3D face mesh with vertices v and faces f for one frame. You can visualize these meshes for instance with MeshLab or Blender.

If you run the script compute_FLAME_params.py, you get the parameters of the FLAME head model. To date, we do not provide any conversion to other blendshape models.