search

metaiintw / build-an-avatar-with-ASR-TTS-Transformer-Omniverse-Audio2Face

195 stars 60 forks source link

facial animation #1

Open kenchikuliu opened 2 years ago

kenchikuliu commented 2 years ago

The facial blendshape is 52 which is equal to APPLE？

metaiintw commented 2 years ago

Unfortunately the answer is no. The Audio2Face team from NVIDIA find the 46 shapes optimal for the blendshape solver. But you should be able to rename and map to ARKit very easily. Just some of the 6 shapes shapes from ARKit would not be animated. but is by design for the solver to give maximum performance. as some shapes are smaller they don't do as well included to the A2F to Blendshape conversion process.