search

LizhenWangT / FaceVerse

FaceVerse: a Fine-grained and Detail-controllable 3D Face Morphable Model from a Hybrid Dataset (CVPR2022)
BSD 2-Clause "Simplified" License
460 stars 57 forks source link

how to mapping the PCA shape components to Apple 51 blendshapes? #2

Open lucasjinreal opened 2 years ago

lucasjinreal commented 2 years ago

Does there any instructions on how to convert?

LizhenWangT commented 2 years ago

I tried to build this conversion. But our model reconstructed from the East Asian faces is quite different with Apple's face model in the nose, eyes, etc. There is still some problems in this conversion. I will continue to try to solve this problem.

lucasjinreal commented 2 years ago

@LizhenWangT that is promising! Are u trying using Apple's standared face model to fit FaceVerse's version? It seems once we have a dividable 52 shapes, and it's semantic meaning, we can mimick apple's behavior.

LizhenWangT commented 2 years ago

Yes, that's just what I want to do. I'm trying to create the 52 FaceVerse shapes which are in the same expression with Apple's standard 52 blendshapes.

lucasjinreal commented 2 years ago

@LizhenWangT I am hoping for your impressive result!

LizhenWangT commented 2 years ago

@jinfagang This has been solved in version 2!

ForrestPi commented 2 years ago

@LizhenWangT Thanks your work， could you provide the related code about converting PCA shape components to Apple 51 blendshapes？

LizhenWangT commented 2 years ago

@LizhenWangT Thanks your work， could you provide the related code about converting PCA shape components to Apple 51 blendshapes？

You can refer to this issue. It's more like a manul job rahter than coding.