zappar-xr / universal-ar-unity

58 stars 13 forks source link

Blendshapes #26

Closed Dalla-Inceptive closed 10 months ago

Dalla-Inceptive commented 11 months ago

Greetings I'm developing a face filter using Zappar SDK in order to develop it I need to get the values of the expressions (they have to be 52 blend shapes)
So when I get them I apply them to my Avatar How to do that since you only provide 29 expression value ? Thanks

nfynt-zap commented 11 months ago

Greeting @Dalla-Inceptive I am afraid there's no support for Blendshapes on the SDK side. Even the 29 expression coefficients are updated w.r.t. default face mesh model, so I doubt that it can be used with any random mesh reliably. However feel free to experiment on your end. Further regarding face filter, I reckon you should be able to swap the material of default face mesh, and for any other embellishment make use of the Face Landmark for placement. Hope that helps.