What is the last 468 float4 in the RefinedFaceVertexBuffer Data?

keijiro / FaceMeshBarracuda

Lightweight facial capture package for Unity

Apache License 2.0

480 stars 89 forks source link

What is the last 468 float4 in the RefinedFaceVertexBuffer Data? #27

Closed newyellow closed 4 months ago

newyellow commented 4 months ago

Hi keijiro,

Thank you for the amazing tool! Today I try to grab the faceLandmarks data in the FacePipeline from c# script, and it works well.

And inside the _pipeline.RefinedFaceVertexBuffer, there are total 936 float4, which the first 468 are faceLandmarks for the faceMesh, and there are another 468 float4 I couldn't figure out what they are.

face

They seems to have a face shape, but only have values when I move. Are they something like motion vectors?

Just curious, and thank you for the time!

keijiro commented 4 months ago

They're delta values for the low-pass filter. https://github.com/keijiro/FaceMeshBarracuda/blob/cf6199d2b07555d9e4554ed4d4b097b25082f314/Assets/FaceMesh/Shader/Postprocess.compute#L108

newyellow commented 4 months ago

@keijiro thank you for the quick answer!!