head jittering for Face landmark detection

[Ehsanwww]

Have I written custom code (as opposed to using a stock example script provided in MediaPipe)

No

OS Platform and Distribution

Windows 10

MediaPipe Tasks SDK version

0.10.9

Task name (e.g. Image classification, Gesture recognition etc.)

Vision task - Face landmark detection

Programming Language and version (e.g. C++, Python, Java)

gdscript

Describe the actual behavior

Hello MEDIAPIPE developers!, thanks for great asset; I am using MEDIAPIPE facial tracking in game engine, map blendshapes and neck movement to 3d avatar; something that i noticed is trembling of head when my head is steady and stable. how can improve that? is that problem because of AI- models or something else ? I use latest version of MEDIAPIPE which is 0.10.9. i use this model: https://developers.google.com/mediapipe/solutions/vision/face_landmarker

Describe the expected behaviour

no jittering

Standalone code/steps you may have used to try to get what you need

1.
import mediapipe in godot 4 
2.
use vision task Face landmark detection 
3.
map landmark to neck of avatar

Other info / Complete Logs

[kuaashish]

Hi @Ehsanwww,

Can you give us the full code example you are using? Confirm if it's an official example from our documentation. Additionally, sharing reference images or videos of the high jitter you are seeing would help us better understand the issue and address it internally.

Thank you

[Ehsanwww]

Thanks for answer, issue was about my logic; i decreased precision of weight of output blendshape and joint to 3 precision and that was a problem; i reset it to default precision and result got better.

[wang-xiaochong]

Thanks for answer, issue was about my logic; i decreased precision of weight of output blendshape and joint to 3 precision and that was a problem; i reset it to default precision and result got better.

Where are the weights adjusted, by adjusting mediapipe parameters?

[Ehsanwww]

@xiaoshuai-tw , mediapipe give floating point by itself, I manually changed precision of that floating point (decreasing precision)

[GeorgeS2019]

@Ehsanwww

We just reach C# wrappers of Godot 4 Mediapipe

We will try upgrading to v 0.10.11

[GeorgeS2019]

We also use Facial landmarks