search

google-ai-edge / mediapipe

Cross-platform, customizable ML solutions for live and streaming media.
https://ai.google.dev/edge/mediapipe
Apache License 2.0
26.83k stars 5.09k forks source link

Side Profile Issue #4773

Open aylinSyntonym opened 1 year ago

aylinSyntonym commented 1 year ago

MediaPipe Solution (you are using)

Face Lanmarks

Programming language

Python

Are you willing to contribute it

Yes

Describe the feature and the current behaviour/state

When faces turn to their side profiles, deviations occur in landmark estimation. For this reason, unfortunately, the masks produced in use cases such as AR provide a bad user experience because they cannot fit properly on the face.

Will this change the current API? How?

No response

Who will benefit with this feature?

No response

Please specify the use cases for this feature

The masks produced in use cases such as AR provide a bad user experience because they cannot fit properly on the face.

Any Other info

No response

Bersaelor commented 11 months ago

Could this be a duplicate of the issue https://github.com/google/mediapipe/issues/4759 I raised a little earlier?

My ticket is about the facialTransformationMatrixes for the landmarks being off when the face is not centered in the view.

I also don't think either one of these issues is programming language (python vs JS) dependent, rather it looks like generally there is a bug in the algorithm for estimating the face-pose.