google-ai-edge / mediapipe

Cross-platform, customizable ML solutions for live and streaming media.
https://ai.google.dev/edge/mediapipe
Apache License 2.0
27.46k stars 5.15k forks source link

Ability to fine-tune pose landmark detection model with model maker #5295

Open RoadieHouse opened 7 months ago

RoadieHouse commented 7 months ago

MediaPipe Solution (you are using)

Poser Landmark detection

Programming language

Python

Are you willing to contribute it

Yes

Describe the feature and the current behaviour/state

Currently pose landmark detection cannot be fine-tuned thorugh the model maker compared to other mediapipe solutions

Will this change the current API? How?

No response

Who will benefit with this feature?

Creators using pose estimation for specific use cases instead of generic ones

Please specify the use cases for this feature

Working on a workout app that focuses on calisthenics. There are many movements and unusual poses that mediapipe pose landmark detection does not handle well (e.g. being upside down). Therefore it would be great to have the ability to use the pose landmark model as a great baseline model and fine tune it for this (and other) specific use cases.

Any Other info

No response

kuaashish commented 7 months ago

Hi @RoadieHouse,

Thank you for suggesting the extension of the pose landmark functionality. We are forwarding your request internally, and our team will prioritize its implementation based on discussions and demand. We have noticed multiple requests for this feature, which underscores its importance.

Thank you!!

harhit22 commented 5 months ago

i need it too

arielfikru commented 5 months ago

Still wait for this

qemtek commented 3 months ago

output

Another use-case I would like to finetune as the original model underperforms (but is very promising!)

mcdonasd1212 commented 2 months ago

This would be a useful feature!

xywang01 commented 1 week ago

This feature would be super helpful!