search

google-ai-edge / mediapipe

Cross-platform, customizable ML solutions for live and streaming media.
https://ai.google.dev/edge/mediapipe
Apache License 2.0
27.39k stars 5.15k forks source link

MediaPipe Pose Model without GHUM and segmentation? #4429

Open noahcoolboy opened 1 year ago

noahcoolboy commented 1 year ago

Hello. I am currently building a python application which uses the mediapipe pose models for pose estimation. However, I am not using the mediapipe library, but a custom implementation of all the required calculators along with onnxruntime to allow me to use the GPU (which is currently not supported on windows when using the mediapipe python library).

For performance reasons, I would like to remove the 3d pose estimation (world landmarks) and pose segmentation as these are not required in my use case. From what I have seen, these models have at one point existed, but I have not found any download links to those models.

Would it be possible to provide those models? Thank you.

ayushgdev commented 1 year ago

Hello @noahcoolboy That is an interesting request. Would you please let us know where did you find the details on the models that did not include world landmarks? This might help us in searching the model file from storage back in time

noahcoolboy commented 1 year ago

Thank you for your response, @ayushgdev .

The original BlazePose paper does not make any mention of segmentation or 3D pose estimation, so I had figured those were added later on. The 0.8.3.1 release also says the model has 3d coordinates: https://github.com/google/mediapipe/releases/tag/0.8.3.1 V0.8.7 also added the segmentation: https://github.com/google/mediapipe/releases/tag/v0.8.7 While looking for the sites mentioning it, I have found one archive which has the full model, but is missing the lite and heavy ones: https://github.com/PINTO0309/PINTO_model_zoo/tree/main/053_BlazePose/03_pose_landmark_full_body The documentation page also mentions the model is a variation of BlazePose with GHUM added: https://developers.google.com/mediapipe/solutions/vision/pose_landmarker#:~:text=This%20variant%20of%20the%20BlazePose%20model%20uses%20GHUM

kuaashish commented 1 year ago

@noahcoolboy,

Sorry for the delayed response!!

Could you please confirm that you are still looking for resolution Or the issue has been resolved from your end? Thank you!

noahcoolboy commented 1 year ago

No worries! Yes, this is still something I am looking for. I had continued searching but to no avail.