search

google-ai-edge / mediapipe

Cross-platform, customizable ML solutions for live and streaming media.
https://ai.google.dev/edge/mediapipe
Apache License 2.0
27.46k stars 5.15k forks source link

BlazePose Full Body Python? #1228

Closed danj96dev closed 3 years ago

danj96dev commented 4 years ago

Is there a way to run the full body version of BlazePose not on mobile. Or to use mlkit without a mobile device? The released version only offers the upper body but I need to run the full body model on a web server.

shabnm commented 4 years ago

Yes, I too faced the same issue, blazepose is for UpperBodyPoseTracker(), and if you want to do full body, you have to use mlkit-pose detection "https://developers.google.com/ml-kit/vision/pose-detection". Mlkit pose detection is made specially to run on android/iOs, but the blazepose upper body can be executed on web.

danj96dev commented 4 years ago

Yes, I too faced the same issue, blazepose is for UpperBodyPoseTracker(), and if you want to do full body, you have to use mlkit-pose detection "https://developers.google.com/ml-kit/vision/pose-detection". Mlkit pose detection is made specially to run on android/iOs, but the blazepose upper body can be executed on web.

I need full body on web, I believe there's a tflite model for the full body that could be run on Python for example but I'm not certain. Is there any other way to run blazenet without a mobile device?

shabnm commented 4 years ago

Yes, I too faced the same issue, blazepose is for UpperBodyPoseTracker(), and if you want to do full body, you have to use mlkit-pose detection "https://developers.google.com/ml-kit/vision/pose-detection". Mlkit pose detection is made specially to run on android/iOs, but the blazepose upper body can be executed on web.

I need full body on web, I believe there's a tflite model for the full body that could be run on Python for example but I'm not certain. Is there any other way to run blazenet without a mobile device?

I used posenet to extract keypoints earlier and ran it on web. I recently started working on ml-kit and blazepose. no luck with them, not yet

PrinceP commented 4 years ago

Use the following repo for the web version for full-body blaze pose

https://github.com/terryky/tfjs_webgl_app/tree/master/blazepose_fullbody

Also, for the python version, we would have to create the runner code for these models

https://github.com/PINTO0309/PINTO_model_zoo/tree/master/058_BlazePose_Full_Keypoints

mgyong commented 4 years ago

MediaPipe v0.8 - Python solutions APIs for Face Mesh, Hands and Upper body pose released! https://github.com/google/mediapipe/releases/tag/0.8.0 Try the colab https://google.github.io/mediapipe/#mediapipe-in-python

PrinceP commented 3 years ago

@ashutoshsoni891 Can you check out the holistic approach also - https://github.com/google/mediapipe/blob/master/docs/solutions/holistic.md