search

google-ai-edge / mediapipe

Cross-platform, customizable ML solutions for live and streaming media.
https://ai.google.dev/edge/mediapipe
Apache License 2.0
26.81k stars 5.09k forks source link

Is there a repository that shows the 3D pose that already exists? #2274

Closed connernam closed 3 years ago

connernam commented 3 years ago

I want to implement 3D Pose on Python like Fig 5 on https://google.github.io/mediapipe/solutions/pose.

However, I would like to refer to a demo that has already been implemented. Please let me know if you have a repository or reference that can help.

chuoling commented 3 years ago

The MediaPipe Python Colab (https://colab.research.google.com/drive/1uCuA6We9T5r0WljspEHWPHXCT_2bMKUy) has an example that generates and visualizes world 3D pose landmarks.

connernam commented 3 years ago

@chuoling Thank you for your reply. Colab's demo seems to cover only a single image. What I want is 3d posture estimation in real time (on webcam).

chuoling commented 3 years ago

Have you tried using the code snippet in https://google.github.io/mediapipe/solutions/pose.html#python-solution-api under # For webcam input, and add the following for visualization the world 3D pose landmarks (like in the Colab with static images)?

mp_drawing.plot_landmarks(
        results.pose_world_landmarks, mp_pose.POSE_CONNECTIONS)
connernam commented 3 years ago

Yes, I tried the code snippet.

The result is shown as a simple image plotted as shown below. image I want to implement a 3D plotter that moves the same as the input image in Python in real time like Fig 5. image

Similar implementation examples can be seen in WebDemo, but no implementation examples or APIs can be found using Python.

If there were no examples and APIs, it would have to be implemented on its own, but if there were, it would have been easier to develop.

Rassibassi commented 3 years ago

Not exactly as in the picture, but check out my mediapipe demo repository. Almost all the solutions as python real-time applications applied on the webcam video signal.

https://github.com/Rassibassi/mediapipeDemos

connernam commented 3 years ago

@Rassibassi I will check your repo. Thank you for your reply.

sn1c3 commented 3 years ago

@Rassibassi, your repo has some useful scripts, but a solution to the initial question is not provided, or am I missing something?

@connernam did you find something? I used for my visualizations ipyvolume. It works quite good, but the repo is not maintained very actively.