CMU-Perceptual-Computing-Lab / openpose

OpenPose: Real-time multi-person keypoint detection library for body, face, hands, and foot estimation
https://cmu-perceptual-computing-lab.github.io/openpose
Other
31.37k stars 7.88k forks source link

Is it possible to use OpenPose output of x and y coordinates to detect rotating movement? #2160

Open kingofjong opened 1 year ago

kingofjong commented 1 year ago

Issue Summary

I did some research on OpenPose and the output is x and y coordinates with confidence point. x and y coordinates are good for detecting up, down, left, and right movements. I was wondering is it possible to detect turning movements. Turning usually happens on the z axis. Is there a way to tell if body part has rotated 180 degrees with x and y coordinate.

I had few ideas like calculating the slope of the hand line. The slope tells us if the hand is tilted or not. If the slope is high or very low then the hand has rotated. Same concept for all other body parts. But I don't think that will work in all cases.

OpenPose Output (if any)

To review the output of open pose go here https://github.com/CMU-Perceptual-Computing-Lab/openpose/blob/master/doc/02_output.md

Type of Issue

Select the topic(s) on your post, delete the rest:

MathurUtkarsh commented 1 year ago

Issue #2160

It is possible to detect turning movements using x and y coordinates, but it may not be as straightforward as detecting up, down, left, and right movements.

One way to detect turning movements is to calculate the change in angle of a body part over time. This can be done by calculating the slope of a line that connects the x and y coordinates of a body part at different points in time. If the slope changes significantly over time, it is likely that the body part has turned.

Another way to detect turning movements is to track the movement of multiple body parts in relation to each other, such as tracking the movement of the shoulders in relation to the hips. However, this approach may not be reliable in all cases, as the movement of multiple body parts can be affected by other factors such as the presence of other people or objects in the scene.