OpenPTrack / open_ptrack_v2

OPT v2 "Gnocchi" - adding object tracking and pose recognition
BSD 3-Clause "New" or "Revised" License
220 stars 65 forks source link

OpenPTrack skeleton joints model #113

Closed mnemllr closed 4 years ago

mnemllr commented 4 years ago

Hello,

The 15 body joints of the pose annotation data look like this:

{ ... "joints": { "model":"rtpose_MPI", "HEAD" "NECK" "RSHOULDER" "RELBOW" "RWRIST" "LSHOULDER" "LELBOW" "LWRIST" "RHIP" "RKNEE" "RANKLE" "LHIP" "LKNEE" "LANKLE" "CHEST"}

  1. Why the OPT skeleton has not 17 joints like the OpenPose skeleton (eyes, ears)?

  2. Can I change the skeleton model in OPT?

  3. Where is the exact position of the HEAD joint? Middle, front top of the head? Is there a picture of the OPT skeleton model?

  4. I saw OpenPose Finger Tracking, thats not possible with OPT right?

Thanks you in advance :)

mnemllr commented 4 years ago

Not any hints? I mean where is, e.g., the joint CHEST located? The OpenPose COCO or BODY_25 skeleton knows only HEAD and NECK, no CHEST.

image

bsubbaraman commented 4 years ago
  1. We're using an older version of OpenPose, rtpose and by default we use with the MPI model which uses 15 joints for faster performance. Updating to the new OpenPose is on our radar (#48).

  2. You should be able to change to the COCO model which uses the 17 joints you mention by editing the skeleton detection launch file... but now that you mention it, I took a look and it seems to still use the MPI model even when coco is enabled. In any case, I'd start with these files if you want to get the 17 joint model working.

  3. Qualitatively, the 15 joints are positioned like this: image

So the chest is joint 14. Empirically, the head joint is approximately at the center of the head.

  1. Hand/finger tracking isn't possible with OPT as of now (see #42) and won't be possible until we update to the newer OpenPose.

I hope this helps, let me know if there are any more questions/clarifications about this!



mnemllr commented 4 years ago

Thank you very much, helps me a lot!

bsubbaraman commented 4 years ago

Great! Closing the issue.