search

liangxuy / Inter-X

[CVPR 2024] Official implementation of the paper "Towards Versatile Human-Human Interaction Analysis"
https://liangxuy.github.io/inter-x/
Other
128 stars 7 forks source link

about skeleton parameters #7

Open MichaelaQ opened 4 months ago

MichaelaQ commented 4 months ago

Thank you for your amazing dataset！ And I want to know what is the order of joints in the skeleton file, and which 64 joints are involved?

liangxuy commented 4 months ago

The topology of the skeleton can be obtained here.

And the corresponding joint names are:

OPTITRACK_SKEL=[
    'Hips',
    'RightUpLeg','RightLeg','RightFoot','RightToeBase',
    'LeftUpLeg','LeftLeg','LeftFoot','LeftToeBase',
    'Spine','Spine_1',
    'RightShoulder','RightArm','RightForeArm','RightHand',
        'RightHandPinky1','RightHandPinky2','RightHandPinky3','RightHandPinky3_Nub',
        'RightHandRing1','RightHandRing2','RightHandRing3','RightHandRing3_Nub',
        'RightHandMiddle1','RightHandMiddle2','RightHandMiddle3','RightHandMiddle3_Nub',
        'RightHandIndex1','RightHandIndex2','RightHandIndex3','RightHandIndex3_Nub',
        'RightHandThumb1','RightHandThumb2','RightHandThumb3','RightHandThumb3_Nub',
    'LeftShoulder','LeftArm','LeftForeArm','LeftHand',
        'LeftHandPinky1','LeftHandPinky2','LeftHandPinky3','LeftHandPinky3_Nub',
        'LeftHandRing1','LeftHandRing2','LeftHandRing3','LeftHandRing3_Nub',
        'LeftHandMiddle1','LeftHandMiddle2','LeftHandMiddle3','LeftHandMiddle3_Nub',
        'LeftHandIndex1','LeftHandIndex2','LeftHandIndex3','LeftHandIndex3_Nub',
        'LeftHandThumb1','LeftHandThumb2','LeftHandThumb3','LeftHandThumb3_Nub',
    'Neck','Head',
]
MichaelaQ commented 4 months ago

The topology of the skeleton can be obtained here.

And the corresponding joint names are:

OPTITRACK_SKEL=[
    'Hips',
    'RightUpLeg','RightLeg','RightFoot','RightToeBase',
    'LeftUpLeg','LeftLeg','LeftFoot','LeftToeBase',
    'Spine','Spine_1',
    'RightShoulder','RightArm','RightForeArm','RightHand',
        'RightHandPinky1','RightHandPinky2','RightHandPinky3','RightHandPinky3_Nub',
        'RightHandRing1','RightHandRing2','RightHandRing3','RightHandRing3_Nub',
        'RightHandMiddle1','RightHandMiddle2','RightHandMiddle3','RightHandMiddle3_Nub',
        'RightHandIndex1','RightHandIndex2','RightHandIndex3','RightHandIndex3_Nub',
        'RightHandThumb1','RightHandThumb2','RightHandThumb3','RightHandThumb3_Nub',
    'LeftShoulder','LeftArm','LeftForeArm','LeftHand',
        'LeftHandPinky1','LeftHandPinky2','LeftHandPinky3','LeftHandPinky3_Nub',
        'LeftHandRing1','LeftHandRing2','LeftHandRing3','LeftHandRing3_Nub',
        'LeftHandMiddle1','LeftHandMiddle2','LeftHandMiddle3','LeftHandMiddle3_Nub',
        'LeftHandIndex1','LeftHandIndex2','LeftHandIndex3','LeftHandIndex3_Nub',
        'LeftHandThumb1','LeftHandThumb2','LeftHandThumb3','LeftHandThumb3_Nub',
    'Neck','Head',
]

Thank you！

yxKryptonite commented 3 months ago

Hi authors, great work!

It seems that the skeleton structure here is different from SMPLX format. Can you give me a hint how to convert this (or motion data) to SMPLX skeletons?

Thanks!

liangxuy commented 3 months ago

Hi, @yxKryptonite The provided skeleton structure is based on the OptiTrack motion capture system, which is irrelevant with SMPL-X. If you need the SMPL-X skeletons, you can refer to the original code of smplx to convert our provided SMPL-X parameters to the SMPL-X skeletons.

jiaqiAA commented 3 months ago

The dimension of the skeletal data is (T, 64, 3). However, you mentioned there are 61 skeleton names. Could you please clarify what the other 3 skeletal names are?

liangxuy commented 3 months ago

Hi, please refer to here. I guess it is because that 'RightToeBase_Nub', 'LeftToeBase_Nub' and 'Head_Nub' are ignored.

OPTITRACK_SKEL=[
    'Hips',
    'RightUpLeg','RightLeg','RightFoot','RightToeBase',# 'RightToeBase_Nub',
    'LeftUpLeg','LeftLeg','LeftFoot','LeftToeBase',# 'LeftToeBase_Nub',
    'Spine','Spine_1',
    'RightShoulder','RightArm','RightForeArm','RightHand',
        'RightHandPinky1','RightHandPinky2','RightHandPinky3','RightHandPinky3_Nub',
        'RightHandRing1','RightHandRing2','RightHandRing3','RightHandRing3_Nub',
        'RightHandMiddle1','RightHandMiddle2','RightHandMiddle3','RightHandMiddle3_Nub',
        'RightHandIndex1','RightHandIndex2','RightHandIndex3','RightHandIndex3_Nub',
        'RightHandThumb1','RightHandThumb2','RightHandThumb3','RightHandThumb3_Nub',
    'LeftShoulder','LeftArm','LeftForeArm','LeftHand',
        'LeftHandPinky1','LeftHandPinky2','LeftHandPinky3','LeftHandPinky3_Nub',
        'LeftHandRing1','LeftHandRing2','LeftHandRing3','LeftHandRing3_Nub',
        'LeftHandMiddle1','LeftHandMiddle2','LeftHandMiddle3','LeftHandMiddle3_Nub',
        'LeftHandIndex1','LeftHandIndex2','LeftHandIndex3','LeftHandIndex3_Nub',
        'LeftHandThumb1','LeftHandThumb2','LeftHandThumb3','LeftHandThumb3_Nub',
    'Neck','Head',# 'Head_Nub'
] # 64 , 61 used,xxx_Nub is ignored hand_Nub can not be ignored