search

EricGuo5513 / HumanML3D

HumanML3D: A large and diverse 3d human motion-language dataset.
MIT License
787 stars 78 forks source link

Is it possible to convert just 1 pose (not the full sequence) from AMASS to HumanML3D ? #98

Open mayank64ce opened 1 year ago

mayank64ce commented 12 months ago

What about SMPL to HumanML3D @EricGuo5513 ?

jojo978 commented 11 months ago

I also found this issue. process_file in motion_representation.ipynb gives exceptions for sequences of the length 1. I think that's because it can't calculate the velocity.

mayank64ce commented 11 months ago

Yeah. Idk if I just pad the next frame with zeros, the output will make any sense.

mayank64ce commented 10 months ago

@jojo978 did you find any solution to this ?

EricGuo5513 commented 10 months ago

I think for 1 pose, you can skip the velocity features,

mayank64ce commented 9 months ago

@EricGuo5513 I see. so to get the single pose, will I have to append maybe a dummy second pose so that the sequence is overall of length 2 ? also what are the indices of the velocity entries so I can zero them out ?

EricGuo5513 commented 9 months ago

Hello, these are the meaning of each indices for a HumanML3D feature vector:

Recover global angle and positions for rotation data

root_rot_velocity (B, seq_len, 1)# root_linear_velocity (B, seq_len, 2)# root_y (B, seq_len, 1)# ric_data (B, seq_len, (joint_num - 1)3)# rot_data (B, seq_len, (joint_num - 1)6)# local_velocity (B, seq_len, joint_num*3)# foot contact (B, seq_len, 4)

For a single pose, I guess you could have a dummy pose with z+ face direction, as the first pose. And you are not able to get the foot contact and local velocity. For the other features, they normally only need the global rotation velocity, which in your case is the root rotation of this single pose.

On Wed, 17 Jan 2024 at 11:09, Mayank Kumar @.***> wrote:

@EricGuo5513 https://github.com/EricGuo5513 I see. so to get the single pose, will I have to append maybe a dummy second pose so that the sequence is overall of length 2 ? also what are the indices of the velocity entries so I can zero them out ?

— Reply to this email directly, view it on GitHub https://github.com/EricGuo5513/HumanML3D/issues/98#issuecomment-1896338853, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKRYNB6NMS6FAPRYSAM6XNLYPAHWBAVCNFSM6AAAAAA6CX463CVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOJWGMZTQOBVGM . You are receiving this because you were mentioned.Message ID: @.***>