OpenMotionLab / MotionGPT

[NeurIPS 2023] MotionGPT: Human Motion as a Foreign Language, a unified motion-language generation model using LLMs
https://motion-gpt.github.io
MIT License
1.45k stars 92 forks source link

What exactly is raw motion data? #8

Closed smandava98 closed 11 months ago

smandava98 commented 1 year ago

I am reading through the paper but I am confused on what you mean raw motion data. It does not seem to be clarified anywhere. Is this full 3D meshes or joint keypoints or what?

willswordh commented 1 year ago

Same question here

ChenFengYe commented 1 year ago

Hi, raw motion data means the raw 3d motion data, which indicates all joint parameters including rotations and position. These motion data are optimized from the MoCap system, which could still have some jitter and noise. You can refer to this paper for more details on motion data. https://github.com/nghorbani/soma

Sorry for this later reply. We are working on this rebuttal and the code available.

smandava98 commented 1 year ago

Thanks Chen. Is this the same thing as SMPL parameters? I believe that is derived from mocap as well.

On Thu, Aug 10, 2023 at 9:32 AM Chen Xin @.***> wrote:

Hi, raw motion data means the raw 3d motion data, which indicates all joint parameters including rotations and position. These motion data are optimized from the MoCap system, which could still have some jitter and noise. You can refer to this paper for more details on motion data. https://github.com/nghorbani/soma

Sorry for this later reply. We are working on this rebuttal and the code available.

— Reply to this email directly, view it on GitHub https://github.com/OpenMotionLab/MotionGPT/issues/8#issuecomment-1672708367, or unsubscribe https://github.com/notifications/unsubscribe-auth/AFNOJP2CYZXM6UBFEKVLXGTXUSFBNANCNFSM6AAAAAA2HBXLVM . You are receiving this because you authored the thread.Message ID: @.***>

-- Class of 2020

ChenFengYe commented 1 year ago

Yes, it is correct. The pose parameter of SMPL is a kind of motion representation in math, called rotation vector R^{1X3} for every joint. Motion data can be represented as pose parameters or just rotation matrix R^{3X3}. You can just treat them as the same thing.