search

IDEA-Research / Motion-X

[NeurIPS 2023] Official implementation of the paper "Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Dataset"
https://motion-x-dataset.github.io
Other
566 stars 15 forks source link

No finger motion in the dataset #76

Open sohananisetty opened 7 months ago

sohananisetty commented 7 months ago

The paper claimed to have finger level motion in the dataset but on rendering the humanml and idea400 datasets there are no finger movements. This can be seen in your DeepDataSpace repo as well. For example in your paper, you showed that you had finger level motion in the piano playing motion (humanml/008422) but there is only wrist movement. Similarly for idea400/subset_0056/Walking_And_Snapping_At_The_Same_Time there is no snapping motion and the hand stays in the the same position throughout. Another example is humanml/006820 (a person appears to be warming up their shoulders and arms, then scans the horizon and sees something while pointing to it) there is no pointing motion of the fingers. The index finger should be extended, but again the hand is in the default pose throughout.

Idea400 example:

https://github.com/IDEA-Research/Motion-X/assets/113209814/984ef33c-eab0-4a75-ad2a-a20caa58b5c1

humanml/006820 006820

linjing7 commented 7 months ago

Hi, the motions of HumanML3D come from AMASS, which do not have hand movements. We only perform facial expression augmentation for them. As for IDEA400, some of the motions are over-smoothed and thus do not have significant hand finger movements. We will provide an improved version of IDEA400 this week.