Xinyu-Yi / TransPose

A real-time motion capture system that estimates poses and global translations using only 6 inertial measurement units
https://xinyu-yi.github.io/TransPose/
GNU General Public License v3.0
373 stars 72 forks source link

Different IMU Set for training and demo #37

Closed VimalMollyn closed 11 months ago

VimalMollyn commented 1 year ago

Hi, I noticed that in the preprocessing script the IMUs used from DIP-IMU are the [left elbow, right elbow, left knee, right knee, head, root] / [7, 8, 11, 12, 0, 2]. Similarly, the locations of the virtual IMUs for AMASS are [left elbow, right elbow, left knee, right knee, head, root] / [18, 19, 4, 5, 15, 0].

However, in the paper and in the demo videos, the IMUs are placed on the left and right wrists, not the left and right elbows as in the training. Am I missing something?

Xinyu-Yi commented 1 year ago

Hi. In live demos, we place the IMUs on the fore arms near the wrists. It means that the imus measure the orientation of the fore arm bone. When synthesizing IMU data for the public datasets, the orientation of the fore arm is exactly the rotation of the elbow. Regarding to the acceleration, we do not use these joint positions, and instead, we use the vertex position which is near the wrist.