Different IMU Set for training and demo

[VimalMollyn]

Hi, I noticed that in the preprocessing script the IMUs used from DIP-IMU are the [left elbow, right elbow, left knee, right knee, head, root] / [7, 8, 11, 12, 0, 2]. Similarly, the locations of the virtual IMUs for AMASS are [left elbow, right elbow, left knee, right knee, head, root] / [18, 19, 4, 5, 15, 0].

However, in the paper and in the demo videos, the IMUs are placed on the left and right wrists, not the left and right elbows as in the training. Am I missing something?

[Xinyu-Yi]

Hi. In live demos, we place the IMUs on the fore arms near the wrists. It means that the imus measure the orientation of the fore arm bone. When synthesizing IMU data for the public datasets, the orientation of the fore arm is exactly the rotation of the elbow. Regarding to the acceleration, we do not use these joint positions, and instead, we use the vertex position which is near the wrist.

[bryanbocao]

Hi @VimalMollyn @Xinyu-Yi, can you help me find which indices correspond to which joints? I searched the code and paper but did not find them. It would be great to point me the reference if I missed that. Thanks!

Update Y2024M10D16Wed Full list:

0. pelvis(root)

1. lhip

2. rhip

3. spine1

4. lknee

5. rknee

6. spine2

7. lankle

8. rankle

9. spine3

10. lfoot

11. rfoot

12. neck(lower neck)

13. lclavicle

14. rclavicle

15. head(upper neck)

16. lshoulder

17. rshoulder

18. lelbow

19. relbow

20. lwirst

21. rwrist

22. lhand

23. rhand https://github.com/Xinyu-Yi/TransPose/issues/69