search

rongakowang / DeepSimHO

[NeurIPS 2023] DeepSimHO: Stable Pose Estimation for Hand-Object Interaction via Physics Simulation
21 stars 4 forks source link

Gravity Direction #2

Closed zhoujun-7 closed 11 months ago

zhoujun-7 commented 11 months ago

Hi Wang,

Thanks for your sharing codes. The "hand_verts" and "obj_verts" are in camera coordinate, which are directly fed to MuJoCo for physical simulation. Is the gravity in MuJoCo aligned with real world? And what is the direction of MuJoCo gravity?

Looking forward to your reply.

Best, Jun

rongakowang commented 11 months ago

Hi Jun:

We made the assumption that the world gravity roughly aligns with the camera coordinate (y axis in the image space) and MuJoCo environment is set to reflect this. You can visualize the xml model in MuJoCo for a better understanding.

zhoujun-7 commented 11 months ago

Thanks for your answer.