search

zju3dv / GVHMR

Code for "GVHMR: World-Grounded Human Motion Recovery via Gravity-View Coordinates", Siggraph Asia 2024
https://zju3dv.github.io/gvhmr
Other
388 stars 25 forks source link

smpl_params_global and camera extrinsic parameters #30

Open tucker666 opened 3 weeks ago

tucker666 commented 3 weeks ago

hi, thank you for your great job. i have two questions (1) smpl body can be projected into the camera view correctly by using "pred_smpl_params_incam"；but i can not project smpl body into the camera view correctly by using "smpl_params_global" and camera extrinsic parameters. is there a way to do that ? (2) i can get two people's "smpl_params_global" by change "track_id" using same video, but how can i make the two person having the correct relative position to each other in Blender. looking forward for your reply.

tucker666 commented 3 weeks ago

您好，想问下： （1）使用smpl_params_global和相机外参，在相机视角下，能否把人投影回视频的正确位置呢？（2）通过更改track_id可以得到同一个静态相机视频里两个人的"smpl_params_global"参数，两个人的相对关系可以得到正确得到么，在blender里两个人初始帧是叠在一块的

zehongs commented 1 week ago

Hi @tucker666, sorry for the late reply! Thanks for these two important questions.

  1. An extra optimization is required to meet your needs. This is because we don't explicitly model the transformation between these two predictions.
  2. The relative relationship is also unconstrained, so an extra optimization is needed.