zju3dv / EasyMocap

Make human motion capture easier.
Other
3.58k stars 442 forks source link

How to visualize the smpl reprojection results for mvmp #111

Open Xianjin111 opened 2 years ago

Xianjin111 commented 2 years ago

Thanks for your perfect work. I would like to ask how to visualize the smpl reprojection results for mvmp. The links is failed in the mvmp webpage.

Looking forward to your reply. Thx~

chingswy commented 2 years ago

What do you mean smpl reprojection?

Xianjin111 commented 2 years ago

I would like to visualize the result for https://github.com/zju3dv/EasyMocap/blob/master/doc/mvmp.md to check whether the smpl for multi-person is correct after reprojecting on the input view RGB image.

Xianjin111 commented 2 years ago

I would like to ask after I get the four person 3D keypoints, why I can only fit the smpl for only 2 person as the pictures show: [

截屏2022-01-02 下午7 21 14 截屏2022-01-02 下午7 21 20

](url)

Could you please give me some suggestions to fit 4 person? Thx

chingswy commented 2 years ago

Our code will automatically read all the person in keypoints3d, you can check the loading results at smpl_from_keypoints.

Xianjin111 commented 2 years ago

Our code will automatically read all the person in keypoints3d, you can check the loading results at smpl_from_keypoints.

I checked that there existed missing hand joints in the original reconstruction keypoints3d before reading. How to deal with the problem at smpl_from keypoints if there existed missing reconstruction 3D joints? Thx

Xianjin111 commented 2 years ago

After loading the 3d keypoints for one of the four, the shape parameters are all zeros as shown in the photos. Cloud you please give me some suggestion?

截屏2022-01-03 上午11 32 23 截屏2022-01-03 上午11 32 14
chingswy commented 2 years ago

The code may not optimize shapes, but the poses seems to be right. You should first check whether all the four person are optimized.