vchoutas / smplify-x

Expressive Body Capture: 3D Hands, Face, and Body from a Single Image
https://smpl-x.is.tue.mpg.de/
Other
1.69k stars 330 forks source link

How to fit those images without lower body #173

Open huanngzh opened 2 years ago

huanngzh commented 2 years ago

@vchoutas Hi! Thanks for the excellent tool and code!

I am fitting SMPL-X model to images, whose lower body is not visible. If I just apply the original smplify-x on them, the results will be so terrible. After I add keypoints of the lower body and modify joint_weights[:, 8:25] to zero, some of them work well but there are still some images that look bad. Can you give me some advice?

Image output
image image
image image
image image
image image

When I tried to run it, I found that camera initialization final loss is so big, which may be tens of thousands. The camera positions in my images are similar, so can I fix the camera feature? Or other useful modification?