search

facebookresearch / pytorch3d

PyTorch3D is FAIR's library of reusable components for deep learning with 3D data
https://pytorch3d.org/
Other
8.7k stars 1.3k forks source link

How could I use PyTorch3D load SMPL model and change the pose? #1681

Closed snowmint closed 10 months ago

snowmint commented 10 months ago

❓ Questions on how to use PyTorch3D

I am currently working on applying my generated 3D coordinate human joint keypoints to the SMPL model with texture. I came across an article about Densepose and applying the SMPL model, which can be found at this link: https://pytorch3d.org/tutorials/render_densepose. However, I am confused about how to adjust the model's pose.

The images below depict my generated keypoints. Currently, when using PyTorch3D, I am only able to achieve the default T-pose. My goal is to pose the PyTorch3D SMPL model to match the desired pose shown in Image 1.

Image 1: Generated body keypoints image

Image 2: I am struggling to figure out how to pose the SMPL model to match the desired pose shown in Image 1. image

Thank you for taking the time to read my question. I appreciate your assistance and welcome any advice you may have. If there is an alternative approach to achieve this, I would greatly appreciate your insights and suggestions.

bottler commented 10 months ago

There's no built-in method in PyTorch3D to do this, you need to work from first principles.