search

vchoutas / smplify-x

Expressive Body Capture: 3D Hands, Face, and Body from a Single Image
https://smpl-x.is.tue.mpg.de/
Other
1.77k stars 340 forks source link

Daz 3d model support #79

Closed yanhn closed 4 years ago

yanhn commented 4 years ago

Does this method support daz 3d model's bones and joints? Any suggestion would be appreciated.

dimtzionas commented 4 years ago

SMPLify(-X) is tailored to the SMPL(-X) model. As a first step, we would suggest using the method as it is.

Then, for the next step, you need to take into account that the SMPL(-X) model and any 3rd party model have a different topology (bones, joints, etc). In principle, you will need to come up with a mapping from the SMPL(-X) model configuration to the DAZ model that you use.

Unfortunately supporting such mappings for 3rd party models exceeds our capacity, but this is the general direction that you will need to follow :)

kartikJ-9 commented 4 years ago

So, this applies to the Densepose model also right? Currently, smplify-x takes openpose json as input. Is there any method involving Densepose IUV images as input and getting the .obj by smplify-x?

SMPLify(-X) is tailored to the SMPL(-X) model. As a first step, we would suggest using the method as it is.

Then, for the next step, you need to take into account that the SMPL(-X) model and any 3rd party model have a different topology (bones, joints, etc). In principle, you will need to come up with a mapping from the SMPL(-X) model configuration to the DAZ model that you use.

Unfortunately supporting such mappings for 3rd party models exceeds our capacity, but this is the general direction that you will need to follow :)

vchoutas commented 4 years ago

@kartikJ-9 You cannot use DensePose IUV data with SMPL-X, since they refer to correspondences on the SMPL model.