XiaokunSun / SemanticHuman

[CVPR 2023] Official repo of "Learning Semantic-Aware Disentangled Representation for Flexible 3D Human Body Editing“
https://cic.tju.edu.cn/faculty/likun/projects/SemanticHuman/index.html
Other
30 stars 1 forks source link

How to learn the joints linear regressor J(·) for your self-defined joints of body? #4

Closed luwang03 closed 1 year ago

luwang03 commented 1 year ago

How to learn the joints linear regressor J(·) for your self-defined joints of body? For your defined additional joints for feet, hands, and faces, how to learn the joints linear regressor J(·) ?

image

XiaokunSun commented 1 year ago

We visualize the human body mesh in meshlab, and manually select landmark points, and then take the mean of these points as the final joint point position.

luwang03 commented 1 year ago

Ok, thanks for your reply! From your reply, the process of my understanding is that: 1) we can visualize template body mesh in meshlab and manually select landmark points on template body mesh; 2) next, for other body mesh, we can use the indexes of selected landmark in 1) to obtain the crrosponding landmark points and take the mean of these points as the final joint point position; 3) for all body joint points data, we can train a joints linear regressor J(·). Is this understanding is right?

XiaokunSun commented 1 year ago

There is no need for the third step, because the joint regressor is essentially a matrix. With the index of the landmark point, we can build the joint regressor. For example, the landmark point index of the 33rd joint point is [1000, 1001, 1002, 1003 ,1004], then you only need to change the corresponding value of the matrix to 1/5.

luwang03 commented 1 year ago

That is great! Thanks for your reply!