IDEA-Research / OSX

[CVPR 2023] Official implementation of the paper "One-Stage 3D Whole-Body Mesh Recovery with Component Aware Transformer"
https://osx-ubody.github.io/
MIT License
622 stars 54 forks source link

Question about Ubody dataset and Its customizing method #126

Open chojinie opened 4 months ago

chojinie commented 4 months ago

Hi @linjing7 , I'm Jin.

I'm currently exploring the UBody dataset, and it seems that while the 2D data only covers the upper body, the 3D SMPL-X annotations provide values for the entire body. Is it possible to obtain 3D SMPL-X annotations that focus solely on the upper body? Could you share any ideas on how to achieve this?

Sincerely,

linjing7 commented 4 months ago

Hi, you can choose the upper-body indexes following the SMPL-X skeleton. And then you can use the rotation of these joints to obtain the upper-body pose. image

chojinie commented 4 months ago

@linjing7 Thanks. As far as I know, when keypoint's axis-angle(e.g index 0 : pelvis = root_pose,1 index 2 : right hip =body_pose) given the situation, it pass the smplx layer with shape, trans etc.. and then it will be 3d smplx annotation. Does it right?

If i understand correctly, Can i make the half body 3d smplx annotation with upper process?

And Did your expression 'rotation of these joints' mean that pose after rot6d_to_axis_angle(pose)?

Sincerely,

linjing7 commented 4 months ago

Hi, I'm not sure what you want for the half-body 3D smplx annotation. Do you mean getting the smplx parameter corresponding to the upper-body joints? If so, you can get them by indexing the parameters corresponding to these joints.

chojinie commented 4 months ago

Hi, I try to make 'half body annotation.json' with upper-body joints. From this, I wanna train(or finetune) OSX model and evaluate full body annotation.

As far as I know, the annotation given in the ubody dataset seems to have values ​​for all vertices of the entire body.

how can i choose upper body vertex?

linjing7 commented 4 months ago

Hi, I think you can index the upper-body vertex based on the vertices segmentation label. You can refer to this instruction.