Question about the moiton data optimization pipeline

IDEA-Research / Motion-X

[NeurIPS 2023] Official implementation of the paper "Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Dataset"

https://motion-x-dataset.github.io

Other

566 stars 15 forks source link

Question about the moiton data optimization pipeline #67

Open jihg88 opened 8 months ago

jihg88 commented 8 months ago

Thank you for your outstanding work! Regarding the use of image information to optimize local and global motions, your idea is utilizing 2D reprojection loss combined with initial motion constraints to fine-tune the osx-model so that the model can produce motions that are more consistent with image information? I now need to reproduce this part: using image information to optimize the initial action. I don’t know how to start. Can you give me some suggestions?

linjing7 commented 8 months ago

Hi, thanks for your interest. I think you can start with local pose optimization. We have a more detailed introduction in OSX.