search

Garfield-kh / PoseTriplet

[CVPR 2022] PoseTriplet: Co-evolving 3D Human Pose Estimation, Imitation, and Hallucination under Self-supervision (Oral)
MIT License
307 stars 25 forks source link

about physical optimization #35

Open Dong09 opened 8 months ago

Dong09 commented 8 months ago

hello,thank you for your work first. I'm new to this. i got itr6000 pkl directly using helix5 training commands in the script , and i'm wondering how i can physically optimize my own wild video. i would appreciate your reply.

Garfield-kh commented 6 months ago

Hi, thank you for the interet. The way to apply physical optimization is: Step 1: Do pose estimation by using the estimator. Step 2: Convert the estimated pose from wpos (world 3D position) to qpos (axis-angle) Step 3: Using the imitator to fit the qpos. Once the imiator loss is low, you have done the potimization.