yufu-wang / tram

TRAM: Global Trajectory and Motion of 3D Humans from in-the-wild Videos
MIT License
234 stars 16 forks source link

Problem:Transfer the final data to bvh file #14

Open ESJIAN opened 3 months ago

ESJIAN commented 3 months ago

HOW TO TRANSFER THE DATA INTO BVH FILE?

ESJIAN commented 3 months ago

I want to transfer the final body posture tensor data matrixand relative angles tensor matrix into a bvh file,but I cant analysis where the data that i want is. I have tried to extract data from object results in vimo_video.py.But only get results like below ![Uploading 屏幕截图 2024-08-05 125851.png…]()

ESJIAN commented 3 months ago

屏幕截图 2024-08-05 125851

yufu-wang commented 3 months ago

The smpl pose results are saved under "results/you_video_name/hps/*.npy". Each person will have one .npy file. To get the global trajectory, you need to combine those with the camera motion similar to here

ESJIAN commented 3 months ago

The smpl pose results are saved under "results/you_video_name/hps/*.npy". Each person will have one .npy file. To get the global trajectory, you need to combine those with the camera motion similar to here

Thank you for your replying ,I wonder pred_pose,pred_cam,pred_shape , pred_rotmat and pred_trans in vivo_track_0.npy means what?

ESJIAN commented 3 months ago

The smpl pose results are saved under "results/you_video_name/hps/*.npy". Each person will have one .npy file. To get the global trajectory, you need to combine those with the camera motion similar to here

image

Because I used the data from j3d.pth as skeleton joint data and it looks normal when i preview in the scatter plot

ESJIAN commented 3 months ago

Here are my projects,I will keep trying https://github.com/ESJIAN/TRAM_DATA_TO_BVH

ESJIAN commented 3 months ago

I have solved that,but I meet new problem .The data in pred_rotmat seems not to be the Euler_angle data of each JOINTS .Where is the right data I am looking for ?I want use it to fit the motion data of bvh file

tppqt commented 2 days ago

I have solved that,but I meet new problem .The data in pred_rotmat seems not to be the Euler_angle data of each JOINTS .Where is the right data I am looking for ?I want use it to fit the motion data of bvh file我已经解决了这个问题,但我遇到了新的问题。pred_rotmat 中的数据似乎不是每个 JOINTS 的Euler_angle数据。我正在寻找的正确数据在哪里 - 我想用它来拟合 bvh 文件的运动数据

Have you solved these issues? I also want to convert files to BVH or FBX, but the characters shake after conversion.