search

sha2nkt / moyo_toolkit

This is a repository for download, preprocessing, visualizing, running evaluations on the MOYO dataset.
Other
71 stars 4 forks source link

image index and mosh index are not aligned #5

Closed YongtaoGe closed 11 months ago

YongtaoGe commented 11 months ago

Hi, @sha2nkt How can I get the corresponding image index from the mosh npz file?

I use the 'img_frame = (mosh_frame // 2) + frame_offset' to get img_frame id, and set frame_offset=1.

However, I found some mosh files are not aligned well with the image.

For example, 

yogi_body_hands_03596_Boat_Pose_or_Paripurna_Navasana_-e_YOGI_Cam_05_0061.jpg

49_train220923_yogi_body_hands_03596_Boat_Pose_or_Paripurna_Navasana_-e_YOGI_Cam_05_0061

By the way, I do not understand the meaning of the selected frames in this file. I wonder if you make it a bit more clear.

https://github.com/sha2nkt/moyo_toolkit/blob/3ad37fbb00fe23deca39395479a159269b107e0e/moyo/utils/constants.py

sha2nkt commented 11 months ago

Hi, If you follow the pressure evaluation script, we save the image frame here and the corresponding smplx fit here. Is this what you are doing as well?

Due to synchronization errors, the image frame might be off by a single frame compared to the pose parameters but it shouldn't be noticeably different.

The selected_frames are just the frames where the person is actually in the Yoga pose. These were manually determined.