search

NVlabs / CALM

Other
528 stars 57 forks source link

Poselib: CMU MoCap dataset #15

Closed chenyunzhanggit closed 1 month ago

chenyunzhanggit commented 1 month ago

Thank you for everything you do!

When I try to replac fbx dataset(like 01_01_cmu.fbx, 07_01_cmu.fbx) I downloaded from other resources, the coordinate axes in the visualization interface became incorrect, and the movement was along the z direction.

With 01_01_cmu.fbx you provided: image

With 01_01.fbx I downloaded from other resources: 01_01

Can you share the way you process the original data? Or can you share the correct dataset?

Thanks!

tesslerc commented 1 month ago

By default the SMPL motions are with Y-up. In Isaac we typically use Z-up. To account for that, we rotate the motions.

See example in PHC: https://github.com/ZhengyiLuo/PHC/blob/6db1db1830b513f670525a2046d28fe51d0e77d2/scripts/data_process/convert_amass_isaac.py#L111

chenyunzhanggit commented 1 month ago

Alright, let me give it a shot. Thank you so much!

tesslerc commented 1 month ago

I forgot to mention. The original dataset is in https://github.com/nv-tlabs/ASE/tree/main/ase/data/motions/reallusion_sword_shield We used the AMP humanoid in both works, it has a reduced DoF compared to SMPL. The AMASS dataset is SMPL so if you want to use the amass dataset, you'll also have to retarget the motion to the AMP humanoid for it to work.

Alternatively, you can swap to the SMPL humanoid. There's an example in the PHC codebase.