jnnan / trumans_utils

Repository of TRUMANS
112 stars 6 forks source link

Detailed hand/finger poses #14

Open jyf588 opened 1 month ago

jyf588 commented 1 month ago

Hello authors!

Great job on all your effort in creating this large dataset! I was trying to play around with it by first loading and visualizing the motions.

For some reason I noticed some issues with the hand motions, for example In the 1st screenshot, right hand is grabbing the bottle fine, but left hand has unnatural finger poses In the 2nd screenshot, the hand is not really grasping the bottle In the 3rd screenshot, bottle is too long and penetrating the body mesh

Screenshot from 2024-09-19 12-20-37 Screenshot from 2024-09-19 12-22-05 Screenshot from 2024-09-19 12-22-09

Could you let me know if this is expected or there might be something I was doing it wrong? Thanks so much!

For reference, here is my code snippet for loading the SMPL motions:

smplx_model: SMPLX = smplx.create(
        model_path=cfg.model_path,
        model_type="smplx",
        gender="neutral",
        batch_size=t_end - t_start,
        use_pca=False,
    )
smplx_output: SMPLXOutput = smplx_model.forward(
        betas=all_betas[t_start:t_end],
        transl=all_human_transl[t_start:t_end],
        body_pose=all_human_poses[t_start:t_end],
        global_orient=all_human_orient[t_start:t_end],
        return_verts=True,
        return_full_pose=True,
        left_hand_pose=all_left_hand_poses[t_start:t_end],
        right_hand_pose=all_right_hand_poses[t_start:t_end],
    )
jnnan commented 1 month ago

Please provide the frame index of the erroneous screenshot.