search

guiggh / hand_pose_action

Dataset and code for the paper "First-Person Hand Action Benchmark with RGB-D Videos and 3D Hand Pose Annotations", CVPR 2018.
257 stars 31 forks source link

False alignment when project 3D hand skeleton and object to 2D image plane #13

Closed fylwen closed 1 year ago

fylwen commented 3 years ago

Hi. I've tried both load_example.m and load_example.py, however, I consider that for some sequences, the alignment from the skeleton and object_pose to image is problematic and does not globally match. I list some screenshots of frame examples below, which are generated by load_example.py; I also checked with the load_example.m, and the same issue exists:

Subject2 pour_milk sequence1 frame119 Subject2_pour_milk_sequence1_frame119

Subject3 pour milk sequence3 frame41 Subject3_pour_milk_sequence3_frame41

Subject6 pour milk sequence1 frame45 Subject6_pour_milk_sequence1_frame45

Subject4 read letter sequence3 frame88 Subject4_read_letter_sequence3_frame88

Subject4 read letter sequence3 frame188 Subject4_read_letter_sequence3_frame188

It seems that something related to the camera parameter goes wrong, and I here open the issue to seek help.

Furthermore, it seems that for Subject 5 open/close/pour liquid soap, I cannot find the object pose label for Sequence 1~4.

Many thanks for the valuable help!

Best regards, Frances

guiggh commented 1 year ago

This is a known issue on some of the annotated sequences due to some bad calibration. I'm afraid this will stay like this as it's hard to fix without manually extensive work.