search

AlanJiang98 / EvRGBHand

Official Code for CVPR 2024 paper "Complementing Event Streams and RGB Frames for Hand Mesh Reconstruction"
MIT License
11 stars 0 forks source link

Dataset #2

Closed jkpark08 closed 6 months ago

jkpark08 commented 6 months ago

Thank you for the great work. Could I know when the dataset will be released?

AlanJiang98 commented 6 months ago

Thank you for your reminder. Our dataset is available here. Additionally, we have updated the README to facilitate a clearer understanding of our work.

jkpark08 commented 6 months ago

Thank you for the prompt response!

Also, how do you obtain 2D keypoints in blurry hand images? Sometimes their behavior seems unpredictable.

AlanJiang98 commented 6 months ago

Yes, labeling on blurred RGB images is challenging. Here, we annotate on the 2D representation of the event stream (as event streams do not experience blur issues). After getting predicted 3D keypoints, we project these 3D keypoints onto the imaging plane of the event camera to compare and calculate metrics such as 2D-MPJPE.

Another method is to increase the camera exposure time to induce image blur, while keeping the exposure time of other cameras constant. From the 2D annotations of other cameras, we calculate the final 3D keypoints and project them onto the imaging plane of the camera that experienced blur.

jkpark08 commented 6 months ago

Great thank you for the response!