oakink / OakInk

[CVPR 2022] OakInk: A Large-scale Knowledge Repository for Understanding Hand-Object Interaction
https://oakink.net
MIT License
103 stars 5 forks source link

The data correspondence between shape and image #9

Closed wyl2077 closed 6 months ago

wyl2077 commented 8 months ago

Hi,

I'm interested in understanding how to locate the RGB image that corresponds to a specific grasp pose within the shape dataset. For instance, I'm looking to find the RGB image associated with the grasp pose detailed in "./shape/oakink_shape_v2/apple/C90001/461d0e1f41/hand_param.pkl". I noticed that the source file is indicated as "pass1E/C90001_0004_0001_0007/2021-10-09-14-39-54/dom.pkl". However, it appears that I need the actual frame to access the corresponding image from directory “./image/stream_release_v2/C90001_0004_0001_0007/2021-10-09-14-39-54/”. Could you provide guidance on how to proceed with this? Snipaste_2024-03-11_19-39-39

Thanks a lot.

lixiny commented 6 months ago

It's unfortunate, but the exact frame corresponding to this grasping pose might be irretrievable.

During the development of this dataset, we manually selected a dominant frame from each sequence, which we labeled as dom.pkl. Regrettably, we neglected to record the frame ID for these selections.