NVlabs / dex-ycb-toolkit

A Python package that provides evaluation and visualization tools for the DexYCB dataset
https://dex-ycb.github.io
GNU General Public License v3.0
145 stars 24 forks source link

How to use this dataset #21

Open lzfff12 opened 1 year ago

lzfff12 commented 1 year ago

if I want to use the dataset to hand and obj pose estimation, What should I do to get the mask of the object

ychao-nvidia commented 1 year ago

The object segmentation map is saved in a variable named seg in the label files. Please see this section for more details

lzfff12 commented 1 year ago

What should I do if I want a complete segmentaation of the object, not just the visible part?

ychao-nvidia commented 1 year ago

If you want a 2D segmentation that includes not just the visible parts but also the occluded parts, you can re-render the segmentation map yourself. Please see the Offline Renderer section for more details. You need to poke around this part of the code to load and render a single object at a time to remove occlusion.

yuyunhuang commented 1 year ago

Sorry, I don't know how to use the dataset to hand and obj pose estimation. I want to use it on robot arm. How to train hand and obj? Thank you.