search

minosworld / minos

MINOS: Multimodal Indoor Simulator
MIT License
201 stars 33 forks source link

Segmentation classes correspondence #82

Open OlgaBarinova opened 6 years ago

OlgaBarinova commented 6 years ago

What is the color-coding for the ground truth segmentation provided by MINOS? Where can the correspondence between the colors and NYV2 classes be found? Thanks!

msavva commented 6 years ago

Hi @OlgaBarinova , thank you for trying out MINOS. The encoding of the object category segmentation mask images is specified by a linear index of all SUNCG object types (see the details in https://github.com/minosworld/minos/blob/master/FAQ.md#getting-semantic-segmentation-masks)

OlgaBarinova commented 6 years ago

Many thanks for reply. I just wonder, how many classes are shown in the segmentation images (looks like there are about 40 distinct colors) and what is the meaning of those colors (e.g. green=wall)?

msavva commented 6 years ago

The list of all object types with their linearized index (as they would be represented in the semantic segmentation mask) are in https://github.com/smartscenes/sstk-metadata/blob/master/data/suncg/objectTypes.csv The color map for visualization purposes (i.e. the image data stored in the data_viz variable) are generated using the code in https://github.com/smartscenes/sstk/blob/dev/client/js/lib/util/Colors.js#L94