search

alexsax / 2D-3D-Semantics

The data skeleton from Joint 2D-3D-Semantic Data for Indoor Scene Understanding
http://3dsemantics.stanford.edu
Apache License 2.0
464 stars 67 forks source link

2d Semantic segmentation labels #30

Closed weixuansun closed 5 years ago

weixuansun commented 5 years ago

I am using the 2d semantic maps in the dataset, it is mentioned in the paper that 2d semantically label is projected from 3d semantic point cloud. Bur not sure how was this projection implemented detailedly, for example in the image below. camera_08aa47684e3948558b6d23cdc7ec31b3_office_21_frame_3_domain_rgb camera_08aa47684e3948558b6d23cdc7ec31b3_office_21_frame_3_domain_semantic_bookcase The white bookcase outside the door is not included in the label, it looks like an error annotation. I wonder is the point cloud outside the room not considered when generating 2d semantic label?

alexsax commented 5 years ago

The 2D semantic labels were created in Blender by rendering directly from the semantic mesh. So long as the objects are unoccluded, they should be visible.

How were these black + white images created? Also, could you provide the name of the corresponding RGB and semantic images?

weixuansun commented 5 years ago

Thank you for your quick reply, I found I made a mistake when I try to create a binary mask for a single class in an image. I will close the issue. Btw, I wonder what is the efficient way to generate mask for one class in semantic map just like semantic-pretty? should we loop the colors in semantic_label.json to find matched color? the above image's name is camera_08aa47684e3948558b6d23cdc7ec31b3_office_21_frame_3_domain_rgb.png

ShihuaiXu commented 4 years ago

I also want to know how to find matched color. Sir, have you solve this solution? @weixuansun

weixuansun commented 4 years ago

I also want to know how to find matched color. Sir, have you solve this solution? @weixuansun

Hi, you can refer to this issue #6.