Can this dataset generate 2d floorplan images? 2d layout images?

[universewill]

Can this dataset generate 2d floorplan images? 2d layout images? How to do it?

[mikeroberts3000]

I'm sorry but I don't understand the question. Can you describe what you want to do in a bit more detail?

[universewill]

I'm sorry but I don't understand the question. Can you describe what you want to do in a bit more detail?

By 2d floorplan i mean something like this (a vectorized image of 2d flootplan):

I want to get the 2d bboxes of the walls, windows and bboxes of the furnitures or vectorized infomation of 2d furnitures from a top-down view. Can this data be generated by this dataset? @mikeroberts3000

[mikeroberts3000]

Hi, thank you for clarifying. I think what you want to do is possible but not easy. I'll comment on the relative difficulty of each piece below.

• Obtaining the 2D bounding boxes of windows and furniture is easy. You can download semantically labeled 3D bounding boxes directly from this GitHub repo. It is easy to convert 3D bounding boxes to 2D bounding boxes.
• Rendering a top-down orthographic view of each scene with semantic labels is easy, but you'll need to pay to obtain the triangle mesh for each scene (link in the README).
• Obtaining 2D bounding boxes for walls is difficult. To reason about walls, you'll need to obtain the triangle mesh for each scene, and use our semantic labels to extract the parts of each mesh that are labeled as walls. Our walls are not labeled at the instance level, so you'll get a big triangle soup for all of the walls in a scene. From here, you'll need to project this triangle soup into a suitable floor plan representation. This projection step is itself is a somewhat ill-posed problem, because many of our walls are slanted. What is the correct way to project slanted walls onto your floor plan?

I'll also comment on some things in your example image that you don't mention in your text.

• Hypersim meshes do not include semantic labels at the room level (e.g., living room, kitchen, etc). You'll get a big triangle soup for all of the floors in each scene.
• Doors are labeled at the instance level, but we have not annotated the direction that they open.