minosworld / minos

MINOS: Multimodal Indoor Simulator
MIT License
201 stars 33 forks source link

How to get 45K House3D houses #104

Closed ZhuFengdaaa closed 6 years ago

ZhuFengdaaa commented 6 years ago

Both the minos and house3d claim that there is 45K houses in suncg dataset, which provide rich training data.

However, data file in this project only provides 365 different houses. Does anybody know how to get 45K different scenes ?

angelxuanchang commented 6 years ago

Once you download the SUNCG datasets, you will have a house directory with /house.json. Each of those house file correspond to a different scene (there should be 45622 in total - not necessarily all are appropriate for the navigation task). You can get the ids by listing the house directory.

ZhuFengdaaa commented 6 years ago

It means that I can use minos/tools/generate_episodes.py to prepare dataset myself, right?

May I ask why there so many houses are not appropriate for navigation task that both minos and house3D papers just select a few houses manually for experiment? Too complex, too large or something else?

angelxuanchang commented 6 years ago

Yes, you can use the script to generate episodes and prepare an dataset.

Some of the houses are not appropriate because 1) not all the rooms are connected - although the scenes are constructed by people, they don't always construct realistic houses 2) some of the houses are empty 3) many of the houses are multi-level (we currently don't have an action for going up/down stairs) and 4) some of them are not even actual houses.

For 1,2,3: See scene 6375f02bb85faedac81580db8ad4381c for an example of an house that is empty, multiple levels, and disconnected.

For 4, See scene 15feafcfd99f95365a01f225e3a4b436 for an example of a scene that is just outside

For Minos, we selected a subset of the houses are manually inspected to be mostly navigatable, single floor, and to vary from single room to larger houses with more rooms.

ZhuFengdaaa commented 6 years ago

Thank you for your detailed response. I hope that we can find way to utilise 3D resource as much as possible and get a larger and more diverse dataset. For example, sample episode from a subset of rooms connected with each other can overcome 1) and 3).

angelxuanchang commented 6 years ago

Yes, it is good to leverage more of the dataset. We welcome contributions! Please let us know if you have any other questions or issues with using the larger dataset.

liucsg commented 4 years ago

@angelxuanchang Hi,can i use personal email for requesting access to download datasets,including matterport3d?