search

facebookresearch / habitat-sim

A flexible, high-performance 3D simulator for Embodied AI research.
https://aihabitat.org/
MIT License
2.58k stars 418 forks source link

tutorial for using HM3D #2383

Open sky-story opened 5 months ago

sky-story commented 5 months ago

Hello, I'm wondering if there's a comprehensive tutorial available to assist me in utilizing the Habitat Matterport 3D dataset within the Habitat framework? Could you also advise me on which sections of the codebase I should focus on for this purpose? I found the information provided in habitat-sim/DATASETS.md to be insufficient for effectively utilizing HM3D and other datasets.（sad）

aclegg3 commented 5 months ago

Hey @sky-story we'll need more information to help out here.

The documentation for HM3D with Habitat describes how to acquire the data locally and then how to configure the Simulator to load the scenes.

Beyond that, your code is application specific. If you know what you want to do we may have more pointers for you. If you are new to AI Habitat, I suggest you take a look at some of our resources pages and tutorials here.

sky-story commented 5 months ago

Hey @aclegg3 Thank you for your prompt response! It appears that the documentation for HM3D with Habitat has not been updated to guide users on utilizing HM3D via Habitat Lab. For instance, the documentation states that 'SIMULATOR.AGENT_0.SENSORS = ["RGB_SENSOR", "SEMANTIC_SENSOR"]', but this specific configuration is not present in the latest habitat-lab .yaml files！ Could you please provide a complete example code demonstrating how to utilize HM3D and visualize the observations (RGBD + semantic) in Habitat Lab? Or could you guide me on which parts of Habitat I should learn to achieve this？