facebookresearch / habitat-matterport3d-dataset

This repository contains code to reproduce experimental results from our HM3D paper in NeurIPS 2021.
MIT License
133 stars 10 forks source link

Using the dataset in NVIDIA isaac #8

Closed sai-prasanna closed 1 year ago

sai-prasanna commented 1 year ago

Hi, thanks for providing this dataset for research. I was wondering if anyone managed to import this dataset into NVIDIA isaac sim. The glb files are directly importable into isaac, but I am not really sure if it's amenable to spawn robots into it/generate navigation meshes, get semantic camera outputs etc. Any pointers would be really helpful!

dhruvbatra commented 1 year ago

Out of scope for us. Closest I've seen in Section 5 in this paper: https://navigation-locomotion.github.io/

Also, you don't have to that. You can simply navigation policies in Habitat and combine with locomotion policies in Isaac as done in this paper: https://www.joannetruong.com/projects/vinl.html