facebookresearch / habitat-lab

A modular high-level library to train embodied AI agents across a variety of tasks and environments.
https://aihabitat.org/
MIT License
1.91k stars 478 forks source link

Object Datasets Usage for Habitat3.0 Baseline Implementation #1694

Open Jinghan11 opened 10 months ago

Jinghan11 commented 10 months ago

Habitat-Lab and Habitat-Sim versions

Habitat-Lab: v0.3.0

Habitat-Sim: v0.3.0

❓ Questions and Help

Hello,

I'm trying to reimplement the habitat3.0 baseline, specifically for the Social Navigation and Social Rearrangement components. I found that the hssd_spot_human_social_nav.yaml and hssd_spot_human.yaml files reference additional object paths.

While the YCB dataset has been provided, it seems that the Amazon Berkeley object dataset and Google object datasets are not included. I was wondering if these datasets are necessary for training the model, or if there might be any impact on the model's performance if it's trained without these two datasets.

aclegg3 commented 9 months ago

Hey @Jinghan11,

I believe those assets can be found here: https://huggingface.co/datasets/ai-habitat/OVMM_objects.