MarSaKi / VLN-BEVBert

[ICCV 2023} Official repo of "BEVBert: Multimodal Map Pre-training for Language-guided Navigation"
180 stars 4 forks source link

Matterport3D RGBD datasets #5

Open ChrisWanghb opened 7 months ago

ChrisWanghb commented 7 months ago

How should I obtain Matterport3D RGBD datasets?

MarSaKi commented 7 months ago

Hi, You should fill out a sheet and download it here: https://niessner.github.io/Matterport/. Just follow the steps in "Setup"

ChrisWanghb commented 7 months ago

Hi, You should fill out a sheet and download it here: https://niessner.github.io/Matterport/. Just follow the steps in "Setup"

Thank you for your reply, I apologize for not clarifying my question. In your provided README.md, it mentions 'Install the latest version of Matterport3DSimulator, including the Matterport3D RGBD datasets (for step 6).' I would like to ask how I should download this Matterport3D RGBD datasets that you referred to. I have followed your guidance and completed the download of habitat using the command 'python download_mp.py --task habitat -o data/scene_datasets/mp3d/ Extract to: ./data/scene_datasets/mp3d/{scene}/{scene}.glb'. However, I did not find any download method related to the Matterport3D RGBD dataset in the download_mp.py file. Could you please provide the download method for it? Thank you. I am looking forward to your reply.

MarSaKi commented 7 months ago

Hi, sorry for the confusion. The ".glb" is used for the Habitat Simulator (VLN-CE). ".glb" is enough for replicating VLN-CE results. If you want to replicate the (discrete) VLN results, you should download the RGB dataset using download_mp.py, and the depth images should be extracted using the habitat simulator. For more details about downloading RGB dataset, please refer to the "Dataset Download" section of https://github.com/peteanderson80/Matterport3DSimulator

xuai05 commented 3 months ago

@ChrisWanghb Sorry to bother you, but I encountered the following error while downloading the .glb data. Do you know how to fix it? image

TLvCo commented 1 month ago

The URL address in the Python script is incorrect and needs to be changed.