Error Downloading HM3D Dataset: tarfile.ReadError

MrCapricornLiu commented 5 months ago

Habitat-Sim Version

v0.3.1

🐛 Bug Report

I encountered an issue while following the instructions provided here to download the HM3D dataset using the command:

python -m habitat_sim.utils.datasets_download --username <api-token-id> --password <api-token-secret> --uids hm3d_minival_v0.2

However, there are some problems during the download process. Please see the detailed error in the screenshot below:

  File "/root/miniconda3/envs/habitat_latest/lib/python3.9/tarfile.py", line 1797, in open
    raise ReadError("file could not be opened successfully")
tarfile.ReadError: file could not be opened successfully

issue

Steps to Reproduce

To reproduce the behavior, run the following command (the api-token is got from here: Developer Tools -> API Token Management):

python -m habitat_sim.utils.datasets_download --username 038b1d8ac662cb50 --password f3f88b6f885c882625ae34cab9d58ba1 --uids hm3d_minival_v0.2 --data-path /root/autodl-tmp/project/download

System Info

OS: Ubuntu 20.04
PyTorch Installation Method: conda
Build Command (if compiling from source):
Python Version: 3.9
CUDA Version: 11.0

ZiruiLi-133 commented 4 months ago

I have also met the same issue, this might happen because we did not have access to the dataset so basically nothing is downloaded. After I follow the instructions mentioned at https://github.com/matterport/habitat-matterport-3dresearch?tab=readme-ov-file and applied for the access, the problem was solved.

aclegg3 commented 4 months ago

Hey @MrCapricornLiu,

It is true that you will need access first. @ZiruiLi-133 I'm glad to hear this resolved the problem for you.

This can also result from temporary outages of the server resulting in corrupted or empty packages. Please ensure you have access and try again. If that doesn't resolve the issue we can dig in more.

facebookresearch / habitat-sim