Closed DrDengDi closed 5 months ago
Hi @DrDengDi,
When I run python -m vlfm.run, it raises "FileNotFoundError: Could not find dataset file data/datasets/objectnav/hm3d/v1/val".
Have you encountered such issue? It seems that the data is stored at the correct location.
Cheers!
Hi @Neal2020GitHub To solve this issue, I ran the debugger from vlfm/run.py and added a breakpoint at ~/anaconda3/envs/vlfm/lib/python3.9/site-packages/habitat/datasets/pointnav/pointnav_dataset.py as shown in the image to check what is difference between the data_path and the stored file path.
@naokiyokoyama Could you tell me how to get the visualization of the environment, robot and path as shown in the README's figure, i.e., what commands to run?
Hi @Neal2020GitHub To solve this issue, I ran the debugger from vlfm/run.py and added a breakpoint at ~/anaconda3/envs/vlfm/lib/python3.9/site-packages/habitat/datasets/pointnav/pointnav_dataset.py as shown in the image to check what is difference between the data_path and the stored file path.
Thank you! It works now.
@DrDengDi to generate the videos, you will need to add "disk" to habitat_baselines.eval.video_option
("['disk']"
)
You will also need to set habitat_baselines.video_dir
to a directory of your choosing. It will be created if it does not exist.
What will be visualized is the ground truth shortest path (green), the agent's trajectory so far (blue), and locations of goal object instances (red).
More config options for habitat_baselines can be found here: https://github.com/facebookresearch/habitat-lab/blob/main/habitat-baselines/habitat_baselines/config/default_structured_configs.py
@DrDengDi Regarding the 'error' that you posted, I believe that you can ignore that. I have also updated the README per your suggestions, thank you.
When I tried to generate videos, it raised TypeError: unsupported format string passed to numpy.ndarray.__format__
.
Any solutions about it? Thanks!
I have pushed a fix in d79d7f1d7e047f34e048f61ce34ad85379dbaa7c
, thanks for pointing it out.
@DrDengDi Hi,when I run python -m vlfm.run, it raises issues below.Could you tell me how to fix this ? I have tried the debugger,but it seems my path is correct. I stored the datasets in /home/name/vlfm-main/data/datasets/objectnav/hm3d/v1/val. And I also tried copy the datasets to root directory,but meaningless.
**/***
2024-07-05 16:58:53,937 Initializing dataset ObjectNav-v1
Error executing job with overrides: []
Traceback (most recent call last):
File "/home/tcy/anaconda3/envs/vlfm/lib/python3.9/runpy.py", line 197, in _run_module_as_main
return _run_code(code, main_globals, None,
File "/home/tcy/anaconda3/envs/vlfm/lib/python3.9/runpy.py", line 87, in _run_code
exec(code, run_globals)
File "/home/tcy/vlfm-main/vlfm/run.py", line 59, in data/datasets/objectnav/hm3d/v1/val
After running
The terminal shows this error:
and![image](https://github.com/bdaiinstitute/vlfm/assets/162066519/ff6353ef-ff48-45b7-ae54-51474e34779e)
How to solve this error? May I know how to get the visualization of the environment, robot and path as shown in the README's figure, i.e., what commands to run?![image](https://github.com/bdaiinstitute/vlfm/assets/162066519/10e51fa2-c777-485f-9997-34c600593c6c)
Minor comments in the README
inconsistent file name
HM3D_OBJECTNAV is defined as objectnav_hm3d_v2.zip, but unzip objectnav_hm3d_v1 file and the folder name is $DATA_DIR/datasets/objectnav/hm3d/v1
solution: change HM3D_OBJECTNAV from v2 to v1 or change the unzip file and folder to v2 and update the predefined data file to v2 and update the hardcoded data/datasets/objectnav/hm3d/v1/{split}/{split}.json.gz to v2.
No instruction to run server
Connection error after running
HTTPConnectionPool(host='localhost', port=12182): Max retries exceeded with url: /blip2itm (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x75083089c8e0>: Failed to establish a new connection: [Errno 111] Connection refused'))
solution: run
before