facebookresearch / sound-spaces

A first-of-its-kind acoustic simulation platform for audio-visual embodied AI research. It supports training and evaluating multiple tasks and applications.
https://soundspaces.org
Creative Commons Attribution 4.0 International
322 stars 55 forks source link

When I plot top-down map, info["top_down_map"]["agent_rotation"] is missing. #142

Open ruohaoguo opened 2 weeks ago

ruohaoguo commented 2 weeks ago

Hi @ChanganVR

I want to plot top-down map, but when I execute the following command: --run-type eval --exp-config ss_baselines/savi/config/semantic_audionav/savi.yaml EVAL_CKPT_PATH_DIR data/pretrained_weights/semantic_audionav/savi/best_val.pth EVAL.SPLIT test USE_SYNC_VECENV True RL.DDPPO.pretrained False the following error occurs:

image

I check the info. It seems to lack info["top_down_map"]["agent_rotation"].

image

How can I solve this problem? Thank you very much!

Star-down commented 1 week ago

@ruohaoguo hello,I would like to ask if you have completed the model training process? I encountered some problems during the training.

ruohaoguo commented 1 week ago

@ruohaoguo hello,I would like to ask if you have completed the model training process? I encountered some problems during the training.

Yes, I completed the training process. Do you have any questions?

Star-down commented 1 week ago

When I executed the command: python ss_baselines/av_nav/run.py --run-type eval --exp-config ss_baselines/av_nav/config/audionav/replica/val_telephone/audiogoal_depth.yaml --model-dir data/models/replica/audiogoal_depth, the program unexpectedly terminated at 400.pth, which seems to be caused by multithreading or insufficient memory. Have you encountered this situation? My computer has 96G of memory.

ruohaoguo commented 1 week ago

When I executed the command: python ss_baselines/av_nav/run.py --run-type eval --exp-config ss_baselines/av_nav/config/audionav/replica/val_telephone/audiogoal_depth.yaml --model-dir data/models/replica/audiogoal_depth, the program unexpectedly terminated at 400.pth, which seems to be caused by multithreading or insufficient memory. Have you encountered this situation? My computer has 96G of memory.

Sorry, I haven't encountered this problem. Maybe you can print out the error message or ask @ChanganVR .

Star-down commented 1 week ago

May I ask what versions of your soundspace, habitat-lab, and habitat-sim are? Thank you very much.

ruohaoguo commented 1 week ago

soundspaces==1.0 habitat-lab==0.2.2 habitat_sim==0.2.2 torch==2.3.1 tensorflow==2.16.1

May I ask what versions of your soundspace, habitat-lab, and habitat-sim are? Thank you very much.

Star-down commented 1 week ago

Thank you very much!

sun17-311 commented 1 week ago

@Star-down I have encountered this problem. My email address is sundilong@mail.dlut.edu.cn. I think we can communicate.