search

facebookresearch / sound-spaces

A first-of-its-kind acoustic simulation platform for audio-visual embodied AI research. It supports training and evaluating multiple tasks and applications.
https://soundspaces.org
Creative Commons Attribution 4.0 International
345 stars 55 forks source link

not support HFOV>90 #69

Open ly-zhu opened 2 years ago

ly-zhu commented 2 years ago

Hey,

I tested the HFOV with a larger value than 90, the returned scene_observations are all with zero values (rgb and depth) using "the scripts/cache_observations.py"?

Is it because of the current habitat version does not support the HFOV other than 90?

ChanganVR commented 2 years ago

I don't think that's the reason because I generated videws with HFOVs larger than 90 before. But I don't know why you got zeros values for these scenarios. I need to take a closer look into the script.

ly-zhu commented 2 years ago

Hi Changan,

Thanks for your responses! Previously I tested only with HFOV=180 ("SIMULATOR_SENSOR.HFOV" in habitat-lab/habitat/config/default.py ) which returns all zeros.

This time I tried the HFOV in (0, 360]. It only returns all zeros for HFOV of 180 and 360, and supports for all the rest. I found 1) the focal length varies when changing the HFOV; 2) when the HFOV is larger than 180, the returned rgb or depth are flipped upside down.

Is there any config setting that supporting for changing only the angle of the "field of view"? Something won't change the focal length, and only equals to a wider view range. For example, for a fixed agent position, instead of only seeing the front field of view of 90, what the agent sees is a 360 image if we set some config value to 360.

ChanganVR commented 2 years ago

@ly-zhu it's good to know that you found something wroking! I would very much like to help with your questions regarding the HFOV but I'm not very familiar with that. For visual related questions, I think you can find better assistance if you post the question in the Habitat repo. For audio related questions, you are very wlecome to post them here.