facebookresearch / habitat-sim

A flexible, high-performance 3D simulator for Embodied AI research.
https://aihabitat.org/
MIT License
2.57k stars 416 forks source link

SoundSpaces 2.0 (Audio Sensor) Materials Issue #2072

Open denfed opened 1 year ago

denfed commented 1 year ago

(For clarity, I have posted this similar issue on the SoundSpaces repository as well. I just wanted to post his here too as this might be a non-soundspaces related error.)

Hello! I am having an issue using SS2.0 with materials enabled in HM3D environments. For some reason, when I run the audio sensor observation, I get these errors:

[13:07:34:776730]:[Assets] ResourceManager.cpp(2941)::joinSemanticHierarchy : Could not get the GenericSemanticMeshData
File: arvr/libraries/audio/AudioSDK/Research/Source/Wrapper/PropagationWrapper.cpp
Function: ovrResult PropagationWrapper::AddMeshVertices(const float *, ovra::Size), Line 926
Mesh vertices were NULL
[13:07:34:777420]:[Sensor] AudioSensor.cpp(394)::loadSemanticMesh : Couldn't add vertices to audio mesh, error:  2001

I am assuming this is something to do with the configurations of the hm3d dataset. However, I saw a previous issue where it was mentioned that soundspaces materials seems to work fine for hm3d, along with mp3d and gibson.

The hm3d scene I am trying to run is : hm3d/minival/00802-wcojb4TFT35/wcojb4TFT35.basis.glb With the scene dataset config: hm3d/minival/hm3d_annotated_minival_basis.scene_dataset_config.json

Any help would be greatly appreciated.

iyeon915 commented 1 year ago

Hi @denfed, Did you solve this issue? I got the same issue when I ran SS2.0 with HM3D environments.

denfed commented 1 year ago

I have not solved it yet, hoping others can chime in and help.

denfed commented 1 year ago

Has any progress been made on this issue? Thank you!