Materials issue with HM3D

[denfed]

Hello! I am having an issue using SS2.0 with materials enabled in HM3D environments. For some reason, when I run the audio sensor observation, I get these errors:

[13:07:34:776730]:[Assets] ResourceManager.cpp(2941)::joinSemanticHierarchy : Could not get the GenericSemanticMeshData
File: arvr/libraries/audio/AudioSDK/Research/Source/Wrapper/PropagationWrapper.cpp
Function: ovrResult PropagationWrapper::AddMeshVertices(const float *, ovra::Size), Line 926
Mesh vertices were NULL
[13:07:34:777420]:[Sensor] AudioSensor.cpp(394)::loadSemanticMesh : Couldn't add vertices to audio mesh, error:  2001

I am assuming this is something to do with the configurations of the hm3d dataset. However, I saw a previous issue where it was mentioned that materials seems to work fine for hm3d, along with mp3d and gibson.

The hm3d scene I am trying to run is : hm3d/minival/00802-wcojb4TFT35/wcojb4TFT35.basis.glb With the scene dataset config: hm3d/minival/hm3d_annotated_minival_basis.scene_dataset_config.json

Any help would be greatly appreciated.

[iyeon915]

I got the same issue when I tried to use the HM3D dataset.

Python file: ~/sound-spaces/examples/minimal_example.py scene_id: data/scene_datasets/hm3d/minival/00800-TEEsavR23oF/TEEsavR23oF.basis.glb scene_dataset_config_file: data/scene_datasets/hm3d/hm3d_annotated_basis.scene_dataset_config.json

File: arvr/libraries/audio/AudioSDK/Research/Source/Wrapper/PropagationWrapper.cpp
Function: ovrResult PropagationWrapper::AddMeshVertices(const float *, ovra::Size), Line 926
Mesh vertices were NULL
[11:24:37:833446]:[Sensor] AudioSensor.cpp(394)::loadSemanticMesh : Couldn't add vertices to audio mesh, error:  2001
[11:24:38:581026]:[Physics] PhysicsManager.cpp(50)::~PhysicsManager : Deconstructing PhysicsManager
[11:24:38:581103]:[Scene] SceneManager.h(25)::~SceneManager : Deconstructing SceneManager
[11:24:38:581113]:[Scene] SceneGraph.h(25)::~SceneGraph : Deconstructing SceneGraph
[11:24:38:581203]:[Sensor] AudioSensor.cpp(64)::~AudioSensor : [Audio]  Destroying the audio sensor
[11:24:38:581503]:[Sensor] Sensor.cpp(69)::~Sensor : Deconstructing Sensor
[11:24:38:581525]:[Scene] SceneGraph.h(25)::~SceneGraph : Deconstructing SceneGraph
[11:24:38:581613]:[Scene] SemanticScene.h(47)::~SemanticScene : Deconstructing SemanticScene
[11:24:38:583345]:[Sim] Simulator.cpp(66)::~Simulator : Deconstructing Simulator
# The length of obtained IR when sampling_rate=16000 : (1, 2067)

When I set the enableMaterials=False, it works fine but I need the absorption rate for each material. @ChanganVR , do you have any additional settings for HM3D? HM3D dataset already used in the paper SS2.0.

[ChanganVR]

@denfed @iyeon915 Sorry for the late reply. we recently found out there is some issue with loading the acoustic materials for HM3D in the simulator. This is still under investigation and due to the lack of developers, the progress has been slow. We will get back to you as soon as possible when this is fixed!

But the acoustic material loading for MP3D and Gibson should be fully functioning.

[denfed]

Have there been any updates on getting the material properties working for HM3D? Thank you!

[aizhiqi-work]

Have there been any updates on getting the material properties working for HM3D? Thank you!

[ZetaRing]

@denfed @iyeon915 Sorry for the late reply. we recently found out there is some issue with loading the acoustic materials for HM3D in the simulator. This is still under investigation and due to the lack of developers, the progress has been slow. We will get back to you as soon as possible when this is fixed!

But the acoustic material loading for MP3D and Gibson should be fully functioning.

Same issue. Pls~