search

IFICL / SLfM

Official code for the paper: [ICCV2023] Sound Localization from Motion: Jointly Learning Sound Direction and Camera Rotation
https://ificl.github.io/SLfM/
MIT License
34 stars 8 forks source link

I meet promblems when I run multi-preprocess.sh in path /SLfM/AI-Habitat #1

Closed qiu-xiaoqi closed 1 year ago

qiu-xiaoqi commented 1 year ago

[11:11:54:265809]:[Metadata] AssetAttributesManager.cpp(110)::AssetAttributesManager : Built default primitive asset templates : 12 [11:11:54:266126]:[Metadata] SceneDatasetAttributesManager.cpp(308)::readDatasetJSONCell : "stages.default_attributes" set in Attributes Manager from JSON. [11:11:54:266182]:[Metadata] AttributesManagerBase.h(357)::buildAttrSrcPathsFromJSONAndLoad : No Glob path result for /root/sound-spaces/data/scene_da tasets/data/versioned_data/hm3d-1.0/hm3d/example/00861-GLAQ4DNUx5U/.basis.glb [11:11:54:266212]:[Metadata] AttributesManagerBase.h(357)::buildAttrSrcPathsFromJSONAndLoad : No Glob path result for /root/sound-spaces/data/scene_da tasets/data/versioned_data/hm3d-1.0/hm3d/minival/00800-TEEsavR23oF/.basis.glb [11:11:54:266240]:[Metadata] AttributesManagerBase.h(357)::buildAttrSrcPathsFromJSONAndLoad : No Glob path result for /root/sound-spaces/data/scene_da tasets/data/versioned_data/hm3d-1.0/hm3d/minival/00802-wcojb4TFT35/*.basis.glb

IFICL commented 1 year ago

Hi. Would you mind describing the issues in details? As what I can see from the error, it is about Habitat-Sim and Soundspace 2.0. Can you check if you are able to run the mini example from Soundspace 2.0 and make sure the scene data with semantic annotations are available?

qiu-xiaoqi commented 1 year ago

Hi，the problem like this： Traceback (most recent call last):   File "generate_audiosfm.py", line 249, in <module>     main()   File "generate_audiosfm.py", line 241, in main     run(args, scene_id, settings)   File "generate_audiosfm.py", line 185, in run     camera_sets = sample_rotated_camera_set_with_n_view(args, scene_id, settings)   File "/root/SLfM/Dataset/AI-Habitat/util/camera_pair.py", line 168, in sample_rotated_camera_set_with_n_view     sim = habitat_sim.Simulator(cfg)   File "<attrs generated init habitat_sim.simulator.Simulator>", line 11, in init   File "/root/miniconda3/lib/python3.8/site-packages/habitat_sim/simulator.py", line 118, in attrs_post_init     self.set_from_config(self.config)   File "/root/miniconda3/lib/python3.8/site-packages/habitat_sim/simulator.py", line 269, in __set_from_config     self._config_backend(config)   File "/root/miniconda3/lib/python3.8/site-packages/habitat_sim/simulator.py", line 200, in _config_backend     super().init__(config.sim_cfg, config.metadata_mediator) AssertionError: ESP_CHECK failed: Missing (at least) one of scene dataset attributes, stage attributes, or dataset scene attributes for scene '/root/sounes/data/scene_datasets/data/versioned_data/hm3d-1.0/hm3d/train/00016-qk9eeNeR4vw/qk9eeNeR4vw.basis.glb'.  Likely an invalid scene name. I have never try to run the mini example from Soundspace 2.0, I will try.Thank you a lot

 

※小李飞刀※ @.***

 

------------------ 原始邮件 ------------------ 发件人: "Ziyang @.>; 发送时间: 2023年8月2日(星期三) 上午10:18 收件人: @.>; 抄送: @.>; @.>; 主题: Re: [IFICL/SLfM] I meet promblems when I run multi-preprocess.sh in path /SLfM/AI-Habitat (Issue #1)

Hi. Would you mind describing the issues in details? As what I can see from the error, it is about Habitat-Sim and Soundspace 2.0. Can you check if you are able to run the mini example from Soundspace 2.0 and make sure the scene data wirh semantic annotations are available.

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>

IFICL commented 1 year ago

Hi，the problem like this： Traceback (most recent call last):   File "generate_audiosfm.py", line 249, in <module>     main()   File "generate_audiosfm.py", line 241, in main     run(args, scene_id, settings)   File "generate_audiosfm.py", line 185, in run     camera_sets = sample_rotated_camera_set_with_n_view(args, scene_id, settings)   File "/root/SLfM/Dataset/AI-Habitat/util/camera_pair.py", line 168, in sample_rotated_camera_set_with_n_view     sim = habitat_sim.Simulator(cfg)   File "<attrs generated init habitat_sim.simulator.Simulator>", line 11, in init   File "/root/miniconda3/lib/python3.8/site-packages/habitat_sim/simulator.py", line 118, in attrs_post_init     self.set_from_config(self.config)   File "/root/miniconda3/lib/python3.8/site-packages/habitat_sim/simulator.py", line 269, in __set_from_config     self._config_backend(config)   File "/root/miniconda3/lib/python3.8/site-packages/habitat_sim/simulator.py", line 200, in _config_backend     super().init__(config.sim_cfg, config.metadata_mediator) AssertionError: ESP_CHECK failed: Missing (at least) one of scene dataset attributes, stage attributes, or dataset scene attributes for scene '/root/sounes/data/scene_datasets/data/versioned_data/hm3d-1.0/hm3d/train/00016-qk9eeNeR4vw/qk9eeNeR4vw.basis.glb'.  Likely an invalid scene name. I have never try to run the mini example from Soundspace 2.0, I will try.Thank you a lot   ※小李飞刀※ @.***   …

As I can tell, this should be the problem of seting up the scene dataset, habitat-smi and soundspace, please refer their repo for detail solution.

qiu-xiaoqi commented 1 year ago

Hi， I ran the code：python examples/minimal_example.py and no error occurred， but after I ran the multi-preprocess， got the same error. The error seems looks like I didn't have the file /.basis.glb, but I have the file 'hm3d_annotated_basis.scene_dataset_config.json'. Whether the /.basis.glb file will be generated after running multi-preprocess  

※小李飞刀※ @.***

 

------------------ 原始邮件 ------------------ 发件人: "Ziyang @.>; 发送时间: 2023年8月2日(星期三) 上午10:34 收件人: @.>; 抄送: @.>; @.>; 主题: Re: [IFICL/SLfM] I meet promblems when I run multi-preprocess.sh in path /SLfM/AI-Habitat (Issue #1)

Hi，the problem like this： Traceback (most recent call last):   File "generate_audiosfm.py", line 249, in <module>     main()   File "generate_audiosfm.py", line 241, in main     run(args, scene_id, settings)   File "generate_audiosfm.py", line 185, in run     camera_sets = sample_rotated_camera_set_with_n_view(args, scene_id, settings)   File "/root/SLfM/Dataset/AI-Habitat/util/camera_pair.py", line 168, in sample_rotated_camera_set_with_n_view     sim = habitat_sim.Simulator(cfg)   File "<attrs generated init habitat_sim.simulator.Simulator>", line 11, in init   File "/root/miniconda3/lib/python3.8/site-packages/habitat_sim/simulator.py", line 118, in attrs_post_init     self.__set_from_config(self.config)   File "/root/miniconda3/lib/python3.8/site-packages/habitat_sim/simulator.py", line 269, in __set_from_config     self._config_backend(config)   File "/root/miniconda3/lib/python3.8/site-packages/habitat_sim/simulator.py", line 200, in _config_backend     super().init(config.sim_cfg, config.metadata_mediator) AssertionError: ESP_CHECK failed: Missing (at least) one of scene dataset attributes, stage attributes, or dataset scene attributes for scene '/root/sounes/data/scene_datasets/data/versioned_data/hm3d-1.0/hm3d/train/00016-qk9eeNeR4vw/qk9eeNeR4vw.basis.glb'.  Likely an invalid scene name. I have never try to run the mini example from Soundspace 2.0, I will try.Thank you a lot   ※小李飞刀※ @.***   …

As I can tell, this should be the problem of seting up the scene dataset, habitat-smi and soundspace, please refer their repo for detail solution.

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>

IFICL commented 1 year ago

Hi， I ran the code：python examples/minimal_example.py and no error occurred， but after I ran the multi-preprocess， got the same error. The error seems looks like I didn't have the file /.basis.glb, but I have the file 'hm3d_annotated_basis.scene_dataset_config.json'. Whether the /.basis.glb file will be generated after running multi-preprocess

For debugging, you can copy the command out to do a single processing debug. For your question, /*.basis.glb file will not be generated after running multi-preprocess. It should be existed. Make sure you download the HM3D semantic dataset in a right way.

qiu-xiaoqi commented 1 year ago

This is my code to download the HM3D python -m habitat_sim.utils.datasets_download --username --password --uids hm3d_semantics and after I downloaded, there is no /.basis.glb, only have the /.semantic.glb and /*.semantic.txt, what should be the uids

IFICL commented 1 year ago

This is my code to download the HM3D python -m habitat_sim.utils.datasets_download --username --password --uids hm3dsemantics and after I downloaded, there is no /.basis.glb, only have the /_.semantic.glb and /*.semantic.txt, what should be the uids

You only download the semantic labels for HM3D while it doesn't download any original meshes for HM3D. An entire scene should be contained as shown in the screenshots below.

image

Please check the HM3D dataset and codes carefully.

qiu-xiaoqi commented 1 year ago

Thank you，now I am downloading the hm3d_train_full

IFICL commented 1 year ago

Solved