search

facebookresearch / sound-spaces

A first-of-its-kind acoustic simulation platform for audio-visual embodied AI research. It supports training and evaluating multiple tasks and applications.
https://soundspaces.org
Creative Commons Attribution 4.0 International
357 stars 57 forks source link

Question about metadata #47

Open vincentlux opened 3 years ago

vincentlux commented 3 years ago

Hi, thanks for this great work! May I ask if it is possible to share how the metadata being created? I read the paper about how the graph being created and wondering if this part of the code can also be released.

Thanks a lot for your help!

ChanganVR commented 3 years ago

Hi @vincentlux sure, I can do that. Just to confirm, by metadata, do you mean creating the graph based on the grid points?

vincentlux commented 3 years ago

Hi @ChanganVR thanks a lot! Exactly, I am wondering how to interact with the matterport original data to create grid points and the graph. Thanks for your help!

ChanganVR commented 3 years ago

Hi @vincentlux, the scripts are added. Please check out these two files: https://github.com/facebookresearch/sound-spaces/blob/master/scripts/generate_matterport3d_metadata.py, https://github.com/facebookresearch/sound-spaces/blob/master/scripts/generate_replica_metadata.py

vincentlux commented 3 years ago

Hi @ChanganVR, got it, thanks a lot for your help!

vincentlux commented 3 years ago

Hi @ChanganVR, one more question, may I ask how you generated these grid points? Since I can't find it from the original matterport dataset, I am confused about how to get these grid points and the original graph.pkl (both are inputs to the generate_matterport3d_metadata.py). Again, thanks for your help in advance!

ChanganVR commented 3 years ago

@vincentlux sorry about the late reply. The grid points are generated beforehand and need to be fixed. You just need to use the existing grid points to generate new graphs with the scripts I shared with you.

yyf17 commented 3 years ago

@ChanganVR Wonderful work!