search

facebookresearch / sound-spaces

A first-of-its-kind acoustic simulation platform for audio-visual embodied AI research. It supports training and evaluating multiple tasks and applications.
https://soundspaces.org
Creative Commons Attribution 4.0 International
338 stars 55 forks source link

Sound rendering engine #63

Open ChrisIck opened 2 years ago

ChrisIck commented 2 years ago

In the readme.md it indicates that the audio renderer is currently not open sourced. Are there any plans to do so in the future, or prior open source implementations of the bidirectional path tracing algorithm?

ChanganVR commented 2 years ago

Hi Chris, thank you for you interest. Althought we don't plan to release the audio renderer in the near future, we're working on a new version of SoundSpaces that will allow you to dynamically specify the sound source/receiver location and load your own environment. This will be out in the next couple months.

For path tracing algorithms, you can checkout this repo: https://github.com/LCAV/pyroomacoustics

ChrisIck commented 2 years ago

Thanks Changan! The project I'm working on currently uses PRA, but there a couple of features (dynamic sound rendering, generalized 3D environment geometry, etc.) that I saw SoundSpaces using that seemed promising. I'm particularly curious to your implementation of bidirectional path tracing for this project. I'll keep an eye out for future releases.

Thanks for getting back to me. Relatedly, do you know if Facebook's audio team is hiring interns next season? My work in spatial acoustics within MARL at NYU is very close to this type of work. Regardless of your response, thanks for getting back to me, much appreciated!

Cheers, Chris

On Thu, Oct 28, 2021 at 5:58 PM Changan Chen @.***> wrote:

Hi Chris, thank you for you interest. Althought we don't plan to release the audio renderer in the near future, we're working on a new version of SoundSpaces that will allow you to dynamically specify the sound source/receiver location and load your own environment. This will be out in the next couple months.

For path tracing algorithms, you can checkout this repo: https://github.com/LCAV/pyroomacoustics https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_LCAV_pyroomacoustics&d=DwMCaQ&c=slrrB7dE8n7gBJbeO0g-IQ&r=RHvUcgP9r_ZMK4b1fVtJJA&m=BSrlyefdA36TtGmy7IVpsN0P2soVXoEfRBSOxrownoo&s=bqGm0vEpfVCyu4mp1zusB7HB6wrZxSoEG1L8jZNDI80&e=

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_facebookresearch_sound-2Dspaces_issues_63-23issuecomment-2D954253558&d=DwMCaQ&c=slrrB7dE8n7gBJbeO0g-IQ&r=RHvUcgP9r_ZMK4b1fVtJJA&m=BSrlyefdA36TtGmy7IVpsN0P2soVXoEfRBSOxrownoo&s=BvNhvrCO1Zzwjmi_9N7H21Xj9ptjjNwD5mrnyk4MN2A&e=, or unsubscribe https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_notifications_unsubscribe-2Dauth_AFIKNYU7Q7VXU2BOKVRERBDUJHBRJANCNFSM5GYUKBVA&d=DwMCaQ&c=slrrB7dE8n7gBJbeO0g-IQ&r=RHvUcgP9r_ZMK4b1fVtJJA&m=BSrlyefdA36TtGmy7IVpsN0P2soVXoEfRBSOxrownoo&s=i3UL9R_w2gyqYWBOWonHhIxqqCZR_WBCh23PSEOYPGM&e= . Triage notifications on the go with GitHub Mobile for iOS https://urldefense.proofpoint.com/v2/url?u=https-3A__apps.apple.com_app_apple-2Dstore_id1477376905-3Fct-3Dnotification-2Demail-26mt-3D8-26pt-3D524675&d=DwMCaQ&c=slrrB7dE8n7gBJbeO0g-IQ&r=RHvUcgP9r_ZMK4b1fVtJJA&m=BSrlyefdA36TtGmy7IVpsN0P2soVXoEfRBSOxrownoo&s=rrxY3cnZq3_c78W4iiu6kJqvwHiDSgk6QX9l81mg5z8&e= or Android https://urldefense.proofpoint.com/v2/url?u=https-3A__play.google.com_store_apps_details-3Fid-3Dcom.github.android-26referrer-3Dutm-5Fcampaign-253Dnotification-2Demail-2526utm-5Fmedium-253Demail-2526utm-5Fsource-253Dgithub&d=DwMCaQ&c=slrrB7dE8n7gBJbeO0g-IQ&r=RHvUcgP9r_ZMK4b1fVtJJA&m=BSrlyefdA36TtGmy7IVpsN0P2soVXoEfRBSOxrownoo&s=HWiDMJnfdOgCfhcMocKlY0itce-UzfoBPLgW-2pCuZM&e=.

ChanganVR commented 2 years ago

@ChrisIck I'm so sorry about the late reply. For the simulation, we are currently not planning to release the code, but are planning to release the binaries early next year. Keep an eye out for that!

As for the intern recruiting, I think it's best to directly contact the audio team. This position might be of interest to you: https://www.facebookcareers.com/jobs/229191922518250. I look forward to seeing and working with you in the future!