aardvarkxr / hackathon-sep20

BSD 3-Clause "New" or "Revised" License
1 stars 0 forks source link

Sound Design VR Toolkit #23

Open onaccident opened 3 years ago

onaccident commented 3 years ago

What would this gadget do?

One of the bigger problems for sound designers working in VR is that they mix and work with their sounds in a tool (called a digital audio workstation, or DAW) that is not natively in VR. This toolkit would provide an extension for sound designers to listen and edit sounds spatialized in VR in real time. The first tool I would try to build is just being able to preview a sound spatialized in VR, so bringing up the widget to connect to another app running (the DAW) and being able to play.

Who would use this gadget?

Sound designers in VR

Assuming that you're on the team, what other skillsets would you need to make this project happen over a couple days of hacking?

I'm a sound designer that has built a custom audio manager in C#. I will probably need an actual programmer to set up the aardvark portion, but I'll muddle through the best I can with what I got!

What will be the toughest part of building this gadget?

Anything with the Aardvark interfacing with the DAW in question. Uncertain if REAPER can actually take commands from another app, but it certainly can do a lot, so I'm hopeful.

JoeLudwig commented 3 years ago

Javascript has fairly sophisticated 3D audio support. Maybe all that's needed here is to plumb the head position in as a listener? Setting Aardvark feature for that bit.