The potential of DDSP for games is enormous, and Unity developers will probably be just as eager to get their hands on the technology as musicians. Giving the technology to game / app developers is the perfect application of DDSP since people who play music games and tools powered by DDSP will get very excited about music, whereas musicians already know how exciting it is to play music. Since JUCE has Unity support it would make sense to add it as a platform, especially because it's often the first game engine for many developers.
Personally, I am excited out of my mind to get my hands on such a plugin. I'm a game developer who is developing a game where the player can play classical music. Right now users can play with a synthesizer, so it's a theremin in VR... but the sounds of the theremin doesn't fit every piece. Using DDSP as a runtime library in Unity would be a dream come true for us.
Suggested features:
A Unity library with cross-platform support (My app is Android/Oculus Quest)
The models should go in the games own data directory in Android.
A working user interface in Unity would be unnecessary. The bare-bones version of ddsp which is controlled with a script would be enough, where the user can drag variables in the inspector to hear the change in pitch/amplitude/parameters and so on.
The ability to bypass midi and pitch detection and control the pitch / amplitude with a script directly. Preferably with just enough smoothing to compensate for the games update rate, so that the sound is smooth during rapid glissandos.
As I said I'm tremendously excited about ddsp, thank you so much for developing this amazing technology... I hope I can find a way to use it in my project!
The potential of DDSP for games is enormous, and Unity developers will probably be just as eager to get their hands on the technology as musicians. Giving the technology to game / app developers is the perfect application of DDSP since people who play music games and tools powered by DDSP will get very excited about music, whereas musicians already know how exciting it is to play music. Since JUCE has Unity support it would make sense to add it as a platform, especially because it's often the first game engine for many developers.
Personally, I am excited out of my mind to get my hands on such a plugin. I'm a game developer who is developing a game where the player can play classical music. Right now users can play with a synthesizer, so it's a theremin in VR... but the sounds of the theremin doesn't fit every piece. Using DDSP as a runtime library in Unity would be a dream come true for us.
Suggested features:
As I said I'm tremendously excited about ddsp, thank you so much for developing this amazing technology... I hope I can find a way to use it in my project!