MarioLiebisch
commented
2 years ago I'm totally for this. Once planned to try something similar as an addon for chiptunes specifically, but I've never found the time to actually do so (so far).
First thought about the proposal above: I don't think this would need a timeline (nor should it have one). Instead there should probably be a Delay modulator node or something like that (along with others to cut parts of streams, too).
But just to put this in for discussion – random idea – might be worth maybe even making this fully scriptable (think VisualShader vs. Shader). The big thing would be the framework either way, considering most processing can be broken down to rather simple math operations.
Quick example for a sinus generator:
audio_node generator; // has no input sample
input float frequency = 10000.0f;
input float amplitude = 1.0f;
// Basically called once per requested sample
void modulate() {
SAMPLE.lr = amplitude * sin(TIME * 2 * PI * frequency);
}Or some stereo balance modulator:
audio_node modulator; // gets a sample as input
input float balance = 0.5f; // 0.0 = full left, 1.0 = full right
void modulate() {
sample s = mono(SAMPLE); // reduce to mono
SAMPLE.l = (1.0f - balance) * s;
SAMPLE.r = balance * s;
}So one script would define a single node (input or modulator), but full scripts could also be merged to single "complex" nodes again. Maybe overthinking, but I'd consider this very neat (and also very useful in education/audio processing) and maybe something for GPU processing, too (as long as no samples are based on previous ones)?
theraot
alexfreyre
starry-abyss
michaelhartung
reduz
gfazzito
amyhaber
SoyoTamo
GeorgeS2019
TokageItLab
gregcsokas
nobuyukinyuu
FlashboxSound
dromer
IntangibleMatter
Calinou
afarra6
Describe the project you are working on
Godot
Describe the problem or limitation you are having in your project
Sound designers in the industry end up having to use tools such as FMOD or Wise, with not really any FOSS alternative. Godot users are forced to use this bit of proprietary software in order to have more advanced audio in their games.
Interactive music is being handled by a separate PR/proposal being worked on, so this focuses entirely on procedural audio.
Describe the feature / enhancement and how it helps to overcome the problem or limitation
This would be a special AudioStream resource in Godot that would make it possible to have procedural/parametrizable audio playback in Godot.
Describe how your proposal will work, with code, pseudo-code, mock-ups, and/or diagrams
A new AudioStream class will be added: AudioStreamGraph. When edited, it will look like this:
The general idea is that the editor will be divided in two.
In the audio graph, several AudioGraphNodes will exist. Those have input and output Audio connections, as well as Controller connections (as a different type of data port).
The following audio graph nodes will be present:
Basic
Generators
These generate audio output:
Operators
These combine audio outputs:
And the idea is to have what is common in this type of software for controlling parameters, such as LFO, Envelopes, etc. This is just the general proposal.
If this enhancement will not be used often, can it be worked around with a few lines of script?
Audio is low level.
Is there a reason why this should be core and not an add-on in the asset library?
While this could be an add-on, games often require a mature and maintained solution for this. Given the popularity of tools such as Wise and FMOD, it sounds like it should be better this is core.