We need to find a way to meaningfully map audio and controls to video. For example a complex track with different instruments might map different frequencies to different video properties (i.e. object colors, size). However, this mapping might not make sense for a sine oscillator sweep for example, since the same "sound changing" would change different video properties.
We might be able to solve that with different types of mapping, giving the user the possibility to change according to its sound
We need to find a way to meaningfully map audio and controls to video. For example a complex track with different instruments might map different frequencies to different video properties (i.e. object colors, size). However, this mapping might not make sense for a sine oscillator sweep for example, since the same "sound changing" would change different video properties.
We might be able to solve that with different types of mapping, giving the user the possibility to change according to its sound