Exploration: Use 2 dimensional data as source for music generation

Use perlin/simplex noice to generate multiple "layers" to be used to control various (arbitrary) axes:

[x] pitch / velocity
[x] freq / resonance
[ ] attack / delay
[ ] sustain / release
[ ] R/L balance
[ ] Up/down positioning (binaural support)
[ ] Chord progressions (could be done with banding / gradations)

That works for a single instrument at a time ... for every instrument, you could have different layers for the various attributes (big storage jump), or you could use the same layers for each instrument and just use values at different distances from a given point (i.e., a 2D ball -- in the formal maths sense -- around a given point to determine which instruments are played).

Papers of possible interest:

See CONVERTING IMAGES TO MUSIC USING THEIR COLOUR PROPERTIES.

Depends on:

Specific scenarios to explore:

Map image data to velocity, send that as MIDI velocity
Map graded image data to notes (e.g., in a scale, across a range of octaves), send that as a MIDI pitch
Panning will be trickier:
- first, maybe build up something in Element that receives MIDI CC and controls the volume
- then figure out what CC to send in order to control said volume
- coordinate these CC codes to lower and raise volumes of L & R to emulate panning

ut-proj / undertone

Exploration: Use 2 dimensional data as source for music generation #110