search

Ignotus-mago / PixelAudio

PixelAudio maps arrays of audio samples onto arrays of pixel values.
Other
0 stars 0 forks source link

Frequent operations in performance #15

Open Ignotus-mago opened 4 months ago

Ignotus-mago commented 4 months ago

Let's make a list for the LoadAudioToImage sample code:

  1. Open an audio file, load it to a buffer: audioFile and other locators
  2. Get a reference to the buffer audio array (or multiple arrays): audioBuffer
  3. Get a copy of the buffer array that is mapSize frames, padded or trimmed if necessary: audioSignal
  4. Transcode the signal to an RGB array in signal order: rgbSignal
  5. Write rgbSignal to an image for display: mapImage
  6. Click on display to trigger audio events with a SamplerInstrument: audioSampler, adsr, samplerInstrument
  7. Load audio from files to color channels of rgbSignal
  8. Write rgbSignal to audioSignal

Also desirable:

Save images and audio to image and audio files. Load a piece of audio to the most recent samplerInstrument selection. Windowed collage of audio/image.

For the most part, working with the signal path.