Audio processing - Githubissues

playasophy / wonderdome

Codebase for the Playasophy Wonderdome project

The Unlicense

10 stars 1 forks source link

Audio processing #3

Open greglook opened 10 years ago

greglook commented 10 years ago

Use Minim (or some equivalent library) to provide audio-processing to the wonderdome. This will ideally provide both beat-detection and very basic frequency power bands via the Fourier transform. This is likely to be performance intensive, so will need lots of tuning.

This component would be another type of input, which would send events like the following:

{:type :audio/beat
 :power 0.8444}

{:type :audio/freq
 :elapsed 138 ; ms
 :power [0.662, 0.328, 0.153, 0.989, ...]}

greglook commented 10 years ago

Looks like someone put 2.2.0 on clojars already: https://clojars.org/ddf.minim

greglook commented 10 years ago

Needs to be fleshed out more, but basic audio input is in! c187014677edb32137c02d2003fedcfad7a654c0

Next steps:

[x] Wire it up to the rest of the system during construction.
[x] Polish the test harness code.
[x] Experiment with windowing functions in the FFT.
[ ] Experiment with rolling-average power levels rather than instantaneous values.

greglook commented 10 years ago

Two more tasks:

[x] Install the physical microphone
[ ] Write a tunes mode which responds to audio input as a proof-of-concept