Open BradyBrenot opened 6 years ago
Dropped?
Please can we get this? The screen sync is awesome, so much better than the HueSync App and i'd love to be able to do audio sync, too!
Project was on hold for a good year, it's alive again, this'll happen eventually.
Design notes
Expanding wave
I dunno
Research
Hue Sync
Audio processing research
http://www.cp.jku.at/research/papers/Boeck_Widmer_DAFx_2013.pdf / https://github.com/CPJKU/SuperFlux (normal 2-clause BSD license) / https://github.com/zsiciarz/aquila
Input
Normal input
Will use QtAudioInput for cross-platform capture from input devices (microphones, line-in, ...)
Loopback (capture from system output device)
Windows
Capture from the current output device is possible on Windows: https://msdn.microsoft.com/en-us/library/windows/desktop/dd317585(v=vs.85).aspx
Linux
No idea. QtAudioInput might be able to get a 'monitor' device from PulseAudio, or maybe Linux users can use JACK?
Android
Oddly, Android has an API to capture "low-quality audio", specifically intended for music visualizers https://developer.android.com/reference/android/media/audiofx/Visualizer.html
Processing
Total and frequency-band energy
Onset detection
Dematrixing and 2D locations