videokit-ai / videokit

Low-code, cross-platform media SDK for Unity Engine. Register at https://videokit.ai
https://videokit.ai
Apache License 2.0
108 stars 14 forks source link

Option to fetch mic data #7

Closed marvpaul closed 1 year ago

marvpaul commented 1 year ago

Feature request: In my music visualization app I use NatDevice to access the microphone and process the audio data to finally visualize it (FFT …). I also use the same audio data to feed NatCorder, so it can record the microphone audio and include it in the video. Is the same possible using VideoKit (commit audio data from NatDevice)?

Your response on discord: “ Not yet; the current API doesn't expose a way to extract the audio data while recording. I recommend opening an issue for this; we can pretty easily expose an API to allow you to receive mic audio while it's being streamed.https://github.com/natmlx/VideoKit

It would be great to have this feature - thanks!

olokobayusuf commented 1 year ago

This is in the works 😄

olokobayusuf commented 1 year ago

We've added the VideoKitAudioManager component in VideoKit 0.0.6, which exposes an OnSampleBuffer event that can be plugged into. Docs incoming.