Microphone.Start Replacement

[BenWindley]

Hey! I was wondering if you have a replacement for Microphone.Start? Since I'm not sure how to make it record audio yet since the demo only has audio volumes.

[chopin1998]

same problem..

[iamkim17]

any news from how to call the microphone.start?

[tgraupmann]

I actually had success using the Recorder.js library. It has a nice recorder with start, stop, clear, and getBuffer methods. I used it to capture Microphone data that feeds directly into the Whisper AI model for speech detection and it works flawlessly for multiple languages. https://github.com/tgraupmann/ChromeOS_Whisper/blob/main/Server.html

[muhammadabdigit]

Dear Timothy, I hope you are great.

First of all, thanks for sharing your Unity WebGL Recorder and I'm also glad to hear that you were able to integrate it with Whisper. I would really appreciate it if you could share with us some information about how to use this recorder in Unity WebGL. I look forward to hearing from you.

with all respect, Muhammad

[iamkim17]

Hi @tgraupmann

Thank you for providing us with the details, but may I know how to create a jslib from this so that I can access it through unity? sorry, still learning javascript

[tgraupmann]

You can see sample JSLib code here - https://github.com/tgraupmann/UnityWebGLMicrophone/blob/master/Assets/Plugins/WebGL/MicrophonePlugin.jslib

The syntax is similar to HTML5 with slightly different syntax for passing strings between Unity C# classes and the JS code.

[iamkim17]

Thank you @tgraupmann . I can see that its similar syntax with your Server.html. It makes sense now.

Thank you again!

[iamkim17]

Hi again @tgraupmann I tried editing the MicrophonePlugin.jslib to the one you used in whisper AI, but I have no luck. Do you have any plugin just we can buy or free to use? I've been looking for a solution for almost 1 month. Thanks!

[tgraupmann]

I don't always see Github notifications. Ping me on Discord - Tim Graupmann#0611

[StephenHodgson]

Bumping this for interest

[tgraupmann]

I'll need this logic as well. I need to make an AI model for audio detection and then I'll need to update the Microphone JS library.

[tgraupmann]

I added some visualization for the volume data and wave data. https://github.com/tgraupmann/UnityWebGLMicrophone/blob/master/Test/index.html

The raw data for your audio clip is in document.dataArray.

[tgraupmann]

It looks like the browser encodes audio in audio/webm format so you have to use an analyzer to get the raw wave data. To get the data available events to fire, I needed to start and stop the audio source. As long as all the data keeps getting appended to an array, it should be ready for an audio clip if you slice the extracted data as it is being read.

[StephenHodgson]

That's been my problem too, getting the data usable to be set in the audio clip PCM data