respeaker / respeakerd

respeakerd is the server application for the microphone array solutions of SEEED, based on librespeaker which combines the audio front-end processing algorithms.
MIT License
54 stars 24 forks source link

Use with Picovoice #21

Open Jonas2OO3 opened 3 years ago

Jonas2OO3 commented 3 years ago

Hi,

I am currently using the 6-mic circular array with Picovoice as described here: https://github.com/Picovoice/picovoice/blob/master/demo/nodejs/mic.js - works pretty well already. However, especially when playing music at the same time, it does not always. I assume Picovoice cannot handle eight channels, so to utilize the full performance of Respeaker, respeakerd would be required?

Your documentation states that "Librespeaker is an audio processing library which can perform noise suppression, direction of arrival calculation, beamforming, hotword searching" - it seems like that would help me (except for the hotword searching that is done by Picovoice itself). I guess I need noise suppression / beamforming before the audio is sent to Picovoice.

How can I use librespeaker/respeakerd together with Picovoice? I tried using respeaker and then use node-audioworklet to read from pulse and send it to Picovoice, but I did not get it to work.