search

Romkabouter / ESP32-Rhasspy-Satellite

The repo has implementing an esp32 standalone MQTT audio streamer. Is is desinged to work as a satellite for Rhasspy (https://rhasspy.readthedocs.io/en/latest/). It supports multiple devices
GNU General Public License v3.0
361 stars 64 forks source link

Sound Playback quality is poor #25

Closed gfawkes66 closed 3 years ago

gfawkes66 commented 4 years ago

Hello again,

I have this working quite well now, but have an issue with the audio playback.

issue:- The audio playback is hissy/crackly and of extremely poor quality. (nothing approaching the 'Alexa demo' video i have seen of yours from a while back). Sometimes i just get a hiss when something is attempted to be spoken. It sounds like there is an issue with the volume or the frequency, but i understand your software corrects the formatting/ freq etc. Mostly i hear the correct response, it just sounds awful.

I have tried:- I have turned the volume right down and i understand that your software changes the sound to the correct format. I wondered if it was latency, so i connected my wifi router directly to the 1gb switch which has the rhasppy / Homeassistant pi's. its exactly the same if i use the 3.5mm jack or the 2 speaker connectors. I have tried a couple of different speakers and also a headset. all the same. I have tried a couple of different power sources.

setup:- I think my setup is pretty much as you have given in examples in the past. Responses are called to Rhasspy by homeassistant using the rest api http://server.local:12101/api/text-to-speech?siteId={{ site }} which works fine for my pi0 satellites. I am using Mary TTS / Prudence voice. I have one pi4 which has Mary TTS and Rhasspy. Another pi4 with Homeassistant using the integrated MQTT.

I very much appreciate the assistance you have given so far. Thanks again.

Romkabouter commented 4 years ago

I also get the hissing sometimes, that seems to be a software issue. Most probably related to playing two audio buffer at the same time, but I cannot seem to find a good solution.

Do the feedback sounds sound bas as well?

gfawkes66 commented 4 years ago

Hi, yes the feedback sounds also sound bad, but not every time. I have tried the Hi/Lo beeps supplied with Rhasspy as well as a couple of phrases set at 44100 from Mary. both the same.

i have been testing with different feedback sounds, but this makes no difference either. The Hissing is not consistent, although it sounds 'ok' sometimes. Sometimes i get 2/3 response cycles with no major hissing. Sometimes, i just get a bit of a click at the end of a feedback sound or the response. Sometimes the feedback sound is replaced by a loud Hiss. Sometimes the spoken word is replaced by a loud hiss. It never goes 5 requests without a loud Hiss.

I have been using the same speaker attached to a Pi0 with a 2mic Seeed hat and that always sounds fine.

I am quite happy to try stuff if it helps and am in no rush!

Romkabouter commented 3 years ago

I am currently trying to rewrite the code, because I think this issue is caused by interfering messages. Just so you know :)

gfawkes66 commented 3 years ago

Thanks for letting me know!

Hopefully you’ll have some success without too much pain. In the meantime, Ill keep an eye on github

Thanks again.

From: Paul Romkes notifications@github.com Sent: 22 November 2020 17:31 To: Romkabouter/Matrix-Voice-ESP32-MQTT-Audio-Streamer Matrix-Voice-ESP32-MQTT-Audio-Streamer@noreply.github.com Cc: gfawkes66 gfawkes@hotmail.co.uk; Author author@noreply.github.com Subject: Re: [Romkabouter/Matrix-Voice-ESP32-MQTT-Audio-Streamer] Sound Playback quality is poor (#25)

I am currently trying to rewrite the code, because I think this issue is caused by interfering messages. Just so you know :)

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://github.com/Romkabouter/Matrix-Voice-ESP32-MQTT-Audio-Streamer/issues/25#issuecomment-731781528, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ADH3IWWH64UZ6OUMDTCLPMTSRFDGLANCNFSM4QJMGOYA.

Romkabouter commented 3 years ago

You can check out my rewrite branch, I never get it anymore, as long as the samplerate is not higher than 22050. The code will resample, which still needs some work because the quality is not very good but no hissing. I still get the same issue with high samplerates (44100), but I am not focussing on that issue. Please try the code from the rewrite branch and let me know

gfawkes66 commented 3 years ago

Hi,

I had a go but can’t get it to compile. I must admit I am a bit of an occasional coder so this is not one of my strong points, but anyway, here is the terminal output. If you see anything obvious, let me know ad I’ll try again. regards

PS C:\Users\uasername\Matrix-Voice-ESP32-MQTT-Audio-Streamer-rewrite\PlatformIO> pio run Processing esp32dev (platform: espressif32; board: esp32dev; framework: arduino) -----------------------------------------------------------------------------------------------------------------------------------------------------------------------Verbose mode can be enabled via -v, --verbose option

warning: Ignoring attempt to set reserved variable `$TARGETS' File "C:\Users\username\Matrix-Voice-ESP32-MQTT-Audio-Streamer-rewrite\PlatformIO\load_settings.py", line 36, in CONFIGURATION: https://docs.platformio.org/page/boards/espressif32/esp32dev.html PLATFORM: Espressif 32 (2.1.0) > Espressif ESP32 Dev Module HARDWARE: ESP32 240MHz, 320KB RAM, 4MB Flash DEBUG: Current (esp-prog) External (esp-prog, iot-bus-jtag, jlink, minimodule, olimex-arm-usb-ocd, olimex-arm-usb-ocd-h, olimex-arm-usb-tiny-h, olimex-jtag-tiny, tumpa) PACKAGES:

From: Paul Romkes notifications@github.com Sent: 03 January 2021 09:18 To: Romkabouter/Matrix-Voice-ESP32-MQTT-Audio-Streamer Matrix-Voice-ESP32-MQTT-Audio-Streamer@noreply.github.com Cc: gfawkes66 gfawkes@hotmail.co.uk; Author author@noreply.github.com Subject: Re: [Romkabouter/Matrix-Voice-ESP32-MQTT-Audio-Streamer] Sound Playback quality is poor (#25)

You can check out my rewrite branch, I never get it anymore, as long as the samplerate is not higher than 22050. The code will resample, which still needs some work because the quality is not very good but no hissing. I still get the same issue with high samplerates (44100), but I am not focussing on that issue. Please try the code from the rewrite branch and let me know

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHubhttps://github.com/Romkabouter/Matrix-Voice-ESP32-MQTT-Audio-Streamer/issues/25#issuecomment-753589196, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ADH3IWVPNJFMQW77XP57VETSYAY45ANCNFSM4QJMGOYA.

Romkabouter commented 3 years ago

That is because you are on windows. Change the devices/ to devices\

Romkabouter commented 3 years ago

As can be seen here, the build fail is due to windows:

https://github.com/Romkabouter/Matrix-Voice-ESP32-MQTT-Audio-Streamer/issues/32#issuecomment-759529742

Closing this