rhasspy / wyoming-satellite

Remote voice satellite using Wyoming protocol
MIT License
609 stars 89 forks source link

wyoming satellite less accurate than assist microphone addon #103

Open Greylinux opened 7 months ago

Greylinux commented 7 months ago

so I'm having an issue with the accuracy of the wyoming satellite.

The setup I have is, a anker powerconf S330 connected directly to my Beelink Se12 running HAOS, Rhasspy repo version of Assist microphone addon and whisper, piper, openwakeword running as addons also.

The satellite is a Raspberry pi 4 also with a anker powerconf S330 connected, I used the installer to setup the satellite with the recommended settings from the tutorial.

The conference speaker connected directly to my HAOS server has near 99% accuracy and is super fast which is great, the satellite however has closer to 50% accuracy.

this is the whisper log for the connected conference speaker :

INFO:wyoming_faster_whisper.handler: Turn on living room side light. INFO:wyoming_faster_whisper.handler: Turn on living room sofa light. INFO:wyoming_faster_whisper.handler: Turn on Dining Room Light. INFO:wyoming_faster_whisper.handler: Turn on bedroom light. INFO:wyoming_faster_whisper.handler: Turn on at spare room at light. INFO:wyoming_faster_whisper.handler: Turn on spare room light. INFO:wyoming_faster_whisper.handler: Turn on wardrobe light. INFO:wyoming_faster_whisper.handler: Turn on landing light. INFO:wyoming_faster_whisper.handler: Turn on hallway light. INFO:wyoming_faster_whisper.handler: Turn on kitchen light. INFO:wyoming_faster_whisper.handler: Turn on power socket. INFO:wyoming_faster_whisper.handler: Turn on PowerSocket 2. INFO:wyoming_faster_whisper.handler: Turn on PowerSocket 2. INFO:wyoming_faster_whisper.handler: Turn on switch 2. INFO:wyoming_faster_whisper.handler: Turn on PowerSocket 2

this is the log for the wyoming satellite

INFO:wyoming_faster_whisper.handler: Turn off living room side light. INFO:wyoming_faster_whisper.handler: turn off living room sofa light. INFO:wyoming_faster_whisper.handler: Turn off dining room light. INFO:wyoming_faster_whisper.handler: Turn off bedroom light. INFO:wyoming_faster_whisper.handler: off wardrobe light. INFO:wyoming_faster_whisper.handler: turn off wardrobe light. INFO:wyoming_faster_whisper.handler: off landing light. INFO:wyoming_faster_whisper.handler: of landing light. INFO:wyoming_faster_whisper.handler: off land in light. INFO:wyoming_faster_whisper.handler: off hallway light. INFO:wyoming_faster_whisper.handler: Turn off hallway light. INFO:wyoming_faster_whisper.handler: Burn off kitchen light. INFO:wyoming_faster_whisper.handler: of land in light. INFO:wyoming_faster_whisper.handler: Turn off landing light. INFO:wyoming_faster_whisper.handler: of kitchen light. INFO:wyoming_faster_whisper.handler: of kitchen light. INFO:wyoming_faster_whisper.handler: Turn off. INFO:wyoming_faster_whisper.handler: an off-kitchen light. INFO:wyoming_faster_whisper.handler: of kitchen light. INFO:wyoming_faster_whisper.handler: and off kitchen light. INFO:wyoming_faster_whisper.handler: Turn off kitchen light. INFO:wyoming_faster_whisper.handler: turn off the spare room light. INFO:wyoming_faster_whisper.handler: on Living Room Lamp. INFO:wyoming_faster_whisper.handler: on dining room lamp. INFO:wyoming_faster_whisper.handler: Turn on living room lamp.

The settings I have for the assist microphone addon are :

VAD : silero Noise suppression: 2 Auto-gain: 15 Volume multiplier: 1

The settings for the satellite using the installer

VAD: ? Noise suppression: medium Auto-gain:15 Volume Multiplier: 0.1 ( in HA device settings) 1.0 in (satellite installer settings) not sure whats going on here or if its even the same thing as its called MIc volume in HA Device settings. I did try changing it to 10 ( the max) in HA device settings with no advantage.

Any idea why the big difference in accuracy?

Greylinux commented 7 months ago

After watching the latest HA year of the voice 6 I had an idea related to this issue, my suspicion looking at the log is that its the delay after the wake word is spoken to streaming commands to HA. If I pause longer than I do with the directly connected speaker it doesn't cut off the first word and therefore the accuracy of the satellite is as good as the direct speaker. Is there a way to change the delay after the wake word is spoken using the installer?

tbutcher365 commented 5 months ago

I have the same experience, it would be useful to reduce the delay.