rhasspy / piper

A fast, local neural text to speech system
https://rhasspy.github.io/piper-samples/
MIT License
4.38k stars 297 forks source link

Assist is translating my request, and then failing to comply #428

Closed davidrpfarinha closed 2 months ago

davidrpfarinha commented 2 months ago

Hey there,

When using Piper as source for translation of my Assist within Home Assistant, I'm using Portuguese as the language. Although, for it translates my sentence to English which then seem to make the Assist to be able to recognize the command. image

Did I misconfigure something? I don't think so, as it was working in the past, and if I run the text pipeline, it does work as expected. image

Cheers

synesthesiam commented 2 months ago

Assist doesn't translate anything, so it looks to me like everything is working correctly. A Portuguese pipeline should fail with an English sentence, no?

davidrpfarinha commented 2 months ago

What you are saying does make sense, but I have everything set to Portuguese 😅 image Just to confirm, the voice command was spoken to Piper in Portuguese, which then translated to English, and that is what you are seeing on the first screenshot.

Could I be missing something else? E.g., original configurations of piper/whisper containers? I thought that I could spin them with english as default, and then set portuguese in the configs

version: "3" services:

wyoming

whisper: container_name: whisper-english image: rhasspy/wyoming-whisper:latest command: --model base-int8 --language en volumes:

llluis commented 2 months ago

Just to confirm, the voice command was spoken to Piper in Portuguese, which then translated to English, and that is what you are seeing on the first screenshot.

That’s whisper not piper. Piper is the output which is in Portuguese.

Are you on HA 2024.3.0 ?

davidrpfarinha commented 2 months ago

Just to confirm, the voice command was spoken to Piper in Portuguese, which then translated to English, and that is what you are seeing on the first screenshot.

That’s whisper not piper. Piper is the output which is in Portuguese.

Are you on HA 2024.3.0 ?

Ohhh that’s right 🤦‍♂️ Yes, I’m. But this was already happening in the previous version.

llluis commented 2 months ago

This screenshot says PT:

image

But this EN:

image

Something seem wrong.

davidrpfarinha commented 2 months ago

This screenshot says PT:

image

But this EN:

image

Something seem wrong.

Yes, that was what I wanted to understand. Because, I did created the container as English at first, but then noticed that you can select other languages within the configurations. I thought that it could be default vs actuals. Nevertheless, I might need to create a new portuguese container, and see if that solves the issue. Thanks for your help.

llluis commented 2 months ago

In theory you are correct, the Assist pipeline config shall be able to use the settings different from the container. But I'm still intrigued how the Portuguese speech got translated to English. :D

I'm also using voice in Portuguese and this never happened.

davidrpfarinha commented 2 months ago

In theory you are correct, the Assist pipeline config shall be able to use the settings different from the container. But I'm still intrigued how the Portuguese speech got translated to English. :D

I'm also using voice in Portuguese and this never happened.

If you don't mind, can you share your Container configs? The odd thing is, I didn't change anything, as far as I can recall of course, and it was working in the past.

davidrpfarinha commented 2 months ago

Did create a new whisper container with PT as default, and that sorted out. Although, I don't understand how in the past this worked, but now is failing. 🤷‍♂️

whisper-portuguese: container_name: whisper-portuguese image: rhasspy/wyoming-whisper:latest command: --model base-int8 --language pt volumes:

davidrpfarinha commented 2 months ago

Closing this, and moving it to rhasspy/wyoming-faster-whisper.