home-assistant / core

:house_with_garden: Open source home automation that puts local control and privacy first.
https://www.home-assistant.io
Apache License 2.0
73.58k stars 30.75k forks source link

Pipeline assist events not firing #124972

Open theGENreel opened 2 months ago

theGENreel commented 2 months ago

The problem

Pipeline assist component not firing PipelineEvent events. I tried to listen events run-start, stt-start, tts-start in developer tools and nothing appears after pipeline do full cycle. Test automation triggered by this events do nothing either. There's no traces or something that can help to define a problem, events just not working

What version of Home Assistant Core has the issue?

core-2024.8.3

What was the last working version of Home Assistant Core?

No response

What type of installation are you running?

Home Assistant Container

Integration causing the issue

assist_pipeline

Link to integration documentation on our website

https://developers.home-assistant.io/docs/voice/pipelines/

Diagnostics information

I can see events in the raw pipeline data. pipeline_data.txt

Example YAML snippet

No response

Anything in the logs that might be useful for us?

No response

Additional information

Assist pipeline configuration:

Conversation agent: Extended OpenAI Conversation STT: GroqCloud Whisper TTS: Microsoft Edge TTS Wake word: OpenWakeWord

home-assistant[bot] commented 2 months ago

Hey there @balloob, @synesthesiam, mind taking a look at this issue as it has been labeled with an integration (assist_pipeline) you are listed as a code owner for? Thanks!

Code owner commands Code owners of `assist_pipeline` can trigger bot actions by commenting: - `@home-assistant close` Closes the issue. - `@home-assistant rename Awesome new title` Renames the issue. - `@home-assistant reopen` Reopen the issue. - `@home-assistant unassign assist_pipeline` Removes the current integration label and assignees on the issue, add the integration domain after the command. - `@home-assistant add-label needs-more-information` Add a label (needs-more-information, problem in dependency, problem in custom component) to the issue. - `@home-assistant remove-label needs-more-information` Remove a label (needs-more-information, problem in dependency, problem in custom component) on the issue.

(message by CodeOwnersMention)


assist_pipeline documentation assist_pipeline source (message by IssueLinks)

synesthesiam commented 2 months ago

These events are internal to the pipeline. They are not events on the Home Assistant bus.

theGENreel commented 2 months ago

These events are internal to the pipeline. They are not events on the Home Assistant bus.

Ahh I get it now. That's sad. Is there any way to read pipeline states other than through the assist_in_progress entity?

synesthesiam commented 2 months ago

There will be. We are working on a new entity type for Assist satellites that will have states mirroring the pipeline. Is there something specific you're trying to do?

BjornPython commented 1 month ago

Hi, just my two cents on this thread.

I think being able to listen to these events would make it easier for us to implement our custom features using the websocket.

regarding:

Is there something specific you're trying to do

for my case, I'd like to flash a certain light when the run-start event is fired. as far as I know, this is not possible to do using the web UI.

Spherell commented 5 days ago

Is there something specific you're trying to do?

in my case, I have a USB LED ring connected to my device running Home Assistant. I want to use the events to trigger prepared Python scripts from automations that send corresponding animations to the ring to make the conversation more intuitive via visual signals, as my roommate is hearing impaired.