home-assistant / core

:house_with_garden: Open source home automation that puts local control and privacy first.
https://www.home-assistant.io
Apache License 2.0
74.02k stars 31.06k forks source link

Conversation Integrations Don't Trigger Sentence Automations #96046

Closed alanjames1987 closed 1 year ago

alanjames1987 commented 1 year ago

The problem

Conversation Agents from external conversation integrations, like OpenAI Conversation and Google Generative AI Conversation, don't trigger sentence based automations, bypassing the automation process entirely.

The built in conversation assistant does trigger automations but any other conversation assistant does not.

This doesn't appear to be an issue with the integrations themselves but instead the code to trigger automations based on a sentence is not happening before the integrations are called, thus bypassing the automation trigger.

What version of Home Assistant Core has the issue?

core-2023.7.1

What was the last working version of Home Assistant Core?

No response

What type of installation are you running?

Home Assistant OS

Integration causing the issue

OpenAI Conversation

Link to integration documentation on our website

https://www.home-assistant.io/integrations/openai_conversation/

Diagnostics information

No response

Example YAML snippet

No response

Anything in the logs that might be useful for us?

No response

Additional information

No response

home-assistant[bot] commented 1 year ago

Hey there @balloob, mind taking a look at this issue as it has been labeled with an integration (openai_conversation) you are listed as a code owner for? Thanks!

Code owner commands Code owners of `openai_conversation` can trigger bot actions by commenting: - `@home-assistant close` Closes the issue. - `@home-assistant rename Awesome new title` Renames the issue. - `@home-assistant reopen` Reopen the issue. - `@home-assistant unassign openai_conversation` Removes the current integration label and assignees on the issue, add the integration domain after the command.

(message by CodeOwnersMention)


openai_conversation documentation openai_conversation source (message by IssueLinks)

balloob commented 1 year ago

This is by design. Generative AI conversation agents do not currently support actions in Home Assistant.