home-assistant / core

:house_with_garden: Open source home automation that puts local control and privacy first.
https://www.home-assistant.io
Apache License 2.0
70.08k stars 29.15k forks source link

Google Gen AI: only executes first tool call #118202

Closed balloob closed 1 month ago

balloob commented 2 months ago

The problem

When talking to the LLM and Google wants to call multiple tools, only the first tool is executed.

What version of Home Assistant Core has the issue?

core-dev20240526

What was the last working version of Home Assistant Core?

No response

What type of installation are you running?

Home Assistant OS

Integration causing the issue

google_generative_ai_conversation

Link to integration documentation on our website

https://www.home-assistant.io/integrations/google_generative_ai_conversation/

Diagnostics information

No response

Example YAML snippet

No response

Anything in the logs that might be useful for us?

2024-05-27 01:14:50.051 DEBUG (MainThread) [homeassistant.components.google_generative_ai_conversation] Response: [function_call {
  name: "HassTurnOff"
  args {
    fields {
      key: "name"
      value {
        string_value: "Ceiling Lights"
      }
    }
  }
}
, function_call {
  name: "HassTurnOff"
  args {
    fields {
      key: "name"
      value {
        string_value: "Bed Light"
      }
    }
  }
}
]
2024-05-27 01:14:50.052 DEBUG (MainThread) [homeassistant.components.google_generative_ai_conversation] Tool call: HassTurnOff({'name': 'Ceiling Lights'})

Additional information

No response

home-assistant[bot] commented 2 months ago

Hey there @tronikos, mind taking a look at this issue as it has been labeled with an integration (google_generative_ai_conversation) you are listed as a code owner for? Thanks!

Code owner commands Code owners of `google_generative_ai_conversation` can trigger bot actions by commenting: - `@home-assistant close` Closes the issue. - `@home-assistant rename Awesome new title` Renames the issue. - `@home-assistant reopen` Reopen the issue. - `@home-assistant unassign google_generative_ai_conversation` Removes the current integration label and assignees on the issue, add the integration domain after the command. - `@home-assistant add-label needs-more-information` Add a label (needs-more-information, problem in dependency, problem in custom component) to the issue. - `@home-assistant remove-label needs-more-information` Remove a label (needs-more-information, problem in dependency, problem in custom component) on the issue.

(message by CodeOwnersMention)


google_generative_ai_conversation documentation google_generative_ai_conversation source (message by IssueLinks)