search

jekalmin / extended_openai_conversation

Home Assistant custom component of conversation agent. It uses OpenAI to control your devices.
964 stars 136 forks source link

Telling it to check if something is on turns it on #130

Open Andrei-Iosifescu123 opened 9 months ago

Andrei-Iosifescu123 commented 9 months ago

I have the latest beta installed with the default settings. Every time I tell it to "check if x is on", it turns x on, then says that x is currently off, which is not true. Sometimes it says Something went wrong: Unable to find service switch.get and sometimes even telling it to check if x is off turns x on. This is really annoying as I can't use a voice assistant without checking if it did something it wasn't supposed to do.

jekalmin commented 9 months ago

Thanks for reporting an issue!

This also happens to me, and it's not easy to get it work perfectly. There are few things we can try.

  1. Tweak prompt and function definitions
    • Although I tried gpt not to do (turn on light when I check so, it didn't work. Probably I have to build prompt from ground up again to come up with better prompt.
  2. Wait for a new smarter model to be released.
    • A new model (gpt-3.5-turbo-0125) will be released soon. Hope that it's fixed.

Contribution to prompts and functions are welcome.

Andrei-Iosifescu123 commented 9 months ago

Thanks for reporting an issue!

This also happens to me, and it's not easy to get it work perfectly. There are few things we can try.

  1. Tweak prompt and function definitions

    • Although I tried gpt not to do (turn on light when I check so, it didn't work. Probably I have to build prompt from ground up again to come up with better prompt.

  2. Wait for a new smarter model to be released.

    • A new model (gpt-3.5-turbo-0125) will be released soon. Hope that it's fixed.

Contribution to prompts and functions are welcome.

I now use gpt-4-turbo-preview and it is much better with no mistakes like this, but it is more expensive.

jekalmin commented 9 months ago

That's another way!

It seems gpt-3.5-turbo-0125 is now available. Let's try it.

mateuszdrab commented 9 months ago

I experienced that myself, since I'm using Azure - I'll need to wait a bit for that model to become available.

Another annoying thing is no matter how much I tell it not to execute services to get state of things, it initially tries to do so: Something went wrong: Service sensor.get_state not found.. Then, out of nowhere it starts to work fine and answers questions from the states table.