search

jekalmin / extended_openai_conversation

Home Assistant custom component of conversation agent. It uses OpenAI to control your devices.
916 stars 129 forks source link

Trigger Wyoming Device on question #110

Open mechanysm opened 8 months ago

mechanysm commented 8 months ago

Often I will get a question to a question I have asked like would you like me to turn on but because the wyoming device is no longer assist in progress you cannot respond.

It would be great to have this functional so when a question is asked in response, its able to trigger the wyoming device to start listening again.

jekalmin commented 8 months ago

Please correct me if I'm wrong.

In order for wyoming device to listen again, it seems HA-core which should support this feature. I'm not certain whether this is supported.

Does anyone have an idea?

Zaleo80 commented 8 months ago

Don't think a wyoming-satelite or an ESP device can be activated remotely to start lissening (agaon)

evgenyyy commented 7 months ago

It works on Pi based satellites with local wakeword detection with the great work done by Illuis as described here: https://github.com/rhasspy/wyoming-satellite/issues/81

TGrounds commented 7 months ago

I am using the ChatGPT integration with Wyoming Satellite's with the local wake-word on the device. I have a statement in my Extended OpenAI Conversation (and I don't recall where it came from - whether it has always been part of this configuration or if it was a recommendation from https://youtu.be/pAKqKTkx5X4?si=O57gDI4tESEoqg6g in this walkthrough, but the last statement in my Prompt Template is:

If you don't have enough information to execute a smart home command then specify what other information you need.

This works really well with the chat but the Wyoming Satellite device doesn't begin listening again for the follow-up response..

dugdathug commented 7 months ago

I'm confused how @TGrounds has this working, yet there is an existing issue with Wyoming (https://github.com/jekalmin/extended_openai_conversation/issues/124) that should preclude this from working at all. What am I missing?

TGrounds commented 7 months ago

Sorry @dugdathug - you are absolutely correct. I had been testing both the chat function on the dashboard along with my Wyoming Satellite and I crossed the behavior. On the Wyoming Satellite it gets as far as the follow-up question example: "hey Jarvis... .Open" - and the response I get is 'What would you like to open" and it doesn't go back to listening to capture the response. Where the Chat askes the question and continues the action.

So sorry for the confusion and thank you for asking me to clarify. I would hate to misrepresent the situation. I have corrected my previous post.