Trouble Incorporating Into Voice Assistant Pipeline

[Dborasik]

My ultimate goal here is to use this in combination with a voice assistant I interact with over a VoIP device.

As of now, however, whenever I pick up my VoIP phone to speak to the assistant, I just get a voice notification saying that the request to OpenAI is bad (400). There is additional messaging that plays afterwards but it consists of mainly special characters obviously meant to be viewed on a screen. I can attempt to recover more of the message if necessary, but I can definitely say that a key word in the error message is “VoIP Phone”.

[TBTHEDBA]

This is also my goal. I just ordered a Grandstream HT801 Single-Port Analog Telephone Adapter. I am eager to see what comes of this.

[Dborasik]

This is also my goal. I just ordered a Grandstream HT801 Single-Port Analog Telephone Adapter. I am eager to see what comes of this.

I wish you the best of luck in this endeavour and hope it isn't as challenging for you as it has been for me. I'm using a phone built for VoIP, so I wonder if our different configurations will yield different results.

Bonus points if you're able to update back here once you've got the Grandstream to tell how it went 🙂

[TBTHEDBA]

I'm retrofitting an old turn-dial phone that used to hang in my grandparents garage. Going to put it in my kids room so they can talk to "characters" and control things in their room.

On Tue, Jan 16, 2024 at 11:52 AM Daniel @.***> wrote:

This is also my goal. I just ordered a Grandstream HT801 Single-Port Analog Telephone Adapter. I am eager to see what comes of this.

I wish you the best of luck in this endeavour and hope it isn't as challenging for you as it has been for me. I'm using a phone built for VoIP, so I wonder if our different configurations will yield different results.

Bonus points if you're able to update back here once you've got the Grandstream to tell how it went 🙂

— Reply to this email directly, view it on GitHub https://github.com/jekalmin/extended_openai_conversation/issues/101#issuecomment-1894228800, or unsubscribe https://github.com/notifications/unsubscribe-auth/AJXIGPQSCQZRONLOJDMIGULYO245VAVCNFSM6AAAAABB4JVGM6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOJUGIZDQOBQGA . You are receiving this because you commented.Message ID: @.***>

[Dborasik]

I'm retrofitting an old turn-dial phone that used to hang in my grandparents garage. Going to put it in my kids room so they can talk to "characters" and control things in their room.

That's a really cool idea! I love to see old technology being given a modern purpose. Turn-dial is even cooler, and I'm interested to know how it'll work out for you.

[Dborasik]

I believe I have located the issue: When the "Attach Username to Message" setting is disabled, I can pick up the phone and speak to the AI perfectly fine. I believe this is because the VoIP phone is not directly associated with any particular user, so I have no idea what is being passed to the assistant when this setting is enabled.

Edit: Upon further testing, I have discovered that asking for user-specific actions or information with the "Attach Username to Message" setting disabled leads to the assistant not replying with anything regardless of what I instruct it to do. In the case of the phone, the assistant simply stays silent until it is ready to listen again and the UI just displays a blank text bubble.

[TBTHEDBA]

Hopefully there will be able to be a way to denote which GPT profile my phone is calling so I can lock down permissions/functions that my daughter will have access to. I'll have to see when I start developing.

On Tue, Jan 16, 2024 at 1:18 PM Daniel @.***> wrote:

I believe I have located the issue: When the "Attach Username to Message" setting is disabled, I can pick up the phone and speak to the AI perfectly fine. I believe this is because the VoIP phone is not directly associated with any particular user, so I have no idea what is being passed to the assistant when this setting is enabled.

— Reply to this email directly, view it on GitHub https://github.com/jekalmin/extended_openai_conversation/issues/101#issuecomment-1894363791, or unsubscribe https://github.com/notifications/unsubscribe-auth/AJXIGPTKB7A4B2F4KUXZ3IDYO3G6ZAVCNFSM6AAAAABB4JVGM6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOJUGM3DGNZZGE . You are receiving this because you commented.Message ID: @.***>

[hobbyboy]

This is also my goal. I just ordered a Grandstream HT801 Single-Port Analog Telephone Adapter. I am eager to see what comes of this.

I've had this going for a few months. Following a Youtube for this was very easy to get going. I'm using it with a FastChatGPT pipeline with no problems.

[jekalmin]

Thanks for reporting an issue.

Is there any error message? Possibly related to https://github.com/jekalmin/extended_openai_conversation/issues/63?

[Dborasik]

Thanks for reporting an issue.

Is there any error message? Possibly related to #63?

Please excuse my extremely late reply.

I don't have any written error messages to provide, I'm afraid. The assistant speaks an error out loud which details that the username being passed as an argument is invalid. I'm assuming it's passing the name of my VoIP phone as the username, at which point Home Assistant recognizes that something is wrong and it returns a verbal error.

The issue you have provided is, although under a different context, pretty similar to what I'm having trouble with. It may be worth a look.

[Dborasik]

I've had this going for a few months. Following a Youtube for this was very easy to get going. I'm using it with a FastChatGPT pipeline with no problems.

Just out of curiosity, what are the benefits to running FastChatGPT? How has your experience been in terms of setup and day-to-day use?