search

sshh12 / llm_convo

Use ChatGPT over Twilio to create an AI phone agent (works for incoming or outgoing calls).
MIT License
89 stars 19 forks source link

Not a bug/issue but more like a feature request. #9

Open Shakirsadiq6 opened 3 weeks ago

Shakirsadiq6 commented 3 weeks ago

As we are using the openai, sometimes the responses are long and the caller has to wait for the response to be completed. Could we use the streaming feature of the openai? If yes, how? I was trying to do it with the streaming feature but couldn’t achieve it correctly.

sshh12 commented 3 weeks ago

Definitely possible to at least stream the openai response into an TTS response (I do it in my project here https://github.com/sshh12/llm-chat-web-ui/tree/main/modal. However, not sure how well the twilio API would support something like that (although haven't looked).