livekit / agents

Build real-time multimodal AI applications 🤖🎙️📹
https://docs.livekit.io/agents
Apache License 2.0
4.07k stars 427 forks source link

"Conversation already has an active response" error with MultimodalAgent #1056

Open davidzhao opened 2 weeks ago

davidzhao commented 2 weeks ago

We've gotten reports in Slack that when certain function calls are used with MultimodalAgent, it would sometimes error out with:

2024-11-07 17:14:37,898 - ERROR livekit.plugins.openai.realtime - OpenAI S2S error {'type': 'error', 'event_id': 'event_AR7s53avu18NBq2Lk5O4r', 'error': {'type': 'invalid_request_error', 'code': None, 'message': 'Conversation already has an active response', 'param': None, 'event_id': None}} {"session_id": "sess_AR7r1ss6nsPVlPETCgFxi"}

It'd be great if anyone could produce a path to reproducing the error.

yepher commented 5 days ago

I've been getting this error quite a bit recently. I feel like it happens more when I give a pretty long-winded response to the LLM.