Open needsmorejpeg opened 2 weeks ago
I noticed similar behavior already after a couple of questions. In the beginning, the assistant is absolutely on point, but it significantly degrades after a few ping pongs... it even says "Goodbye" out of nowhere.
I've noticed that when testing out my assistant, it tends to do a great job following the instructions in my system prompt for the first 1-2 minutes of a call. Then, as we start getting to minutes 3-5, it will make mistakes that are specifically addressed in the prompt. Has anyone else noticed the performance get worse over time?
I'm wondering if this has to do with how the context / state is managed internally to the API. I assume the system prompt is always maintained, while the audio stream starts dropping old audio (in a FIFO manner)?
I see this in the API docs:
And just want to confirm that the "heuristic-based algorithm" will always include the system instructions. Any extra detail you can provide is helpful, too!