Open AnderRedna opened 2 weeks ago
Thanks, @AnderRedna! I've confirmed with the AOAI service team that this is a known, tracked issue with the current model deployment -- output audio and transcripts can be "cut off" midway, often along with a supplementary error
message containing the rather cryptic "Response parsing interrupted" detail in the payload. The problem reproduces readily independently of client (including the playground) and occurs right around the 1200-1400 token mark.
This problem will be addressed ASAP with a deployment fix. In the interim, limiting response output (resuming across responses is fine) is the best workaround.
Thanks for the response! How can i limite response output? Im currently using the js sample.
As silly as it sounds, the model is surprisingly receptive to being asked (via user input, be it audio or text) to keep it short. E.g. here's some incremental output for the long story using the interactive .NET sample (applicable everywhere):
<<< Start of speech detected
<<< End of speech detected
>>> USER: Give me the first two sentences of a long story.
Once upon a time, in a mystical forest shrouded in mist, there was an ancient oak tree that whispered secrets of the past to those who listened closely. Legends spoke of a hidden portal within its roots that could transport one to realms beyond imagination.
<<< Start of speech detected
<<< End of speech detected
>>> USER: Give me the next two sentences.
Many had tried to find it, but only the pure of heart and those daring enough to seek the unknown could uncover its secrets. The forest was alive with the hum of magic, and the air buzzed with tales waiting to be told.
<<< Start of speech detected
<<< End of speech detected
>>> USER: the next two.
One day, a curious young adventurer named Elara, driven by tales of this enchanted portal, set forth on a journey to uncover its mysteries. With a heart full of wonder and a spirit unyielding, she ventured into the depths of the forest, guided by the whispers of the ancient oak. Little did she know, her quest would lead her to discoveries beyond her wildest dreams.
This issue is for a: (mark with an
x
)Minimal steps to reproduce
Any log messages given by the failure
Expected/desired behavior
OS and Version?
Versions
Mention any other details that might be useful