It would be great if the first text token's logprob can be used to discard a transcription draft as failed and start over. Start over could mean either falling back to a higher temperature sampling or updating the audio buffer for streaming use cases.
It would be great if the first text token's logprob can be used to discard a transcription draft as failed and start over. Start over could mean either falling back to a higher temperature sampling or updating the audio buffer for streaming use cases.