Whisper Out returns Gibberish

[akshaynarisetti]

At times when voice isn’t recognized properly or language spoken isn’t English, whisper throws gibberish output as transcription. Apply English filter to Whisper output to sanitize such responses.

How to this? Only permit English letters, numbers etc.. (Regex should do)

[DamienDeepgram]

Whisper will also output things like "Thanks for listening" and other weird things during silence

[ex3ndr]

This is easily solvable using whisperx

[akshaynarisetti]

That works too

[Wladefant]

@DamienDeepgram yeah that is a known bug, even the chatgpt app does that. I agree with @ex3ndr whisperx is the way moving forward for a local setup, plus other specialized services like deepgram

[akshaynarisetti]

Closing this, we are now using Deepgram.