search

sandrohanea / whisper.net

Whisper.net. Speech to text made simple using Whisper Models
MIT License
512 stars 78 forks source link

Whisper parameter tweaks for hallucinations / ghosting #102

Closed Karrde1984 closed 10 months ago

Karrde1984 commented 11 months ago

Hi There are some discussions about those ghost transcriptions with whisper and there are some parameter tweaks around, which reduces those hallucinations by ~90%. The most important parameter is called „condition_on_previous_text“. But that parameter is nowhere to see in whisper.net. Can you include that parameter anytime soon? I think it is highly important

You can follow the discussion about that topic here: https://github.com/openai/whisper/discussions/679

What do you mean?

sandrohanea commented 10 months ago

Unfortunately, that parameter is not added in https://github.com/ggerganov/whisper.cpp/tree/master and this library is a wrapper for whisper.cpp.

If that option would be added there, it will be added in this library as well automatically in order to update to latest version, but for now, there is not much we can do here.

Karrde1984 commented 10 months ago

Thanks for your answer. So i will ask the question @ whisper.cpp as well, as it is very important parameter setting. it reduces those hallucinations heavily and we cant see any relevant negativ side effects.

dfengpo commented 5 months ago

If you don't have this parameter, have you solved your hallucination problem so far? I often encounter hallucination problems and haven't found a solution yet

@Karrde1984