search

krikristoophe / whisper_flutter_plus

Ready to use whisper.cpp models implementation for iOS and Android
https://pub.dev/packages/whisper_flutter_plus
MIT License
17 stars 11 forks source link

Very slow transcription. #9

Closed hussain-mustafa990 closed 11 months ago

hussain-mustafa990 commented 11 months ago

Hi, The plugins seems to be working as intended but even when using the WhisperModel.tinyEn the transcription speed is very slow. For a 2 second wav file it's taking upwards of 20 seconds. Isn't whisper.cpp quite fast then why the performance bottleneck here?

Thank you for your help.

krikristoophe commented 11 months ago

Hello, From my tests, the transcription is too slow to be usable in real time (in my own app, I display transcription to user only when available. Whisper work as a background task). Also, the speed is very dependent on 2 things : the device used and the running mode (release is much much faster than debug)

As reminder, this package is only an implementation of whisper.cpp, I'd just managed to make it work but didn't touch to whisper.cpp. I'm not really aware to the whisper functioning. If you find anything to make it work better or faster, feel free to make a PR or proposition !

Have a good day

krikristoophe commented 11 months ago

Duplicate of https://github.com/krikristoophe/whisper_flutter_plus/issues/10 I keep the other issue because there is details about the demo app that I didn't know and can be useful