Kindly add OpenVINO backend support

[gericho]

Will it be possible to add OpenVINO support for Intel-based processors? The repo by @zhuzilin here shows a speed improvement of nearly 50%, so users will be able to use larger models without sacrificing current performance. Thank you!

[zachs-55]

You can use OpenVINO with whisper.cpp (I personally found using CLBlast instead was a little faster on my weak Celeron n5095, though): https://github.com/ggerganov/whisper.cpp#openvino-support

Then you can use this for a Wyoming endpoint: https://github.com/ser/wyoming-whisper-api-client

[gericho]

Thank you very much, I'll give it a try soon!

[tannisroot]

faster-whisper uses CTranslate2 which doesn't have OpenVino support.