search

ggerganov / whisper.cpp

Port of OpenAI's Whisper model in C/C++
MIT License
35.38k stars 3.61k forks source link

Added OpenVino init on state #2464

Closed sandrohanea closed 3 weeks ago

sandrohanea commented 3 weeks ago

Hello @ggerganov, I am trying to add support for OpenVino for whisper.net and observed that the init function whisper_ctx_init_openvino_encoder can only be called on the default context-owned state which I'm not using as I manage multiple parallel states.

This PR is adding a new API function whisper_ctx_init_openvino_encoder_with_state that basically is doing the same thing on the provided state.

sandrohanea commented 3 weeks ago

I'll test this soon and will update here if everything will work as expected. Didn't expect that you'll review so fast :) Thank you!

sandrohanea commented 3 weeks ago

I'll test this soon and will update here if everything will work as expected. Didn't expect that you'll review so fast :) Thank you!

Just tested this change and now it's working as expected: image