search

matatonic / openedai-whisper

An OpenAI API compatible speech to text server for audio transcription and translations, aka. Whisper.
GNU Affero General Public License v3.0
28 stars 6 forks source link

Insanely-fast-whisper support #3

Open lojik-ng opened 2 months ago

lojik-ng commented 2 months ago

Please add support for insanely-fast-whisper or faster-whisper

johnyu0 commented 1 month ago

Could you please support SenseVoiceSmall and paraformer-zh-streaming ? Wisper’s accuracy in recognizing Chinese is too poor.

ayancey commented 1 month ago

You may consider this project: https://github.com/ahmetoner/whisper-asr-webservice

We do not have OpenAI compatible endpoints yet but working on it!

matatonic commented 1 month ago

I've never used it, but just FYI, this exists: https://github.com/fedirz/faster-whisper-server which supports the openai api.

matatonic commented 1 day ago

FYI: https://github.com/vllm-project/vllm/issues/180 whisper (and encoder-decoder models) to be added to vllm.

I probably wont update this repo much after that, assuming the implementation is good, it would be the preferred way to run open source whisper models with an openai api.