search

toverainc / willow-inference-server

Open source, local, and self-hosted highly optimized language inference server supporting ASR/STT, TTS, and LLM across WebRTC, REST, and WS
Apache License 2.0
373 stars 33 forks source link

Adding Distil-Whisper #137

Open strich opened 10 months ago

strich commented 10 months ago

Thought I'd add an issue here for adding Distil-Whisper to use in this project as it looks very promising.

kristiankielhofner commented 10 months ago

I made sure to be up nice and early for when the weights are released today!

After some validation testing we'll be adding support for it.

Note that it is only available in medium (English only) and large.

kristiankielhofner commented 10 months ago

distil-whisper is only available in medium.en and large-v2 currently. WIS doesn't have the concept of an English only model (I'll work on this) but if you want to test large-v2 it is available.

Put that in your WIS models/tovera-wis-whisper-large-v2 directory and restart WIS.