argmaxinc / WhisperKit

On-device Speech Recognition for Apple Silicon
https://takeargmax.com/blog/whisperkit
MIT License
3.17k stars 268 forks source link

Tokenizer refactor, tests cleanup #87

Closed jkrukowski closed 6 months ago

jkrukowski commented 6 months ago

Based on a discussion with @ZachNagengast in https://github.com/argmaxinc/WhisperKit/pull/45 this PR introduces: