argmaxinc / WhisperKit

On-device Speech Recognition for Apple Silicon
https://takeargmax.com/blog/whisperkit
MIT License
3.17k stars 267 forks source link

MLX model support #124

Open ZachNagengast opened 5 months ago

ZachNagengast commented 5 months ago

Draft PR for the early stages of supporting MLX based whisper models directly in WhisperKit. (To be updated)

Initial TODOs:

ZachNagengast commented 4 months ago

@jkrukowski relevant: https://ml-explore.github.io/mlx/build/html/install.html#binary-size-minimization

We'll want to minimize the binary size as much as reasonable for iOS deployment