xenova
commented
5 months ago Hey! This is indeed possible now!
-
HF Space: https://huggingface.co/spaces/Xenova/realtime-whisper-webgpu
-
Source code: https://github.com/xenova/transformers.js/tree/v3/examples/webgpu-whisper
-
Video:
Many optimizations still possible, but it's a good starting point!
Hey @xenova do you think this will be supported in the future? Thanks!