search

collabora / WhisperFusion

WhisperFusion builds upon the capabilities of WhisperLive and WhisperSpeech to provide a seamless conversations with an AI.
1.45k stars 101 forks source link

Mac OSX apple silicon framework #14

Open jdk998 opened 5 months ago

jdk998 commented 5 months ago

Hello,

Will this run on OSX Metal or CoreML or mlx frameworks or does it require the CUDA framework?

Thank you.

makaveli10 commented 5 months ago

@jdk998 WhisperFusion doesnt support mac for running the server yet. It runs Whisper and LLM with TensorRT backend which leverages CUDA.

You could run the server on a different machine with CUDA capabilities.