search

collabora / WhisperFusion

WhisperFusion builds upon the capabilities of WhisperLive and WhisperSpeech to provide a seamless conversations with an AI.
1.5k stars 109 forks source link

Whisper Live ONNX Runtime Error #54

Closed rahulanand2 closed 4 weeks ago

rahulanand2 commented 1 month ago

VAD model gives the below error on start of transcription. INVALID_PROTOBUF : Load model from /root/.cache/whisper-live/silero_vad.onnx failed:Protobuf parsing failed.

ali8molaee commented 1 month ago

see this: https://github.com/livekit/agents/issues/420

ali8molaee commented 1 month ago

I used this method and it solved temporarily:

docker compose up -d --build
docker compose exec whisperfusion bash

and 

cd .cache/whisper-live/
rm silero_vad.onnx
wget https://github.com/snakers4/silero-vad/raw/v4.0/files/silero_vad.onnx

Then exit the terminal and the system works properly

ali8molaee commented 1 month ago

You can simply edit this file:

docker/scripts/setup-whisperfusion.sh:22 to

curl -L -o /root/.cache/whisper-live/silero_vad.onnx https://github.com/snakers4/silero-vad/raw/v4.0/files/silero_vad.onnx