t41372 / Open-LLM-VTuber

Talk to any LLM with hands-free voice interaction, voice interruption, Live2D taking face, and long-term memory running locally across platforms
MIT License
460 stars 51 forks source link

i watch UI but don't work, can't talk, server fail in tts. #18

Open sontoriyama opened 4 days ago

sontoriyama commented 4 days ago

I have ollama and miniconda in i7 7gen, 1070gtx, 16gb ram.

I change configs yaml like medium.en for medium (because i wan speak in spanish), and change sites "en" for "es". But for in local can have good tts in spanish i don't know what i will have. Sorry for my english, i'm spanish ;)

error: (vt) C:\eines\llm-amb-config-fastwhisperetc-tts-detotscolors-ollama-animee\Open-LLM-VTuber>python server.py INFO: Started server process [10100] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://localhost:12393 (Press CTRL+C to quit) INFO: ::1:57092 - "GET / HTTP/1.1" 304 Not Modified INFO: ('::1', 57094) - "WebSocket /client-ws" [accepted] INFO: connection open Connection established Model Information Loaded. Model Information Loaded. config.json: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2.26k/2.26k [00:00<?, ?B/s] vocabulary.txt: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████| 460k/460k [00:00<00:00, 1.55MB/s] tokenizer.json: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2.20M/2.20M [00:00<00:00, 4.28MB/s] model.bin: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1.53G/1.53G [00:35<00:00, 42.9MB/s] Error: Piper TTS voice model not found at path "./models/piper_voice/es_ES-amy-medium.onnx" Downloading the default voice model... Downloading from https://huggingface.co/rhasspy/piper-voices/resolve/v1.0.0/en/en_US/amy/medium/en_US-amy-medium.onnx ERROR: Exception in ASGI application Traceback (most recent call last): File "C:\programes\miniconda3\envs\vt\lib\site-packages\uvicorn\protocols\websockets\websockets_impl.py", line 244, in run_asgi result = await self.app(self.scope, self.asgi_receive, self.asgi_send) # type: ignore[func-returns-value] File "C:\programes\miniconda3\envs\vt\lib\site-packages\uvicorn\middleware\proxy_headers.py", line 70, in call return await self.app(scope, receive, send) File "C:\programes\miniconda3\envs\vt\lib\site-packages\fastapi\applications.py", line 1054, in call await super().call(scope, receive, send) File "C:\programes\miniconda3\envs\vt\lib\site-packages\starlette\applications.py", line 113, in call await self.middleware_stack(scope, receive, send) File "C:\programes\miniconda3\envs\vt\lib\site-packages\starlette\middleware\errors.py", line 152, in call await self.app(scope, receive, send) File "C:\programes\miniconda3\envs\vt\lib\site-packages\starlette\middleware\exceptions.py", line 62, in call await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send) File "C:\programes\miniconda3\envs\vt\lib\site-packages\starlette_exception_handler.py", line 62, in wrapped_app raise exc File "C:\programes\miniconda3\envs\vt\lib\site-packages\starlette_exception_handler.py", line 51, in wrapped_app await app(scope, receive, sender) File "C:\programes\miniconda3\envs\vt\lib\site-packages\starlette\routing.py", line 715, in call await self.middleware_stack(scope, receive, send) File "C:\programes\miniconda3\envs\vt\lib\site-packages\starlette\routing.py", line 735, in app await route.handle(scope, receive, send) File "C:\programes\miniconda3\envs\vt\lib\site-packages\starlette\routing.py", line 362, in handle await self.app(scope, receive, send) File "C:\programes\miniconda3\envs\vt\lib\site-packages\starlette\routing.py", line 95, in app await wrap_app_handling_exceptions(app, session)(scope, receive, send) File "C:\programes\miniconda3\envs\vt\lib\site-packages\starlette_exception_handler.py", line 62, in wrapped_app raise exc File "C:\programes\miniconda3\envs\vt\lib\site-packages\starlette_exception_handler.py", line 51, in wrapped_app await app(scope, receive, sender) File "C:\programes\miniconda3\envs\vt\lib\site-packages\starlette\routing.py", line 93, in app await func(session) File "C:\programes\miniconda3\envs\vt\lib\site-packages\fastapi\routing.py", line 383, in app await dependant.call(solved_result.values) File "C:\eines\llm-amb-config-fastwhisperetc-tts-detotscolors-ollama-animee\Open-LLM-VTuber\server.py", line 94, in websocket_endpoint self.open_llm_vtuber = OpenLLMVTuberMain(self.open_llm_vtuber_config) File "C:\eines\llm-amb-config-fastwhisperetc-tts-detotscolors-ollama-animee\Open-LLM-VTuber\main.py", line 73, in init self.tts = self.init_tts() File "C:\eines\llm-amb-config-fastwhisperetc-tts-detotscolors-ollama-animee\Open-LLM-VTuber\main.py", line 133, in init_tts tts = TTSFactory.get_tts_engine(tts_model, tts_config) File "C:\eines\llm-amb-config-fastwhisperetc-tts-detotscolors-ollama-animee\Open-LLM-VTuber\tts\tts_factory.py", line 43, in get_tts_engine return PiperTTSEngine(voice_path=kwargs.get("voice_model_path"), verbose=kwargs.get("verbose")) File "C:\eines\llm-amb-config-fastwhisperetc-tts-detotscolors-ollama-animee\Open-LLM-VTuber\tts\piperTTS.py", line 26, in init scripts.install_piper_tts.download_default_model() File "C:\eines\llm-amb-config-fastwhisperetc-tts-detotscolors-ollama-animee\Open-LLM-VTuber\scripts\install_piper_tts.py", line 203, in download_default_model download_file(default_voice_model_url, voice_model_path) File "C:\eines\llm-amb-config-fastwhisperetc-tts-detotscolors-ollama-animee\Open-LLM-VTuber\scripts\install_piper_tts.py", line 44, in download_file with open(save_path, "wb") as f: FileNotFoundError: [Errno 2] No such file or directory: 'C:\eines\llm-amb-config-fastwhisperetc-tts-detotscolors-ollama-animee\Open-LLM-VTuber\models\piper_voice\en_US-amy-medium.onnx' INFO: ('::1', 57137) - "WebSocket /client-ws" [accepted] INFO: ('127.0.0.1', 57268) - "WebSocket /client-ws" [accepted] INFO: connection closed INFO: connection closed INFO: connection closed ERROR: Exception in ASGI application Traceback (most recent call last): File "C:\programes\miniconda3\envs\vt\lib\site-packages\uvicorn\protocols\websockets\websockets_impl.py", line 332, in asgi_send await self.send(data) # type: ignore[arg-type] File "C:\programes\miniconda3\envs\vt\lib\site-packages\websockets\legacy\protocol.py", line 630, in send await self.ensure_open() File "C:\programes\miniconda3\envs\vt\lib\site-packages\websockets\legacy\protocol.py", line 931, in ensure_open raise self.connection_closed_exc() websockets.exceptions.ConnectionClosedError: no close frame received or sent

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "C:\programes\miniconda3\envs\vt\lib\site-packages\starlette\websockets.py", line 85, in send await self._send(message) File "C:\programes\miniconda3\envs\vt\lib\site-packages\starlette_exception_handler.py", line 48, in sender await send(message) File "C:\programes\miniconda3\envs\vt\lib\site-packages\uvicorn\protocols\websockets\websockets_impl.py", line 345, in asgi_send raise ClientDisconnected from exc uvicorn.protocols.utils.ClientDisconnected

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "C:\programes\miniconda3\envs\vt\lib\site-packages\uvicorn\protocols\websockets\websockets_impl.py", line 244, in run_asgi result = await self.app(self.scope, self.asgi_receive, self.asgi_send) # type: ignore[func-returns-value] File "C:\programes\miniconda3\envs\vt\lib\site-packages\uvicorn\middleware\proxy_headers.py", line 70, in call return await self.app(scope, receive, send) File "C:\programes\miniconda3\envs\vt\lib\site-packages\fastapi\applications.py", line 1054, in call await super().call(scope, receive, send) File "C:\programes\miniconda3\envs\vt\lib\site-packages\starlette\applications.py", line 113, in call await self.middleware_stack(scope, receive, send) File "C:\programes\miniconda3\envs\vt\lib\site-packages\starlette\middleware\errors.py", line 152, in call await self.app(scope, receive, send) File "C:\programes\miniconda3\envs\vt\lib\site-packages\starlette\middleware\exceptions.py", line 62, in call await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send) File "C:\programes\miniconda3\envs\vt\lib\site-packages\starlette_exception_handler.py", line 62, in wrapped_app raise exc File "C:\programes\miniconda3\envs\vt\lib\site-packages\starlette_exception_handler.py", line 51, in wrapped_app await app(scope, receive, sender) File "C:\programes\miniconda3\envs\vt\lib\site-packages\starlette\routing.py", line 715, in call await self.middleware_stack(scope, receive, send) File "C:\programes\miniconda3\envs\vt\lib\site-packages\starlette\routing.py", line 735, in app await route.handle(scope, receive, send) File "C:\programes\miniconda3\envs\vt\lib\site-packages\starlette\routing.py", line 362, in handle await self.app(scope, receive, send) File "C:\programes\miniconda3\envs\vt\lib\site-packages\starlette\routing.py", line 95, in app await wrap_app_handling_exceptions(app, session)(scope, receive, send) File "C:\programes\miniconda3\envs\vt\lib\site-packages\starlette_exception_handler.py", line 62, in wrapped_app raise exc File "C:\programes\miniconda3\envs\vt\lib\site-packages\starlette_exception_handler.py", line 51, in wrapped_app await app(scope, receive, sender) File "C:\programes\miniconda3\envs\vt\lib\site-packages\starlette\routing.py", line 93, in app await func(session) File "C:\programes\miniconda3\envs\vt\lib\site-packages\fastapi\routing.py", line 383, in app await dependant.call(**solved_result.values) File "C:\eines\llm-amb-config-fastwhisperetc-tts-detotscolors-ollama-animee\Open-LLM-VTuber\server.py", line 87, in websocket_endpoint await websocket.send_text( File "C:\programes\miniconda3\envs\vt\lib\site-packages\starlette\websockets.py", line 165, in send_text await self.send({"type": "websocket.send", "text": data}) File "C:\programes\miniconda3\envs\vt\lib\site-packages\starlette\websockets.py", line 88, in send raise WebSocketDisconnect(code=1006) starlette.websockets.WebSocketDisconnect ERROR: Exception in ASGI application Traceback (most recent call last): File "C:\programes\miniconda3\envs\vt\lib\site-packages\uvicorn\protocols\websockets\websockets_impl.py", line 332, in asgi_send await self.send(data) # type: ignore[arg-type] File "C:\programes\miniconda3\envs\vt\lib\site-packages\websockets\legacy\protocol.py", line 630, in send await self.ensure_open() File "C:\programes\miniconda3\envs\vt\lib\site-packages\websockets\legacy\protocol.py", line 931, in ensure_open raise self.connection_closed_exc() websockets.exceptions.ConnectionClosedError: no close frame received or sent

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "C:\programes\miniconda3\envs\vt\lib\site-packages\starlette\websockets.py", line 85, in send await self._send(message) File "C:\programes\miniconda3\envs\vt\lib\site-packages\starlette_exception_handler.py", line 48, in sender await send(message) File "C:\programes\miniconda3\envs\vt\lib\site-packages\uvicorn\protocols\websockets\websockets_impl.py", line 345, in asgi_send raise ClientDisconnected from exc uvicorn.protocols.utils.ClientDisconnected

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "C:\programes\miniconda3\envs\vt\lib\site-packages\uvicorn\protocols\websockets\websockets_impl.py", line 244, in run_asgi result = await self.app(self.scope, self.asgi_receive, self.asgi_send) # type: ignore[func-returns-value] File "C:\programes\miniconda3\envs\vt\lib\site-packages\uvicorn\middleware\proxy_headers.py", line 70, in call return await self.app(scope, receive, send) File "C:\programes\miniconda3\envs\vt\lib\site-packages\fastapi\applications.py", line 1054, in call await super().call(scope, receive, send) File "C:\programes\miniconda3\envs\vt\lib\site-packages\starlette\applications.py", line 113, in call await self.middleware_stack(scope, receive, send) File "C:\programes\miniconda3\envs\vt\lib\site-packages\starlette\middleware\errors.py", line 152, in call await self.app(scope, receive, send) File "C:\programes\miniconda3\envs\vt\lib\site-packages\starlette\middleware\exceptions.py", line 62, in call await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send) File "C:\programes\miniconda3\envs\vt\lib\site-packages\starlette_exception_handler.py", line 62, in wrapped_app raise exc File "C:\programes\miniconda3\envs\vt\lib\site-packages\starlette_exception_handler.py", line 51, in wrapped_app await app(scope, receive, sender) File "C:\programes\miniconda3\envs\vt\lib\site-packages\starlette\routing.py", line 715, in call await self.middleware_stack(scope, receive, send) File "C:\programes\miniconda3\envs\vt\lib\site-packages\starlette\routing.py", line 735, in app await route.handle(scope, receive, send) File "C:\programes\miniconda3\envs\vt\lib\site-packages\starlette\routing.py", line 362, in handle await self.app(scope, receive, send) File "C:\programes\miniconda3\envs\vt\lib\site-packages\starlette\routing.py", line 95, in app await wrap_app_handling_exceptions(app, session)(scope, receive, send) File "C:\programes\miniconda3\envs\vt\lib\site-packages\starlette_exception_handler.py", line 62, in wrapped_app raise exc File "C:\programes\miniconda3\envs\vt\lib\site-packages\starlette_exception_handler.py", line 51, in wrapped_app await app(scope, receive, sender) File "C:\programes\miniconda3\envs\vt\lib\site-packages\starlette\routing.py", line 93, in app await func(session) File "C:\programes\miniconda3\envs\vt\lib\site-packages\fastapi\routing.py", line 383, in app await dependant.call(**solved_result.values) File "C:\eines\llm-amb-config-fastwhisperetc-tts-detotscolors-ollama-animee\Open-LLM-VTuber\server.py", line 87, in websocket_endpoint await websocket.send_text( File "C:\programes\miniconda3\envs\vt\lib\site-packages\starlette\websockets.py", line 165, in send_text await self.send({"type": "websocket.send", "text": data}) File "C:\programes\miniconda3\envs\vt\lib\site-packages\starlette\websockets.py", line 88, in send raise WebSocketDisconnect(code=1006) starlette.websockets.WebSocketDisconnect INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [10100] ^C (vt) C:\eines\llm-amb-config-fastwhisperetc-tts-detotscolors-ollama-animee\Open-LLM-VTuber>

t41372 commented 3 days ago

Fixing it