Open naman-scogo opened 4 days ago
Hi, friend. I was trying to run the same example but I can't. On my windows machine I always have this error:
{"message": "silero stream failed\nTraceback (most recent call last):\n File \"D:\!!!Trabajo\!!Natasquad\Repos\Live-Agent\env\lib\site-packages\livekit\plugins\silero\vad.py\", line 148, in _run\n await asyncio.shield(self._run_inference())\n File \"D:\!!!Trabajo\!!Natasquad\Repos\Live-Agent\env\lib\site-packages\livekit\plugins\silero\vad.py\", line 171, in _run_inference\n raw_prob = await asyncio.to_thread(\n File \"D:\!!!Trabajo\!!Natasquad\Repos\Live-Agent\env\lib\asyncio\threads.py\", line 25, in to_thread\n return await loop.run_in_executor(None, func_call)\n File \"D:\!!!Trabajo\!!Natasquad\Repos\Live-Agent\env\lib\concurrent\futures\thread.py\", line 58, in run\n result = self.fn(*self.args, **self.kwargs)\n File \"D:\!!!Trabajo\!!Natasquad\Repos\Live-Agent\env\lib\site-packages\livekit\plugins\silero\vad.py\", line 172, in
TL:DR
[ONNXRuntimeError] : 2 : INVALID_ARGUMENT : Unexpected input data type. Actual: (tensor(int32)), expected: (tensor(int64))
I have made a Voice Assistant using the kitt example
It can interact over voice as well as text messages.
Once the user ends the call/room, the assistant is designed to process all the messages and store them in a persistent database.
However, after the call ends, all the ChatMessaged pushed to the ChatContext using llm.chat() method while answering the text messages from the user are not present in the messages array.
The same happens if I push a System Message to the context while sending a system message to the llm after the function calls are finished.