pipecat-ai / pipecat

Open Source framework for voice and multimodal conversational AI
BSD 2-Clause "Simplified" License
3.25k stars 287 forks source link

Storybot interaction issues #216

Open rwmjhb opened 4 months ago

rwmjhb commented 4 months ago

I modified the llm service code to local ollama. After the program started, everything was fine at first. The robot asked me what kind of story I wanted to hear. I answered it, and then it told me the first paragraph. When it finished telling this When I was asked about my next step needs, the microphone on the page turned gray, and there was no error message in the log. The page was obviously waiting for my response, but because the microphone turned gray, I couldn't answer it. I observed that the Chrome tab shows that the microphone is running normally, I posted the log below, hoping someone can help me.

jptaylor commented 4 months ago

Did you remove the DailyTransportMessageFrame(CUE_USER_TURN) frame from the pipeline? Or does it get shown in the logs? This is an app message that gets sent to the UI in order to trigger the user's turn.

I will give this a try with a local LLM and see if I can replicate.

rwmjhb commented 4 months ago

I just modified the code about the llm service part to ollama, and the other parts were completely untouched.

rwmjhb commented 4 months ago

Did you remove the DailyTransportMessageFrame(CUE_USER_TURN) frame from the pipeline? Or does it get shown in the logs? This is an app message that gets sent to the UI in order to trigger the user's turn.

I will give this a try with a local LLM and see if I can replicate.

Hi,Is there any progress?