pipecat-ai / pipecat

Open Source framework for voice and multimodal conversational AI
BSD 2-Clause "Simplified" License
3.44k stars 335 forks source link

Empty text content bug fix for Gemini #743

Closed kwindla closed 4 days ago

kwindla commented 4 days ago

When pushing function call context we need to make sure not to add text content items that are empty.

I'm not sure if this is a regression that snuck into Pipecat code, or whether this is new model behavior we haven't seen before. But either way, this is a small but important check. (If we push an empty text content message, all inference requests subsequently fail.)

Also started testing with gemini-exp-1114. Text, audio, image, and function calling inference all work with no changes to the GoogleLLMService.