A programming framework for agentic AI 🤖
Creative Commons Attribution 4.0 International
32.64k
stars
4.75k
forks
source link
[Bug]: tool response will be wrong when tool_caller‘s llm_config include stream=True and n > 0 #3506
Open
yinzuoweia opened 1 month ago
Describe the bug
when set stream=True and n > 0 in llm_config. OpenAIClient.create will raise an exception cause
type
!= "function" The debug variables like:Steps to reproduce
Model Used
gpt-4o
Expected Behavior
every choice should has it's own tool call response
Screenshots and logs
No response
Additional Information
No response