Open agilebean opened 1 month ago
Just found out that
await task.queue_frames([OpenAILLMContextFrame(context)])
doesn't have any response at all if the LLM is instantiated as LangchainProcessor.
In conclusion, the above error message is generated most likely by
LLMUserContextAggregator(context)
LLMAssistantContextAggregator(context)
Current Code
Used the pipecat example code here to define the context and pass it to OpenAILLMContext.
Expected Behavior
The system message is passed to the LLM when instantiated by
LangchainProcessor
the same way as byOpenAILLMService
. If so, the system role would be recorded as follows:Current Behavior
At the first invocation of the LLM, this error is thrown:
with traceback
Caveat
Further testing confirmed: This error occurs when
OpenAILLMContext
used withLangchainProcessor
. In contrast, using an LLM instantiated directly from the API works: