Open aizaiyishunjian opened 10 months ago
It looks to me like these APIs would also have a problem with the "name" attribute that is important for Group Chat scenarios. I'm not sure compatibility will be easy to achieve. @LittleLittleCloud
For the multi-system-message issue, you can override the select_speaker()
function. The "name" attribute issue mentioned by @afourney needs attention too.
multiple 'system' messages are also causing a problem with using litellm proxy on claude 3 models. is there a work around for this issue?
multiple 'system' messages are also causing a problem with using litellm proxy on claude 3 models. is there a work around for this issue?
here is a potential fix, do you want to try to implement it? https://github.com/microsoft/autogen/issues/1861
Increasingly I think we need middleware for messages. The format AutoGen uses should be able to diverge from that used by the LLMs, with messages transformed just prior to making the LLM call.
I'm getting the following error using groupchats with Claude-3. I believe it might be related to this issue. Followed the example on the documentation for configuration.
anthropic.BadRequestError: Error code: 400 - {'type': 'error', 'error': {'type': 'invalid_request_error', 'message': 'messages.0.name: Extra inputs are not permitted'}}
GroupChatManager requests the 'messages' of the model, passing multiple system messages.
However, for encapsulated OpenAI APIs like fschat, the setting of system messages is overridden, hence only one is retained.: