[Issue]: Why is response_format ignored in groq?

autogenhub / autogen

A programming framework for agentic AI. Discord: https://discord.gg/pAbnFJrkgZ

https://autogenhub.github.io/autogen/

Apache License 2.0

119 stars 23 forks source link

[Issue]: Why is response_format ignored in groq? #77

Open r4881t opened 1 month ago

r4881t commented 1 month ago

Describe the issue

I looked into the code and found that response_format is ignored in groq. https://github.com/autogenhub/autogen/blob/e90aee43ed8eb156d5b27c99f642dd08aff9c6c5/autogen/oai/groq.py#L121

Why would this be? Similar params in OpenAI are not ignored.

Steps to reproduce

No response

Screenshots and logs

No response

Additional Information

No response

marklysze commented 1 month ago

Hey @r4881t, it's a good question... It's currently noted as a beta feature and in their documentation they note this against it: Important: when using JSON mode, you must also instruct the model to produce JSON yourself via a system or user message..

Would having the parameter be beneficial to you? If so, would you like to create a PR for it? I can assist if needed.