Agent Issue With AutoGen Studio

[arch3angel]

Hello,

Everything generates in AutoGroq fine, imports into AutoGen database just fine. I change the LLM to a local LLM running on LMStudio. Everytime I try to run the agents and workflow generated by AutoGroq I get an API key error, if I manually generate the agents it works fine.

Any suggestions?

Thank you!

[gxgl]

Hi,

I had the same issue. I didn't looked deeper to see the problem, but it looks like the setting in autogenstudio is not overwriting the model in agent so I have edited the files with gpt-4o (replaced the mistral model - in my case) and also the max_tokens value which for gpt-4o should be 4096 and then reimported the files.

I hope this will help you.

All the best, George

[arch3angel]

Hi,

I had the same issue. I didn't looked deeper to see the problem, but it looks like the setting in autogenstudio is not overwriting the model in agent so I have edited the files with gpt-4o (replaced the mistral model - in my case) and also the max_tokens value which for gpt-4o should be 4096 and then reimported the files.

I hope this will help you.

All the best, George

Can you show me an example of what you changed and where?

[jgravelle]

Yep. That's exactly what I'm doing here: https://www.youtube.com/watch?v=IlTovnAqMqM&t=85s

I need to add the ability to specify models rather than taking the Autogen default. Probably per agent... -jjg

On Sat, May 25, 2024 at 9:03 PM Robert Miller @.***> wrote:

Hi,

I had the same issue. I didn't looked deeper to see the problem, but it looks like the setting in autogenstudio is not overwriting the model in agent so I have edited the files with gpt-4o (replaced the mistral model - in my case) and also the max_tokens value which for gpt-4o should be 4096 and then reimported the files.

I hope this will help you.

All the best, George

Can you show me an example of what you changed and where?

— Reply to this email directly, view it on GitHub https://github.com/jgravelle/AutoGroq/issues/26#issuecomment-2131958091, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAZ6GXF7PIGCUNELXY2Y3TTZEE7IVAVCNFSM6AAAAABIJDSKCSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMZRHE2TQMBZGE . You are receiving this because you are subscribed to this thread.Message ID: @.***>

[gxgl]

Hi @arch3angel,

sure thing.

After you download and extract the files into a folder:

1. Right click on that folder and open it in VSCode or any other editor that supports multi file search and replace and you will end up with something like this: Then open an agent file (doesn't matter which one) and look for "model" and note the used model (example: "model": "mixtral-8x7b-32768", next look for "max_tokens" (example: "max_tokens": 32768) and note the values of these two. Example in a file:

2. Click on the magnification glass (search) if you use VSCode else you need to figure it out yourself how your preferred editor works and you will have a screen like this:

• Now put in "Search" field mixtral-8x7b-32768 and gpt-4o in "Replace" field and it will show somehow near to this: ...and if looks fine to you, then click on "Replace All" button near to "Replace" field in the right (marked by red sqaure in the next image).
• Repeat the step for the max_tokens value if is the case - For gpt-4o it must be 4096:

At the end it will look like this: ...now save all files and that's all. I think...

I hope this helps.

All the best, George

[jgravelle]

Alright, people. Click on any agent's gear icon and you'll see you can set any model listed in the config.py

If you don't select any, the current main dropdown selection will be used by default. AND you can change all agents at once.

Hope this makes things nicer...

-jjg