microsoft / autogen

A programming framework for agentic AI 🤖
https://microsoft.github.io/autogen/
Creative Commons Attribution 4.0 International
32.19k stars 4.69k forks source link

AutoGen Studio skill does not work in a GroupChat (with groupchatmanager and 2-3 agents) #3655

Open joslat opened 2 weeks ago

joslat commented 2 weeks ago

What happened?

Hi, I am having the following problem: With the simple two agent chat to create a book with pictures, everything works. I put a chat with the user_proxy and another with the book_creator_assistant with the two skills and I get it all.

But, if I do it with an Agent_chat_manager and three agents, Book_concept for writing the book concept Book_concept_critic for critizicing constructively the book concept and "APPROVE" Book_composer for creating the book, armed with the pdf and image skills.

The manager has clear instructions to derive first to the book_concept and pass it to the book_concept_critic until it "APPROVE" or a number of turns, and then handover to the Book_composer.

This happens but the book_composer cannot use the skill due that the OPEN_AI_KEY is invalid...??

But the skill worked on the previous flow? I checked it and it is ok. I reviewed the workflows and all looks good.

Any suggestion? is this a known bug? any help is welcome 🙂

What did you expect to happen?

The skill works when invoked by all agents and inside a GroupChat

How can we reproduce it (as minimally and precisely as possible)?

Seems like that an agent chat manager that contains an agent with a skill that has a connection will not run properly, but that agent run as a single agent with that skill runs properly.

AutoGen version

AutoGen Studio CLI version: 0.1.5

Which package was this bug in

AutoGen Studio

Model used

gpt-4o

Python version

Python 3.11.9

Operating system

Windows 11

Any additional info you think would be helpful for fixing this bug

No response

rysweet commented 1 week ago

@victordibia can you please have a look?