microsoft / autogen

A programming framework for agentic AI 🤖
https://microsoft.github.io/autogen/
Creative Commons Attribution 4.0 International
29.94k stars 4.36k forks source link

[Feature Request]: Enable overwrite_tools in register_for_llm for GPTAssistantAgent #2575

Open jtrugman opened 3 months ago

jtrugman commented 3 months ago

Is your feature request related to a problem? Please describe.

Re: Conversation between Eric and I We should have the ability to set the tools a GPTAssistantAgent can use via the register_for_llm paradigm that is set up. Currently, register_for_llm does not work for GPTAssistantAgent because it does not update the tools for the OpenAI Assistants API. This results in the issue described here in PR-2375 where fetching the tools via llm_config["tools"] returns the proper tools, but seeing the tools the Assistant API has access too on the OpenAI Platform Portal shows the tools not being there.

Describe the solution you'd like

We agreed that we should have the ability to overwrite_tools for register_for_llm. Basically the logic in overwrite_tools that enables you to use the underlying OpenAI APIs to update the tool available to the Assistant API should be applied for then you are register_for_llm on a GPTAssistantAgent. This we have feature parity between GPTAssistantAgent and ConversableAgent.

Additional context

No response

jtrugman commented 3 months ago

@ekzhu can you assign this issue to me? I can work on it