search

microsoft / autogen

A programming framework for agentic AI 🤖
https://microsoft.github.io/autogen/
Creative Commons Attribution 4.0 International
34.65k stars 5.01k forks source link

Exporting an OpenAI compatible API for an agent #4274

Open matbee-eth opened 2 days ago

matbee-eth commented 2 days ago

What feature would you like to be added?

I would love to have a /v1/chat endpoint that communicates with my Autogen agents. Is there any simple platforms that support this with autogen agents?

Why is this needed?

So I can interface with it with external openai api compatible clients

ekzhu commented 1 day ago

You can read about the API doc: https://microsoft.github.io/autogen/dev/reference/python/autogen_ext/autogen_ext.models.html#autogen_ext.models.OpenAIChatCompletionClient

matbee-eth commented 1 day ago

No I want to SERVE the agent over an OpenAI API compatible endpoint

ekzhu commented 1 day ago

No I want to SERVE the agent over an OpenAI API compatible endpoint

No, we don't have it in the current Python API. If you are interested, you can start a community package. See: https://microsoft.github.io/autogen/dev/user-guide/extensions-user-guide/index.html.

It is even more interesting to support (partially) an Assistant API.