microsoft / autogen

A programming framework for agentic AI 🤖
https://microsoft.github.io/autogen/
Creative Commons Attribution 4.0 International
31.58k stars 4.59k forks source link

[Roadmap] AutoGen Studio #737

Open gagb opened 10 months ago

gagb commented 10 months ago

[!TIP]

Want to get involved?

We'd love it if you did! Please get in contact with the people assigned to this issue, or leave a comment. See general contributing advice here too.

The app is in /samples/apps/autogen-studio . Contribution guide is here.

### Roadmap
- [x] [P0] Rewrite DB Layer to enable entity linking #1694. #1342
- [ ] [P0] Support for a public gallery of agents, workflows, skills, sessions (logs)
- [x] [P0] Support additional types of workflows in AGS - e.g.., current twoagent/groupchat, sequential chat, automated workflows.
- [ ] [P0] Add ability to learn skills, help users create skills #1442
- [ ] [P0] Better UX for authoring workflows #1362
- [ ] https://github.com/microsoft/autogen/issues/1358
- [ ] https://github.com/microsoft/autogen/issues/3058
- [ ] [P1] Allow users to interrupt a multi-agent conversation
- [ ] [P1] Ability to rate agents, workflows, skills, sessions
- [ ] [P3] Support extracting skills from current session
- [ ] https://github.com/microsoft/autogen/issues/1364
- [ ] [P3] Test UI on mobile device views
- [ ] [P3] Testing on Windows
- [ ] https://github.com/microsoft/autogen/issues/1361
- [ ] https://github.com/microsoft/autogen/issues/1391
- [ ] [AutoGen Studio] Support Authentication in AutoGen Studio
victordibia commented 10 months ago

Great. Current work for this is being done on the autogenstudio branch.

iMicknl commented 10 months ago

Would it make sense to have the devcontainer compatible with AutoGen Studio? Currently it is a pain to run AutoGen Studio from the default devcontainer of this project. Best would be if it is fully ready, and even has a VSCode task to start AutoGen Studio.

gagb commented 10 months ago

Would it make sense to have the devcontainer compatible with AutoGen Studio? Currently it is a pain to run AutoGen Studio from the default devcontainer of this project. Best would be if it is fully ready, and even has a VSCode task to start AutoGen Studio.

Good point. Added to the feature list.

gagb commented 8 months ago

Would it make sense to have the devcontainer compatible with AutoGen Studio? Currently it is a pain to run AutoGen Studio from the default devcontainer of this project. Best would be if it is fully ready, and even has a VSCode task to start AutoGen Studio.

Good point. Added to the feature list.

@iMicknl this was added

glindberg2000 commented 8 months ago

Is it possible to use Teachable Agents and if not will it be supported in the future?

JonasBE13 commented 8 months ago

Will RAG be added for AutoGen studio?

romilandc commented 5 months ago

Would it make sense to add Ollama model configuration within the Build -> Models tab? The only method I know of uses is supported by LiteLLM, e.g. https://gist.github.com/shimomurakei/5692335e4fdfb12450afa2580002db77 but UI configuration would be great. Thank you!

victordibia commented 5 months ago

Hi @romilan24 ,

Thanks for the note. Ollama does provide an openai compatible api. https://ollama.com/blog/openai-compatibility. This way, if you put in your model name, base url and api key, (similar to how you will use an openai model) Are you having any issues with this?

romilandc commented 5 months ago

Hi @romilan24 ,

Thanks for the note. Ollama does provide an openai compatible api. https://ollama.com/blog/openai-compatibility. This way, if you put in your model name, base url and api key, (similar to how you will use an openai model) Are you having any issues with this?

That actually worked! Thank you for the suggestion, very simple implementation. Then I would suggest we add this as an example for reference because I wasn't able to find any recent examples showing this.

Took some screenshots for reference: image image image

Happy to write this up as well. Thanks @victordibia

harrywang commented 2 months ago

@gagb @victordibia @JingyaChen

Thanks for creating the great AutoGen framework - I have been using it to teach my students about AI agents. My startup Takin.ai (https://takin.ai/) wants to integrate with AutoGen Studio and we saw the new interface shown on the release news web page (https://www.microsoft.com/en-us/research/blog/introducing-autogen-studio-a-low-code-interface-for-building-multi-agent-workflows/).

Screenshot 2024-07-19 at 7 52 09 AM

It seems the changes are quite significant - I wonder whether you can provide any information on the new version of AutoGen Studio:

  1. Will the tech stack be changed? the current one is Fastapi + Gatsby

  2. When will the new version be released? Any estimate?

Should we wait for the new version or use the current version?

Thanks a lot for your help!

joslat commented 2 months ago

Yes great point, wondering if this roadmap is still relevant. Anyhow I agree on that the UI is sweet enough to "ask for more" :)

victordibia commented 2 months ago

@harrywang

We expect the same backend functionality and tech stack, just updates to UX.

harrywang commented 2 months ago

@harrywang

We expect the same backend functionality and tech stack, just updates to UX.

  • Gatsby and FastAPI will remain unchanged.

  • We do not have an ETA at the moment, but working on this.

@victordibia Thanks a lot. Your reply is very helpful!