search

microsoft / autogen

A programming framework for agentic AI 🤖
https://microsoft.github.io/autogen/
Creative Commons Attribution 4.0 International
35.17k stars 5.09k forks source link

[Roadmap]: Gemini Integration #2387

Open BeibinLi opened 7 months ago

BeibinLi commented 7 months ago

[!TIP]

Want to get involved?

We'd love it if you did! Please get in contact with the people assigned to this issue, or leave a comment. See general contributing advice here too.

Intro

Gemini is a Google GenAI product that offers another set of GenAI models for users. Since December 2023, our "gemini" branch has seen significant community interest, including the integration of Gemma with autogen earlier this year. We're now excited to bring the experimental Gemini branch into AutoGen's main release. While we currently offer Gemini chat completion and vision models, this roadmap aims to unlock more potential of Google Gemini within AutoGen, laying out TODOs, feature requests, and future directions.

The Roadmap

Merged PR: https://github.com/microsoft/autogen/pull/2360

Future:

NikolayTV commented 7 months ago

Hi! Is it the list of planned features for future or is it what have been done? I don't see safety settings or generation config in this PR, and wanted to be active contributor to the repo because im gonna be using it very actively. Could I help with it?

  • GenerationConfig Parameters: temperature, max_tokens, etc.
  • Multiple Responses: generate several responses at the same time.
  • Cost/Token Calculation. Great feedback from @joshkyh , documentation
  • Function Calling.
  • JSON Output: structure outputs in JSON.
  • Image Generation.
  • Other Modalities: audio/video generation and processing.
  • Safety Settings: user-customizable safety controls. Feedback from @marklysze chat.send_message("hi", stream=stream, safety_settings=safety). documentation
  • Multi-turn Vision Chat: improve conversational context for image tasks.
  • Streaming: real-time output from the client.
ekzhu commented 7 months ago

@NikolayTV the list are tasks not yet completed. If you are interested to contribute, we can discuss here and create an issue for you. cc @BeibinLi @sonichi

NikolayTV commented 7 months ago

Thanks! Here is my first PR #2429

abhinavankur commented 7 months ago

How can I contribute?

randombet commented 7 months ago

How can I contribute? Welcome @abhinavankur You may find the contribution guide at https://microsoft.github.io/autogen/docs/contributor-guide/contributing/

arjun-g commented 6 months ago

My PR for Function Calling support #2793

yeounoh commented 5 months ago

Hi I would like to help/contribute as well. Any open issues from the list? (cc hello @ekzhu @sonichi )

yeounoh commented 5 months ago

Hi I would like to help/contribute as well. Any open issues from the list? (cc hello @ekzhu @sonichi )

I raised a feature request for caching, (https://github.com/microsoft/autogen/issues/3038) -- I can take this as my first contribution?