search

microsoft / autogen

A programming framework for agentic AI. Discord: https://aka.ms/autogen-dc. Roadmap: https://aka.ms/autogen-roadmap
https://microsoft.github.io/autogen/
Creative Commons Attribution 4.0 International
27.96k stars 4.08k forks source link

[Feature Request]: context caching for gemini-1.5 #3038

Open yeounoh opened 2 days ago

yeounoh commented 2 days ago

Is your feature request related to a problem? Please describe.

Context caching is critical in reducing the cost over repeated prompts and/or requests. We can also expose and leverage this as part of the ongoing gemini integration efforts.

Describe the solution you'd like

Provide an API for caching and provide examples for the usage.

Additional context

https://ai.google.dev/gemini-api/docs/caching?utm_source=gais&utm_medium=email&utm_campaign=june&lang=python

yeounoh commented 2 days ago

I can raise a PR for this, but currently not allowed to claim (assign to myself) the issue.

LittleLittleCloud commented 1 day ago

@yeounoh just assign this task to you, let us know if you need further assistance.