Explicit Caching patch - Githubissues

google-gemini / generative-ai-python

The official Python library for the Google Gemini API

https://pypi.org/project/google-generativeai/

Apache License 2.0

1.45k stars 286 forks source link

Closed mayureshagashe2105 closed 3 months ago

mayureshagashe2105 commented 4 months ago

follow-on PR for #355

Patch .update
Remove __new__ constructs, and add public property to access cached_content on GenerativeModel class.
Reomve auto cache deletion.
Remove name param
Handle ttl and expire_time separately
Implict role assignment as user if the content is of type list[str] | str
Minor fixes

mayureshagashe2105 commented 3 months ago

Yeah, It simply overrides the name.

mayureshagashe2105 commented 3 months ago

@MarkDaoust @markmcd We are good to go with context caching 🥳. Thanks for all the feedback and contributions.

@markmcd can you please review my last commits. Thanks!