google-gemini / generative-ai-js

The official Node.js / Typescript library for the Google Gemini API

https://www.npmjs.com/package/@google/generative-ai

Apache License 2.0

679 stars 141 forks source link

Add the Content caching feature #167

Closed hsubox76 closed 3 months ago

hsubox76 commented 3 months ago

Feature: Content Caching

Design doc (API) (internal): https://docs.google.com/document/d/1kJTdoz-RO7mkzsjE1QDfJfD1YvSxJXuzmqTAtsS1hJ0/edit?resourcekey=0-cv2C2J8SLDn__yoetTPvBw&tab=t.0 Design doc (Python SDK) (internal): https://docs.google.com/document/d/11en7rPCuXIu-hfF71jUDWkfQctWeFEoq_5KgkinnxWg/edit?resourcekey=0-ntvB0-Y_GBQXOfkO-KDaXg&tab=t.0

APIs added

GoogleAICacheManager class (exported from new /server path) with create, update, get, list, delete methods.
GoogleGenerativeAI.getGenerativeModelFromContextCache() added

Infrastructure changed

/files subpath changed to /server. GoogleAIFileManager and GoogleAICacheManager will be exported from here as they are only meant to be used in a server environment.
All types moved to a single folder.
Generate common/api-review md files for easier review of API mistakes/gaps
Refactor makeRequest-related functions to reduce code duplication

DellaBitta commented 3 months ago

Fixes merged. Documentation merged.