google-genai [feature]: Context Caching

langchain-ai / langchainjs

🦜🔗 Build context-aware reasoning applications 🦜🔗

https://js.langchain.com/docs/

MIT License

12.71k stars 2.19k forks source link

google-genai [feature]: Context Caching #7169

Open KevinZJN opened 1 week ago

KevinZJN commented 1 week ago

Fixes #5841

Implemented conetxt caching feature for google-genai, we now allow user to caching a file and create gen-ai model base on the cached content

vercel[bot] commented 1 week ago

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
langchainjs-docs	✅ Ready (Inspect)	Visit Preview		Nov 13, 2024 5:43pm

1 Skipped Deployment

KevinZJN commented 3 days ago

Hi @jacoblee93, we've implemented the foundational structure for context caching with files. Could you take a look and let us know if the code aligns with our intended design? Thank you!