gmickel / CodeWhisper

CodeWhisper: AI-Powered End-to-End Task Implementation & blazingly fast Codebase-to-LLM Context Bridge
https://discord.com/invite/82mjJkwABQ
MIT License
57 stars 4 forks source link

Implement Prompt Caching for Anthropic models #94

Open gmickel opened 3 months ago

gmickel commented 3 months ago

see: https://docs.anthropic.com/en/docs/build-with-claude/prompt-caching

This would allow Codewhisper to cache the system prompt, task and codebase context between the planning and code modification step.