continuedev / continue

⏩ Continue is the leading open-source AI code assistant. You can connect any models and any context to build custom autocomplete and chat experiences inside VS Code and JetBrains
https://docs.continue.dev/
Apache License 2.0
19.25k stars 1.66k forks source link

Prompt caching for providers (other than Claude) #2962

Open dalisoft opened 3 hours ago

dalisoft commented 3 hours ago

Validations

Problem

Currently supports only Claude prompt caching per documentation and did not find (from search) for other providers such as DeepSeek, OpenAI. Or this is effectively for other providers too?

Previously used cacheSystemMessage: true for all providers but not sure it did help or not. Would be helpful to enable caching (especially for chat) for more cheaper solution

Solution

No response