[CON-266] Improved "Apply" prompting

continuedev / continue

⏩ Continue is the leading open-source AI code assistant. You can connect any models and any context to build custom autocomplete and chat experiences inside VS Code and JetBrains

https://docs.continue.dev/

Apache License 2.0

19.54k stars 1.7k forks source link

[CON-266] Improved "Apply" prompting #2137

Open sestinj opened 2 months ago

sestinj commented 2 months ago

Validations

[X] I believe this is a way to improve. I'll try to join the Continue Discord for questions
[X] I'm not able to find an open issue that requests the same enhancement

Problem

GPT-4o-mini can sometimes output english, which should be avoided at all costs. A better prompt/filtering can fix this

Solution

No response

_CON-266

sestinj commented 2 months ago

Sidenote: it's possible to get really quick diff application in some cases if you look for full overwrites. You could just ask a language model whether this is an exact overwrite, and if so do that.

sestinj commented 2 months ago

Another good idea: Do "lazy" full file rewrite, and then a series of find/replace to fill that in