The current prompt for editing files requires the LLM to rewrite the entire range that it wants to edit. Ideally, it could specify only the diff, or at most a few lines surrounding the areas that it wants to edit.
To see the start of one attempt at this, look here. One idea on how to do this is by getting the LLM to output git merge conflict notation, like this:
<<<<<<< HEAD
<OLD_CODE>
=======
<NEW_CODE>
>>>>>>> updated
Other ideas:
Fine-tune a model to generate a git diff
Get the model to quote parts of the range it wants to edit
Give the model tools like "insert here", "delete here", or "find and replace"
The current prompt for editing files requires the LLM to rewrite the entire range that it wants to edit. Ideally, it could specify only the diff, or at most a few lines surrounding the areas that it wants to edit.
To see the start of one attempt at this, look here. One idea on how to do this is by getting the LLM to output git merge conflict notation, like this:
Other ideas: