sourcegraph / cody

AI that knows your entire codebase
https://cody.dev
Apache License 2.0
2.24k stars 213 forks source link

Chat: adapt context preamble for Sonnet 3.5 #4666

Closed jtibshirani closed 1 week ago

jtibshirani commented 1 week ago

This PR enables Claude Sonnet 3.5 in the chat quality and edit tests to check its results. In the initial chat test results, Sonnet 3.5 refused to answer 'general codebase context' questions. So we also tweak the 'context preamble' to fix these cases. This tweak does not regress tests on other models.

Test plan

Adapted chat and edit tests