search

sourcegraph / cody

Type less, code more: Cody is an AI code assistant that uses advanced search and codebase context to help you write and fix code.
https://cody.dev
Apache License 2.0
2.71k stars 297 forks source link

Small improvements to cody bench context #5641

Closed beyang closed 1 month ago

beyang commented 1 month ago

Adjust the overlap threshold at which we count something as a "hit". The ground truth now includes some pretty large blocks of context, so we use a min of a percentage threshold and a constant line overlap.

Make error messages more descriptive when cody internal bench fails.

Test plan

N/A (benchmarks only)