search

sourcegraph / cody

AI that knows your entire codebase
https://cody.dev
Apache License 2.0
2.24k stars 213 forks source link

Leaderboard: add autocomplete benchmarks #4659

Closed olafurpg closed 1 week ago

olafurpg commented 1 week ago

An incomplete implementation of autocomplete evals. Want to merge this now to unblock another PR for chat evals that depend on the diff here.

Test plan

N/a

olafurpg commented 1 week ago

This is a low-risk PR to merge because the diff is limited to the cody-bench tool